Smartphone Input Using an Integrated Projector and a Monocular Camera

  • Touch input on modern smartphones can be tedious, especially if the touchscreen is small. Smartphones with integrated projectors can be used to overcome this limitation by projecting the screen contents onto a surface, allowing the user to interact with the projection by means of simple hand gestures. In this work, we propose a novel approach for projector smartphones that allows the user to remotely interact with the smartphone screen via its projection. We detect user's interaction using the built-in camera, and forward detected hand gestures as touch input events to the operating system. In order to avoid costly computations, we additionally use built-in motion sensors. We verify the proposed method using an implementation for the consumer smartphone Samsung Galaxy Beam equipped with a deflection mirror.

Export metadata

Additional Services

Share in Twitter Search Google Scholar
Author:Sergiu Dotenco, Timo GötzelmannORCiD, Florian Gallwitz
Parent Title (English):Lecture Notes in Computer Science
Document Type:conference proceeding (article)
Date of Publication (online):2014/10/31
Year of first Publication:2014
Publishing Institution:Technische Hochschule Nürnberg Georg Simon Ohm
Release Date:2014/12/11
Tag:Limited input space; Mobile computing; Projector; Smartphone; Touch input
GND Keyword:App <Programm>; Programmierung; Projektionsapparat
Volume:Volume 8512
Konferenzangabe:16th International Conference on Human-Computer Interaction (HCII'14)
Dewey Decimal Classification:0 Informatik, Informationswissenschaft, allgemeine Werke
Licence (German):Keine Lizenz - Deutsches Urheberrecht gilt