Wearable Multitouch Interaction

Опубликовано 15 августа 2016, 19:19

We present is a wearable depth-sensing and projection system that enables interactive multitouch applications on everyday surfaces. Beyond the shoulder-worn system, there is no instrumentation of the user or environment. Foremost, the system allows the wearer to use their hands, arms and legs as graphical, interactive surfaces. Users can also transiently appropriate surfaces from the environment to expand the interactive area (e.g., books, walls, tables). On such surfaces - without any calibration - our device provides capabilities similar to that of a mouse or touchscreen: X and Y location in 2D interfaces and whether fingers are ΓÇ£clickedΓÇ¥ or hovering, enabling a wide variety of interactions. Reliable operation on the hands, for example, requires buttons to be 2.3cm in diameter. Thus, it is now conceivable that anything one can do on todayΓÇÖs mobile devices, they could do in the palm of their hand.