Multitoe: High-Precision Interaction with Back-Projected Floors Based on High-Resolution Multi-Touch Input

Figure 1

Integrating high-resolution FTIR into a back-projected floor allows the floor to see the pressure distribution of the user's soles (inset top left, as seen from below). In the shown situation, the floor ignores the foot on the right based on its posture, yet allows the foot on the left to interact. By identifying the user based on her sole patterns, the floor has attached a user-specific high-precision pointer to her foot, which allows her to operate tiny controls, here a keyboard.

Abstract

Tabletop applications cannot display more than a few dozen on-screen objects. The reason is their limited size: tables cannot become larger than arm's length without giving up direct touch. We propose creating direct touch surfaces that are orders of magnitude larger. We approach this challenge by integrating high-resolution multi-touch input into a back-projected floor. At the same time, we maintain the purpose and interaction concepts of tabletop computers, namely direct manipulation.

We base our hardware design on frustrated total internal reflection. Its ability to sense per-pixel pressure allows the floor to locate and analyze users' soles. We demonstrate how this allows the floor to recognize foot postures and identify users. These two functions form the basis of our system. They allow the floor to ignore users unless they interact explicitly, identify and track users based on their shoes, enable high-precision interaction, invoke menus, track heads, and allow users to control high-degree of freedom interactions using their feet. While we base our designs on a series of simple user studies, the primary contribution on this paper is in the engineering domain.

Publication

Thomas Augsten, Konstantin Kaefer, Rene Meusel, Caroline Fetzer, Dorian Kanitz, Thomas Stoff, Torsten Becker, Christian Holz and Patrick Baudisch. 2010. Multitoe: High-Precision Interaction with Back-Projected Floors Based on High-Resolution Multi-Touch Input. In Proceedings of the 23rd annual ACM symposium on User interface software and technology (ACM UIST '10). New York, NY, USA (October 3-6, 2010). ACM, New York, NY, USA, 209–218.

• paper
• video

BibTeX

@inproceedings{augsten2010,
	author = {Augsten, Thomas and Kaefer, Konstantin and Meusel, Ren\'{e} and
		Fetzer, Caroline and Kanitz, Dorian and Stoff, Thomas and
		Becker, Torsten and Holz, Christian and Baudisch, Patrick},
	title = {Multitoe: high-precision interaction with back-projected floors
		based on high-resolution multi-touch input},
	booktitle = {UIST '10: Proceedings of the 23nd annual ACM symposium on
		User interface software and technology},
	year = {2010},
	isbn = {978-1-4503-0271-5},
	pages = {209--218},
	location = {New York, New York, USA},
	doi = {http://doi.acm.org/10.1145/1866029.1866064},
	publisher = {ACM},
	address = {New York, NY, USA},
}