A Toolkit for Prototyping Tabletop-Centric Cross-Device Interaction.

Different types of devices are used in our daily lives, and each type has its own advantages and disadvantages. Cross-device interaction that involves multiple devices can potentially overcome each device's inherent disadvantages. Without a toolkit, it is time consuming to develop cross-device interaction. Focusing on a horizontal large display (called a tabletop), this paper proposes a generic toolkit for prototyping tabletop-centric cross-device applications that involve a large display and multiple smartphones. In our toolkit, a user uses a smartphone as a look-through lens for browsing and selecting objects on a tabletop, and remotely manipulates the selected object with multimodal feedback. Based on the above interaction style, our toolkit formalizes the development of cross-device interaction as defining a mobile interface on each tabletop interface object. Since our toolkit encapsulates the interface distribution and synchronization through message passing, interface developers can focus on developing cross-device interaction by designing a mobile interface in response to a selected tabletop interface object. In order to demonstrate the versatility and design space of our toolkit, six design issues, i.e., data transfer, personalization, user interface composition, authentication, localized & private feedback, and input expressiveness, were discussed through a set of sample applications. [ABSTRACT FROM AUTHOR]