Tangible user interface

Tangible user interface
source
Name	Tangible user interface
Other names	TUI, Tangible computing
Classification	Human–computer interaction
Related concepts	Ubiquitous computing, Augmented reality, Haptic technology, Physical computing
Notable researchers	Hiroshi Ishii, Brygg Ullmer
Notable projects	MIT Media Lab, Urp, I/O Brush

Tangible user interface. A tangible user interface (TUI) is a user interface in which a person interacts with digital information through the physical environment. This paradigm, emerging from the field of human–computer interaction, seeks to bridge the gap between the physical and digital worlds by giving physical form to digital data and computation. TUIs leverage our innate abilities to grasp and manipulate physical objects, offering an alternative to the dominant graphical user interface model.

Definition and concept

The concept was pioneered by researchers like Hiroshi Ishii at the MIT Media Lab, who articulated the vision of "tangible bits." This framework posits that coupling physical representations with digital information can make computing more comprehensible and accessible. It draws inspiration from earlier work in ubiquitous computing by Mark Weiser and principles from embodied cognition. The core idea contrasts with the WIMP (computing) paradigm, instead emphasizing direct manipulation and physical affordances.

Historical development

Early precursors to TUIs include Ivan Sutherland's Sketchpad and Myron Krueger's Videoplace, which explored responsive environments. The field coalesced in the mid-1990s with foundational work at the MIT Media Lab under the Tangible Media Group. Seminal projects like Urp, an urban planning tool using physical building models, and I/O Brush, a drawing tool that captured real-world textures, demonstrated the potential. The term itself was popularized in a 1997 paper by Brygg Ullmer and Hiroshi Ishii, presented at the ACM Conference on Human Factors in Computing Systems.

Key characteristics and components

Key characteristics include the tight coupling of physical artifacts with digital representations, often described as "bits and atoms." Essential components are the physical objects or tokens, which serve as both representations and controls for underlying data. These are typically coupled with a sensing system, such as computer vision, RFID, or embedded sensors, to track manipulation. The interaction space, often a tabletop surface or room, and the underlying computational model that maps physical actions to digital outcomes are also critical.

Design principles and frameworks

Several design frameworks guide TUI development. The MCRpd interaction model, developed by MIT Media Lab, describes the relationship between physical Manipulators, digital Controllers, and their Representations. Principles emphasize making the interface's interactive properties perceptible and exploiting users' existing skills with the physical world. The concept of "embodied facilitation," where the physical configuration of objects guides interaction, is also central. These principles are often explored at venues like the ACM Symposium on User Interface Software and Technology.

Applications and examples

Applications span diverse domains. In education, systems like Sifteo cubes or Topobo, a kinetic construction kit, teach programming and dynamics. Scientific visualization is supported by tools like Tangible Geospace for geology. In design and planning, projects like the Illuminating Clay system for landscape analysis are notable. Commercial products include the Reactable, an electronic music instrument, and Microsoft PixelSense (formerly Surface). Museums, such as the Exploratorium, frequently employ TUIs for interactive exhibits.

Advantages and limitations

Advantages include intuitive interaction leveraging haptic feedback and spatial reasoning, support for collaborative work around a shared physical space, and engaging, often playful, user experiences. They can lower barriers for non-technical users and make abstract concepts more concrete. Limitations involve the cost and complexity of fabricating robust physical artifacts, scalability issues in representing large datasets, and challenges in general-purpose application compared to the flexibility of the graphical user interface. Maintenance and durability in public settings can also be problematic.

Future directions and research

Future research explores the convergence with augmented reality and mixed reality, creating hybrid interfaces that overlay digital information on physical objects. Advances in rapid prototyping and shape-changing interfaces are enabling more dynamic and adaptive tangible forms. Integration with the Internet of Things and ambient intelligence is another significant direction. Ongoing work at institutions like the MIT Media Lab, Stanford University, and Keio University, and presented at conferences like CHI (conference), continues to push the boundaries of material interaction.

Category:Human–computer interaction Category:User interfaces