Inspired by the Incredible Machine, the general objective of IncreTable is to arrange a given collection of virtual and real objects in a complex fashion sufficient to perform a simple task. Each level presents a puzzle requiring multi-modal interaction
provoking user creativity. Digital pens can be used to place virtual domino blocks. A depth ZSense camera from 3DV Systems, Ltd. is used to recognize physical objects (obstacles) and users’ gestures. The result, an 8 bit 320×240 depth image influences the digital terrain. Players can use any kind of physical objects (folded paper, ramps etc.) to modify the terrain. A projector is used to display the additional content (e.g. a jumping ball) on the surface. When the digital ball, for example, moves over a real ramp, it jumps appropriately. In addition, small robots move around the table interacting again with virtual and real items. These robots have embedded brightness sensors, which track projected markers. Finally, special physical objects, so called “portals”, are used to connect the virtual world with the real world. Using these portals, the real domino
bricks, for example, can be knocked over by the virtual ones and vice versa. Summarizing, IncreTable has the following novel features:
- Demonstration of multi-modal interaction based on new technologies
- The provision of new experiences dissolving the boundary between virtual and real worlds
- User-generated content through multi-user, interactive interfaces
- Bi-directional projection setup that allows content to be displayed in multiple levels.
The amalgamation of the real and virtual world through our technological developments allow for a new, unparalleled gaming experience.
