Smartphone projector breathes life into storybooks

[Nipuna]

Hal Hodson, technology reporter

VIDEO

Remember your favourite storybook from childhood? Now imagine that the characters that graced its pages didn't only appear in print, but acted out scenes right in front of you, à la magic Harry Potter paintings.

HideOut, a smartphone projector system developed by Karl Willis at Disney Research in Pittsburgh, Pennsylvania, does exactly that by using invisible-ink markers to guide the projected characters of a storybook through an entire other layer of activities.

The projector also lets the user move a digital, animated character over surfaces in the real world. By passing the camera over another of the hidden patterns - which are visible only in infrared - the character can even seem to interact with physical obstacles, as in the video above.

In a paper describing the system, presented this month at the Tangible, Embedded and Embodied Interaction conference in Barcelona, Spain, Willis laid out how projection will move past games and playing to become an important computer-human interaction technology, freeing digital content from the screens.

Willis writes that future smartphones with embedded projectors will be used to browse digital files projected on any wall or table, to augment theme parks with digital characters, or to make digital board games that jump out of the table. "Enabling projected content to be mapped onto everyday surfaces from mobile devices is an important step towards seamless interaction between the digital and physical worlds."