The future of NUI

This next video shows our early experimentation with depth sensing technologies. We think of it as the expectable evolution of Natural User Interfaces: the ability to touch the virtual.

Our proprietary algorithms perform a direct mapping between the real and virtual worlds, so the digital content reacts to any part of the body or even inanimate objects. It is possible to accomplish great precision with our technique, because it uses the full resolution of the depth sensor. With it we can control things with the tips of our fingers, something impossible through regular skeleton tracking.

This AR proof-of-concept brings us closer to our expectations when we use the word “Natural” in reference to these new interfaces.

This demo was awarded with the “Auggies Award” at ARE2010, judged by Bruce Sterling, Jesse Schell and Mark Billinghurst.