I want to interact with my computer like in Minority Report

You have to admit that being able to interact with a computer just by waving your hands around would be awesome, and the truth is that the technology to accomplish such a feat is already preparing to reach the market. Traditionally, people interact with their computers using a keyboard and/or a mouse. We've been using these same interfaces since the first personal computers and not much has changed since. Sure, now we have touchpads for our laptops and scroll wheels for some mice and some are even wireless now, but otherwise, not much has changed. Even a joystick used for computer games is not that much different from a mouse. It can control direction in a two-dimensional plane and has a buttons to execute simple commands.

There are several different types of new interaction hardware reaching the market today. The most commonly know is the multi-point touchscreen that has been incorporated into the iPhone and several other handheld devices. These small touch screens work by monitoring the change in electric current flowing through the screen. Anything touching, or even approaching, the screen alters the way in which current flows through it, and these changes are interpretted as commands to be given to the device. However, in order to have the same multi-point interface for larger surfaces, an entirely new set of technologies had to be explored.

Microsoft has successfully brought their product, the Surface to realization. The Surface is essentially a table size screen that can handle multiple touch commands. However, the technology behind the Surface requires quite a bit of space. In order to take in the touches made on the screen, a wide-angle camera has to place about 3-4 feet infront of or behind the screen in order to capture the inputs. Infrared light is shone onto the screen and touches create shadows that the camera captures.

Another similar technology is currently being investigated at NYU. It uses total internal frustration in order to collect information instead of a projector. shining infrared light through the side of a piece of translucent acryllic creates and even field of light in the screen. Touches to the screen create refraction patterns in the screen and a camera set behind the screen takes in these patterns so that they can be interpretted into commands. Here's a link to a video of their screen (I want one!): http://www.cs.nyu.edu/~jhan/ftirtouch/

I plan to post updates soon on other emerging interface technologies. If you have any requests for future topics, feel free to ask.