Several years ago Microsoft's ramped up its recruitment of researchers in the field of voice recognition and other multimodal interactions (touch, vision, voice, position/motion) for the HCI (human-computer interaction). Only now is its efforts becoming commercial and reaching market. Of note is their research in computer vision, which will only trend larger unless limited by privacy issues (Big Brother watching or Minority Report iris/retinal scans). Microsoft's Surface uses cameras to track interaction with the table interface and is an example of how refined vision has become.

It's not a far stretch to see future payoff in Microsoft's investment in robotics. I'd say robotics is essentially computing empowered with motion. The payoff (reaching consumers) comes with applying that vision to hand-eye coordination and then applying AI. This is not to say, robots do not already exist for the consumer (Roomba), but it has yet to hit critical mass.

Not only are our senses interacting with computing more but computing devices are increasingly sensing us. For example xuuk has a camera with infrared eye tracker to detect if you are looking at it. They are marketing it as a way for advertisements (Wired magazine says billboards) to tell if you are looking at them. Not too long ago, a Wired magazine article described military research on computers scanning our brains to monitor which sensory input was overloaded or underutilized. The computer would then select the optimal mode of communication (image, text, or audio) to the user.

Microsoft Surface
Microsoft Surface look promising and will threaten Google and Apple. SciFi is definitely a source of inspiration -- Minority Report, that is. The multi-touch surface will be the interface for Apple iPhone (as you know) and the newly announced Microsoft Surface (a 30 inch monitor). It looks as though the spider web of Microsoft has come together in a product integration akin to Apple, but even tighter. The Surface looks like one of Apple's older monitors (before they went silver) and the music interface is shamelessly copied from iTunes. Have they out-Appled Apple?


Let me list some of the ways of integration and clever promotional tie-ins:

• Microsoft mobile operating system on mobile devices (take that Palm)
  
• Microsoft Live Search, Virtual Earth Maps (take that Google)
  
• Microsoft Zune (take that Apple)
• T Mobile deal (take that Cingular...ummm AT&T)
• Increased multiplayer interactivity (take that Nintendo...maybe?)

A YouTube search of FTIR or Reactable shows that the interface technology has been in development for quite a while not just by Apple or Microsoft, but only now is it becoming more comercialized. However it doesn't seem Mircosoft uses FTIR but instead uses near-infrared cameras.