Using computer vision to interact with pervasive computers seems to be a good match. We have worked with several computer vision algorithms tracking people moving in spaces e.g. operating theatres or tracking the movement of mobile devices using their onboard camera.

In Mixis we apply computer vision algorithms implemented on a mobile phone to video captures with the phones camera. E.g. in DROZO a doctor is able to drag, scale and rotate images on a large display by using the mobile phone. The way it is implemented is that the phone tracks the small circle under the picture and sends this information to the large wall display that moves the picture.

By moving the phone the doctor is able to move the picture. By moving the phone closer to the display or futher away makes the picture zoom in and out and rotation the phone rotates the picture.

The interaction technique we use is the mixed interaction space technique. The technique is described in more detail at the [Mixis part of the page...]

In the Active Theatre project we are working on how to interact with large wall displays without using mouse and keyboard and in this scenario we have worked with computer vision as well trying to detect the hand and the movement done with the hand. The Active Theatre project home page describe the project in more details. [Active Theatre...]