This project was started August 2003 and the focus in this project is on how to support the surgeons’ interaction with technology within an operating theatre. Field studies and workshops have been conducted to identify possible constrains and needs within the setting. A first preliminary prototype has been developed of a simple “Electronic Speech Patient Record” that uses speech and gestures as input and responds with visual and oral output. And second version has since been built and we are currently working with supplementing the speech with gestures.

This picture shows our current prototype that runs on large wall displays and where you are able to interact with the application through speech. The response from the application is either visual or synthesized speech.

We demonstrated the application for the Danish crown prinse Frederik and his wife princess Mary.

The application was also demonstrated for the other Danish prince Joakim.

We have also been working with wearable glasses within the operation theatre. The wearable glasses are a par of glasses with a data display in front of one of the eyes.

At the moment we have tested one kind of gestures with the application where we track the movement of a mobile phone in front of the screen. By moving the phone the doctor is able to move the picture. By moving the phone closer to the display or futher away makes the picture zoom in and out and rotation the phone rotates the picture.

The interaction technique we use is the mixed interaction space technique. The technique is described in more detail at the [Mixis part of the page...]

At the moment we are working on image processing algorithms that are able to recognize gestures made with the hand. At the moment we are able to detect some gesture, but the system is still to unstable. We are currently working on improving it. A collection of links to resources and related material can be found [here...]

2004 December: The AwareTheatre prototype developed
2004 August: Project presented for the Danish prince Joakim
2004 July: Project presented for the Danish crown prince Frederik and his wife princess Mary
2004: June: Second improved speech interface created
2004: January: A simple “Electronic Speech Patient Record” created
2003: Oktober-November: Field study conducted
2003 August: Project started