Mixed Interaction Spaces

Introduction

Mixed Interaction Space is a new concept that uses the mobile phone to interact with either applications on the phone or in the environment by tracking the position and rotation with the camera in 4 dimmension.

Most mobile devices today has a camera onboard. In the project about Mixed Interaction Spaces we use image processing algorithms to track the movement of the mobile phone according to a fixed point and use this information as input to different applications. We are able to track the movement of the device in 3D plus the rotation of the device and uses these information as a kind of four dimensional input device.

As a fixed point we use a circle in the first version of Mixis. By tracking the circle we have developed a number of applications that uses this technique as input. Above is three examples.

The following poster from the UbiComp 2005 conference in Tokyo gives a visual introduction to our work: Demo Poster

Selected applications

ImageViewZoom
This picture shows the application ImageViewZoom that are able to pan and zoom a map or a X-Ray picture by moving the phone in front of the circle.

DrawME
This picture shows the DrawME application where the user draws an icon and holds the phone over the icon to call the person associated with the icon.

	DROZO DROZO is an application where we are able to drag pictures on a large screen, zoom in on the pictures and rotate the pictures by moving the phone in front of the large screen.
	Colour histogram tracking A special program track a colour profile instead of a circle. All coloured objects can be selected and used as tracking points.

Publications

Hansen, Thomas Riisgaard, Eriksson, Eva, Lykke-Olesen, Andreas, Mixed Interaction Space – Expanding the Interaction Space with Mobile Devices, full paper at British HCI 2005, Edinburgh, Scotland, in People and Computers XIX - The Bigger Picture
Proceedings of HCI 2005, Springer Verlag, (pdf).
Hansen, Thomas Riisgaard, Eriksson, Eva, Lykke-Olesen, Andreas, Mixed Interaction Spaces – a new interaction technique for mobile devices, Demonstration presented at UbiComp 2005, Tokyo, Japan. (pdf).
Hansen, Thomas Riisgaard, Eriksson, Eva, Lykke-Olesen, Andreas, Mixed Interaction Spaces – Designing for Camera Based Interaction with Mobile Devices, short paper presented at CHI 2005, Portland, US. (pdf)

Videos

	Mixis Video Watch this video of how the applications work (mov)
	Multi User Video Watch this video of how the multi-user applications work (avi)
	Face Trakcing Watch this preliminary video of face tracking - draft video (wmv)

People

	Thomas Riisgaard Hansen thomasr@daimi.au.dk (www) Center for Pervasive Healthcare Department of Computer Science University of Aarhus		Andreas Lykke-Olesen :alo@daimi.au.dk (www) Department of Design Aarhus School of Architecture,
	Eva Eriksson evae@daimi.au.dk (www) Interactive Spaces Department of Computer Science University of Aarhus

Links

[Getting started programming for mobile phones...]

Editor: Thomas Riisgaard Hansen (web, email) - last updated Feb. 2006.