Listen to what you look at: Combining an audio guide with a mobile eye tracker on the go

The paper presents work in progress about integrating a mobile eye-tracker into a museum visitors' guide system, so to relive the visitor from explicitly requesting information about objects of interest. The novel and most challenging aspects of the study are the image based positioning and the identification of the visitor's focus of attention, while using a commercially available mobile eye tracker. A prototype system has been developed and it will be evaluated in a user study in a realistic setting. The focus of this paper is possible solutions for real-time efficient image based positioning, the overall system design and the planned evaluation.