WORK SOUND ABOUT CONTACT
This installation is an interactive audio-visual system that consists of a stereoscopic multi-viewer system for displaying images and a wave field synthesis audio system. Audio-visual objects are rendered for each user in high quality. Using 3D input devices users are able to interact with virtual objects as well as changing their auditive properties, thereby creating and experiencing an audio-visual environment.
Using spatial sound systems in combination with virtual environments (VE) has a long tradition. For projection-based environments the visual and the audio display supports only a single tracked user with a spatially correct audio-visual feedback. Recently multi-viewer stereo displays (MVSD) are becoming feasible for a small number of users. One of the questions is how spatial audio can be added to such a system. The head positions of all users are known to produce perspective correct images. Thus headphones could be used to supply them with the appropriate binaural signals. Unfortunately head phones limit the possibility for natural communication between the users, which is a much appreciated and used feature of projection-based systems.
Our experiment was to combine wave field synthesis (WFS) with projection-based multi-viewer stereo displays. WFS delivers listener-position independent spatial audio reconstruction of high quality, which makes it the ideal choice for a consistent multi-user audio-visual environment. We have implemented such a system for two tracked users to evaluate the usability and the limitations of this approach.
In cooperation with Bauhaus University Weimar, Hochschule für Musik Franz Liszt and Fraunhofer Institute for Mediatechnology Ilmenau.
Concept / Sound for the Scene: Moritz Fehr
3D-Rendering: Tom Freitag
Technical Realisation: Robert Dünger, Jan Hanak, Markus Hartleb, Martin Scheffler, Anita Schilling, Christoph Sladezcek, Jörg Wolfermann
Tutor(s): Prof. Dr. Bernd Fröhlich, Dipl.-Ing. Frank Melchior (Fraunhofer IDMT), Prof. Robin Minard,
Dipl-Inf. (FH) Jan Hochstrate, Dipl.-Inf. Jan P. Springer
