Sound and Vibration Engineering
Refine
Year of publication
Document Type
- Conference Proceeding (25)
- Article (20)
- Part of a Book (5)
- Workingpaper / Report (2)
- Article trade magazine (1)
- Bachelor Thesis (1)
- Diploma Thesis (1)
- Researchdata (1)
Language
- English (42)
- German (13)
- Multiple languages (1)
Keywords
- VSVR (14)
- Resource Management (5)
- Sound Spatialization (5)
- FHD (4)
- audio rendering (4)
- human perception (4)
- user interface design (3)
- virtual environments (3)
- DOAJ (2)
- Reverberation (2)
Department/institution
Virtual TV studios use actor tracking systems for resolving the occlusion of computer graphics and studio camera image. The actor tracking delivers the distance between actor and studio camera. We deploy a photonic mixing device, which captures a depth map and a luminance image at low resolution. The renderer engines gets one depth value per actor using the OSC protocol. We describe the actor recognition algorithm based on the luminance image and the depth value calculation. We discuss technical issues like noise and calibration.
The Sound Spatialization Framework is a C++ toolkit and development environment for providing advanced sound spatialization for virtual reality and multimedia applications. The Sound Spatialization Framework provides many powerful display and user-interface features not found in other sound spatialization software packages. It provides facilities that go beyond simple sound source spatialization: visualization and editing of the soundscape, multiple sinks, clustering of sound sources, monitoring and controlling resource management, support for various spatialization backends, and classes for MIDI animation and handling.
Keywords:
sound spatialization, resource management, virtual environments, spatial sound authoring, user interface design, human-machine interfaces
This paper presents an approach to integrate non-visual user feedback in today's virtual tv studio productions. Since recent studies showed that systems providing vibro-tactile feedback are not sufficient for replacing the common visual feedback, we developed an audio-based solution using an in ear headphone system, enabling a talent to move, avoid and point to virtual objects in a blue or green box. The system consists of an optical head tracking system, a wireless in ear monitor system and a workstation, which performs all application and audio processing. Using head related transfer functions, the talent gets directional and distance cues. Past research showed, that generating reflections of the sounds and simulating the acoustics of the virtual room helps the listener to conceive the acoustical feedback, we included this technique as well. In a user study with 15 participants the performance of the system was evaluated.
Ziel des Projektes ist die Entwicklung einer virtuellen Umgebung, die das charakteristische Klangabstrahlverhalten eines Musikinstruments in Echtzeit erfahrbar macht. Es wird eine virtuelle Umgebung geschaffen, in der sich der Benutzer frei um ein Musikinstrument bewegen kann und in Echtzeit ein akustisches und visuelles Feedback erhält. Durch die Verbindung der auditiven und visuellen Elemente und die Möglichkeit der Interaktion, wird das Erleben und die Wahrnehmung der Effekte intensiviert. Die Simulation des charakteristischen Klangabstrahlverhaltens erfolgt nicht durch eine rechenaufwändige Klangsynthese wie z.B. Physical Modeling, sondern basiert auf der Lautstärkeinterpolation einer Mehrkanalaufnahme. Die Verwendung der realen Aufnahmen ermöglicht eine annähernd naturgetreue Abbildung des Klangabstrahlverhaltens und ist, im Gegensatz zu rechenaufwändigen Klangsyntheseverfahren, echtzeitfähig. Zusätzlich wurde ein einfacher Filter entwickelt, der das charakteristische Klangabstrahlverhalten des Instruments eher qualitativ simuliert und sich problemlos in Echtzeit 3D-Anwendungen implementieren lässt. Die beiden entwickelten Methoden zur Simulation des Klangabstrahlverhaltens wurden mittels Spektralanalyse und anhand eines durchgeführten Hörtests auf ihre Funktionalität und ihre Gültigkeit überprüft.
Broader use of virtual reality environments and sophisticated animations spawn a need for spatial sound. Until now, spatial sound design has been based very much on experience and trial and error. Most effects are hand-crafted, because good design tools for spatial sound do not exist. This paper discusses spatial sound authoring and its applications, including shared virtual reality environments based on VRML. New utilities introduced by this research are an inspector for sound sources, an interactive resource manager, and a visual soundscape manipulator. The tools are part of a sound spatialization framework and allow a designer/author of multimedia content to monitor and debug sound events. Resource constraints like limited sound spatialization channels can also be simulated.
The Sound Spatialization Framework is a C++ toolkit and development environment for providing advanced sound spatialization for virtual reality and multimedia applications. The Sound Spatialization Framework provides many powerful display and user-interface features not found in other sound spatialization software packages. It provides facilities that go beyond simple sound source spatialization: visualization and editing of the soundscape, multiple sinks, clustering of sound sources, monitoring and controlling resource management, support for various spatialization backends, and classes for MIDI animation and handling.