TY - JOUR A1 - Herder, Jens T1 - Visualization of a Clustering Algorithm of Sound Sources based on Localization Errors JF - Journal of the 3D-Forum Society N2 - A module for soundscape monitoring and visualizing resource management processes was extended for presenting clusters, generated by a novel sound source clustering algorithm. This algorithm groups multiple sound sources together into a single representative source, considering localization errors depending on listener orientation. Localization errors are visualized for each cluster using resolution cones. Visualization is done in runtime and allows understanding and evaluation of the clustering algorithm. KW - audio rendering, clustering KW - human perception KW - Resource Management KW - Sound Spatialization KW - Visualization Y1 - 1999 VL - 13 IS - 3 SP - 66 EP - 70 ER - TY - GEN A1 - Herder, Jens T1 - Interactive Sound Spatialization - a Primer T2 - MM News, University of Aizu Multimedia Center N2 - Sound spatialization is a technology which puts sound into the three dimensional space, so that it has a perceivable direction and distance. Interactive means mutually or reciprocally active. Interaction is when one action (e.g., user moves mouse) has direct or immediate influence to other actions (e.g., processing by a computer: graphics change in size). Based on this definition an introduction to sound reproduction using DVD and virtual environments is given and illustrated by applications (e.g., virtual converts). KW - DVD KW - Interactivity KW - Resource Management KW - Sound Spatialization KW - Virtual Concerts KW - VSVR Y1 - 2000 UR - http://vsvr.medien.hs-duesseldorf.de/publications/mmnews2000-8.pdf VL - 8 SP - 8 EP - 12 ER - TY - THES A1 - Herder, Jens T1 - A Sound Spatialization Resource Management Framework N2 - In a virtual reality environment, users are immersed in a scene with objects which might produce sound. The responsibility of a VR environment is to present these objects, but a practical system has only limited resources, including spatialization channels (mixels), MIDI/audio channels, and processing power. A sound spatialization resource manager, introduced in this thesis, controls sound resources and optimizes fidelity (presence) under given conditions, using a priority scheme based on psychoacoustics. Objects which are spatially close together can be coalesced by a novel clustering algorithm, which considers listener localization errors. Application programmers and VR scene designers are freed from the burden of assigning mixels and predicting sound source locations. The framework includes an abstract interface for sound spatialization backends, an API for the VR environments, and multimedia authoring tools. KW - audio rendering KW - human perception KW - Resource Management KW - Sound Spatialization Y1 - 1999 UR - http://vsvr.medien.hs-duesseldorf.de/publications/phd99-abstract.html PB - University of Tsukuba CY - Tsukuba ER - TY - JOUR A1 - Herder, Jens T1 - Interactive Content Creation with Virtual Set Environments JF - Journal of the 3D-Forum Society N2 - Digital broadcasting enables interactive \sc tv studios with virtual set environments. This presentation reviews current technology and describes the requirements for such systems. Interoperability over the production, streaming, and viewer levels requires open interfaces. As the technology allow more interaction, it becomes inherent difficult to control the quality of the viewers experience. KW - Interactive Media KW - Sound Spatialization KW - Virtual Sets KW - virtual studio KW - VSVR Y1 - 2001 VL - 15 IS - 4 SP - 53 EP - 56 ER - TY - CHAP A1 - Herder, Jens T1 - Challenges of Virtual Sets: From Broadcasting to Interactive Media T2 - Seventh International Workshop on Human N2 - Virtual sets have evolved from computer-generated, prerendered 2D backgrounds to realtime, responsive 3D computer graphics and are nowadays standard repertoire of broadcasting divisions. The graphics, which are combined with real video feed becoming moresophisticated, real looking and more responsive. We will look at the recent developments and suggest further developments like integration of spatial audio into the studio production and generating interactive media streams. Educational institutes recognize the demands of the rising media industry and established new courses on media technology like the Duesseldorf University of Applied Sciences. KW - Education KW - Interactive Media KW - Sound Spatialization KW - Virtual Sets KW - Virtual (TV) Studio KW - VSVR Y1 - 2000 SP - 13 EP - 17 PB - University of Aizu CY - Aizu-Wakamatsu ER - TY - CHAP A1 - Herder, Jens T1 - Optimization of Sound Spatialization Resource Management through Clustering T2 - Second International Conference on Human and Computer N2 - Level-of-detail is a concept well-known in computer graphics to reduce the number of rendered polygons. Depending on the distance to the subject (viewer), the objects’ representation is changed. A similar concept is the clustering of sound sources for sound spatialization. Clusters can be used to hierarchically organize mixels and to optimize the use of resources, by grouping multiple sources together into a single representative ource. Such a clustering process should minimize the error of position allocation of elements, perceived as angle and distance, and also differences between velocity relative to the sink (i.e., Doppler shift). Objects with similar direction of motion and speed (relative to sink) in the same acoustic resolution cone and with similar distance to a sink can be grouped together. KW - audio rendering KW - clustering, and human perception KW - Resource Management KW - Sound Spatialization Y1 - 1999 SP - 1 EP - 7 CY - Aizu-Wakamatsu ER - TY - CHAP A1 - Herder, Jens T1 - Visualization of a Clustering Algorithm of Sound Sources based on Localization Errors T2 - Second International Conference on Human and Computer N2 - A module for soundscape monitoring and visualizing resource management processes was extended for presenting clusters, generated by a novel sound source clustering algorithm. This algorithm groups multiple sound sources together into a single representative source, considering localization errors depending on listener orientation. Localization errors are visualized for each cluster using resolution cones. Visualization is done in runtime and allows understanding and evaluation of the clustering algorithm. KW - audio rendering, clustering KW - human perception KW - Resource Management KW - Sound Spatialization KW - Visualization Y1 - 1999 SP - 1 EP - 5 CY - Aizu-Wakamatsu ER -