TY - JOUR A1 - Martens, William L. A1 - Herder, Jens A1 - Shiba, Yoshiki T1 - A filtering model for efficient rendering of the spatial image of an occluded virtual sound source JF - The Journal of the Acoustical Society of America N2 - Rendering realistic spatial sound imagery for complex virtual environments must take into account the effects of obstructions such as reflectors and occluders. It is relatively well understood how to calculate the acoustical consequence that would be observed at a given observation point when an acoustically opaque object occludes a sound source. But the interference patterns generated by occluders of various geometries and orientations relative to the virtual source and receiver are computationally intense if accurate results are required. In many applications, however, it is sufficient to create a spatial image that is recognizable by the human listener as the sound of an occluded source. In the interest of improving audio rendering efficiency, a simplified filtering model was developed and its audio output submitted to psychophysical evaluation. Two perceptually salient components of occluder acoustics were identified that could be directly related to the geometry and orientation of a simple occluder. Actual occluder impulse responses measured in an anechoic chamber resembled the responses of a model incorporating only a variable duration delay line and a low-pass filter with variable cutoff frequency. KW - virtual environment Y1 - 1999 U6 - https://doi.org/10.1121/1.425354 VL - 105 IS - 2 SP - 980 ER - TY - JOUR A1 - Ryskeldiev, Bektur A1 - Cohen, Michael A1 - Herder, Jens T1 - StreamSpace: Pervasive Mixed Reality Telepresence for Remote Collaboration on Mobile Devices JF - Journal of Information Processing N2 - We present a system that exploits mobile rotational tracking and photospherical imagery to allow users to share their environment with remotely connected peers “on the go.” We surveyed related interfaces and developed a unique groupware application that shares a mixed reality space with spatially-oriented live video feeds. Users can collaborate through realtime audio, video, and drawings in a virtual space. The developed system was tested in a preliminary user study, which confirmed an increase in spatial and situational awareness among viewers as well as reduction in cognitive workload. Believing that our system provides a novel style of collaboration in mixed reality environments, we discuss future applications and extensions of our prototype. KW - Ubiquitous Computing KW - Telepresence KW - Remote Collaboration KW - Mixed Reality KW - Live Video Streaming Y1 - 2018 U6 - https://doi.org/10.2197/ipsjjip.26.177 VL - 26 SP - 177 EP - 185 PB - J-STAGE ER - TY - JOUR A1 - Herder, Jens T1 - Sound Spatialization Framework: An Audio Toolkit for Virtual Environments JF - Journal of the 3D-Forum Society N2 - The Sound Spatialization Framework is a C++ toolkit and development environment for providing advanced sound spatialization for virtual reality and multimedia applications. The Sound Spatialization Framework provides many powerful display and user-interface features not found in other sound spatialization software packages. It provides facilities that go beyond simple sound source spatialization: visualization and editing of the soundscape, multiple sinks, clustering of sound sources, monitoring and controlling resource management, support for various spatialization backends, and classes for MIDI animation and handling. Keywords: sound spatialization, resource management, virtual environments, spatial sound authoring, user interface design, human-machine interfaces KW - sound spatialization KW - resource management KW - virtual environments KW - spatial sound authoring KW - user interface design KW - human-machine interfaces Y1 - 1998 VL - 12 IS - 3 SP - 17 EP - 22 ER - TY - JOUR A1 - Daemen, Jeff A1 - Herder, Jens A1 - Koch, Cornelius A1 - Ladwig, Philipp A1 - Wiche, Roman A1 - Wilgen, Kai T1 - Halbautomatische Steuerung von Kamera und Bildmischer bei Live-Übertragungen JF - Fachzeitschrift für Fernsehen, Film und Elektronische Medien N2 - Live-Video-Broadcasting mit mehreren Kameras erfordert eine Vielzahl von Fachkenntnissen. Robotersysteme ermöglichen zwar die Automatisierung von gängigen und wiederholten Tracking-Aufnahmen, diese erlauben jedoch keine kurzfristigen Anpassungen aufgrund von unvorhersehbaren Ereignissen. In diesem Beitrag wird ein modulares, automatisiertes Kamerasteuerungs- und Bildschnitt-System eingeführt, das auf grundlegenden kinematografischen Regeln basiert. Die Positionen der Akteure werden durch ein markerloses Tracking-System bereitgestellt. Darüber hinaus werden Tonpegel der Lavaliermikrofone der Akteure zur Analyse der aktuellen Szene verwendet. Ein Expertensystem ermittelt geeignete Kamerawinkel und entscheidet, wann von einer Kamera auf eine andere umgeschaltet werden soll. Eine Testproduktion wurde durchgeführt, um den entwickelten Prototyp in einem Live-Broadcast-Szenario zu beobachten und diente als Videodemonstration für eine Evaluierung. KW - Halbautomatische Roboterkamerasteuerung KW - Verfolgen von Darstellern KW - Bildmischer KW - Szenenanalyse KW - Filmregeln KW - Automatische Bildauswahl KW - Virtual (TV) Studio Y1 - 2017 N1 - Der Artikel ist eine Übersetzung von dem Konferenzbeitrag "Semi-Automatic Camera and Switcher Control for Live Broadcast", International Conference on Interactive Experiences for Television and Online Video, TVX'2016, Chicago, IL, USA, ACM, DOI=10.1145/2932206.2933559, June 22-24, 2016. IS - 11 SP - 501 EP - 505 PB - Schiele & Schön ER - TY - JOUR A1 - Juttner, Carsten A1 - Herder, Jens T1 - Lighting an Interactive Scene in Real-time with a GPU and Video Textures JF - Journal of the 3D-Forum Society N2 - The presentation of virtual environments in real time has always been a demanding task. Specially designed graphics hardware is necessary to deal with the large amounts of data these applications typically produce. For several years the chipsets that were used allowed only simple lighting models and fixed algorithms. But recent development has produced new graphics processing units (GPUs) that are much faster and more programmable than their predecessors. This paper presents an approach to take advantage of these new features. It uses a video texture as part of the lighting calculations for the passenger compartment of a virtual train and was run on the GPU of a recent PC graphics card. The task was to map the varying illumination of a filmed landscape onto the virtual objects and also onto another video texture (showing two passengers), thereby enhancing the realism of the scene. KW - graphics processing unit KW - shader programming KW - video textures KW - virtual prototyping KW - FHD KW - VSVR Y1 - 2006 VL - 20 IS - 1 SP - 22 EP - 28 ER - TY - JOUR A1 - Novotny, Tom A1 - Jaensch, Kai A1 - Herder, Jens T1 - A Database Driven and Virtual Reality supported Environment for Marketing Studies JF - Journal of the 3D-Forum Society N2 - In today’s market research mechanisms multi modal technologies are significant tools to perform flexible and price efficient studies for not only consumer products but also consumer goods. Current appraisal mechanisms in combination with applied computer graphics can improve the assessment of a product’s launch in the very early design phase or an innovation process. The combination of online questionnaires, Virtual Reality (VR) applications and a database management system offers a powerful tool to let a consumer judge products as well as innovated goods even without having produced a single article. In this paper we present an approach of consumer good studies consisting of common as well as interactive VR product presentations and online questionnaires bases on a bidirectional database management solution to configure and manage numerous studies, virtual sets, goods and participants in an effective way to support the estimation of the received data. Non-programmers can create their test environment including a VR scenario very quickly without any effort. Within the extensive knowledge of consumer goods, marketing instruments can be defined to shorten and improve the rollout process in the early product stages. KW - virtual environments KW - databases KW - marketing studies KW - FHD KW - VSVR Y1 - 2005 VL - 19 IS - 4 SP - 95 EP - 101 ER - TY - JOUR A1 - Hesse, Jan A1 - König, Rainer A1 - Logi, Filippo A1 - Herder, Jens T1 - A Prototype of an Interface Builder for the Common Lisp Interface Manager - CLIB JF - ACM Sigplan Notices N2 - The Common Lisp Interface Manager (CLIM) is used to develop graphical user interfaces for Lisp-basedapplications. With the prototype of the CLIM interface Builder (CLIB) the programmer can generate code for CLIM interactively. The developing process will be fast and less prone to errors. With this new tool, the interactive rapid prototyping reduces costs of a specification phase. Here we present the concept and first results of the prototype of CLIB. Y1 - 1993 U6 - https://doi.org/10.1145/163114.163116 VL - 28 IS - 8 SP - 19 EP - 28 PB - Forschungszentrum Informatik (FZI), Technical Expert Systems and Robotics ER - TY - JOUR A1 - Kunii, Tosiyasu L. A1 - Herder, Jens A1 - Myszkowski, Karol A1 - Okunev, Oleg A1 - Okuneva, Galina A1 - Ibusuki, Masumi T1 - Articulation Simulation for an Intelligent Dental Care System JF - Displays N2 - CAD/CAM techniques are used increasingly in dentistry for design and fabrication of teeth restorations. An important issue is preserving occlusal contacts of teeth after restoration. Traditional techniques based on the use of casts with mechanical articulators require manual adjustment of occlusal surface, which becomes impractical when hard restoration materials like porcelain are used; they are also time and labor consuming. Most existing computer systems ignore completely such an articulation check, or perform the check at the level of a tooth and its immediate neighbors. We present a new mathematical model and a related user interface for global articulation simulation, developed for the Intelligent Dental Care System project. The aim of the simulation is elimination of the use of mechanical articulators and manual adjustment in the process of designing dental restorations and articulation diagnostic. The mathematical model is based upon differential topological modeling of the jawbs considered as a mechanical system. The user interface exploits metaphors that are familiar to dentists from everyday practice. A new input device designed specifically for use with articulation simulation is proposed. Y1 - 1994 VL - 15 IS - 3 SP - 181 EP - 188 ER - TY - JOUR A1 - Struchholz, Holger A1 - Herder, Jens A1 - Leckschat, Dieter T1 - Sound radiation simulation of musical instruments based on interpolation and filtering of multi-channel recordings JF - Journal of the 3D-Forum Society N2 - With the virtual environment developed here, the characteristic sound radiation patterns of musical instruments can be experienced in real-time. The user may freely move around a musical instrument, thereby receiving acoustic and visual feedback in real-time. The perception of auditory and visual effects is intensified by the combination of acoustic and visual elements, as well as the option of user interaction. The simulation of characteristic sound radiation patterns is based on interpolating the intensities of a multichannel recording and offers a near-natural mapping of the sound radiation patterns. Additionally, a simple filter has been developed, enabling the qualitative simulation of an instrument’s characteristic sound radiation patterns to be easily implemented within real-time 3D applications. Both methods of simulating sound radiation patterns have been evaluated for a saxophone with respect to their functionality and validity by means of spectral analysis and an auditory experiment. KW - sound radiation pattern KW - audio interpolation KW - audio filtering KW - FHD KW - VSVR Y1 - 2006 VL - 20 IS - 1 SP - 41 EP - 47 ER - TY - JOUR A1 - Griesert, Arnfried A1 - Walczak, Oliver A1 - Herder, Jens T1 - Interactive Realtime Terrain Visualization for Virtual Set Applications JF - Journal of the 3D-Forum Society N2 - Virtual set environments for broadcasting become more sophisticated as well as the visual quality improves. Realtime interaction and production-specific visualization implemented through plugin mechanism enhance the existing systems like the virtual studio software 3DK. This work presents an algorithm which can dynamically manage textures of high resolution by prefetching them depending on their requirement in memory and map them on a procedural mesh in realtime. The main goal application of this work is the virtual representation of a flight over a landscape as part of weather reports in virtual studios and the interaction by the moderator. KW - 3D KW - VSVR KW - Virtual (TV) Studio Y1 - 2003 VL - 17 IS - 4 SP - 20 EP - 26 ER -