TY - CHAP A1 - Thiele, Simon A1 - Meyer, Laurid A1 - Geiger, Christian A1 - Drochtert, Daniel A1 - Woldecke, Bjorn T1 - Virtual archery with tangible interaction T2 - 2013 IEEE Symposium on 3D User Interfaces (3DUI), 16.03.2013 - 17.03.201, Orlando Y1 - 2013 UR - http://ieeexplore.ieee.org/document/6550199/ SN - 978-1-4673-6098-2 U6 - https://doi.org/10.1109/3DUI.2013.6550199 SP - 67 EP - 70 PB - IEEE ER - TY - CHAP A1 - Suzuki, Kenji A1 - Nishoji, Yuji A1 - Herder, Jens T1 - Implementation of Aural Attributes for Simulation of Room Effects in Virtual Environments T2 - ACM Multimedia 2000 N2 - The audio design for virtual environments includes simulation of acoustical room properties besides specifing sound sources and sinks and their behavior. Virtual environments supporting room reverberation not only gain realism but also provide additional information to the user about surrounding space. Catching the different sound properties by the different spaces requires partitioning the space by the properties of aural spaces. We define soundscape and aural attributes as an application and multimedia content interface. Calculated data on an abstract level is sent to spatialization backends. Part of this research was the implementation of a device driver for the Roland Sound Space Processor. This device not only directionalizes sound sources, but also controls room effects like reverberation. KW - Acoustic displays KW - Aural attributes KW - Room effects KW - Virtual environments KW - VSVR Y1 - 2000 SP - 439 EP - 441 PB - ACM CY - Los Angeles ER - TY - CHAP A1 - Stöcklein, Jörg A1 - Pogscheba, Patrick A1 - Geiger, Christian A1 - Paelke, Volker ED - Gain, James ED - Marais, Patrick T1 - MiReAS: a mixed reality software framework for iterative prototyping of control strategies for an indoor airship T2 - Proceedings of the 7th International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa - AFRIGRAPH '10 , 21.06.2010 - 23.06.2010, Franschhoek Y1 - 2010 UR - http://portal.acm.org/citation.cfm?doid=1811158 SN - 9781450301183 U6 - https://doi.org/10.1145/1811158.1811164 PB - ACM Press CY - New York ER - TY - CHAP A1 - Stöcklein, Jörg A1 - Geiger, Christian A1 - Paelke, Volker A1 - Pogscheba, Patrick ED - Shumaker, Randall T1 - A Design Method for Next Generation User Interfaces Inspired by the Mixed Reality Continuum T2 - Virtual and Mixed Reality, Third International Conference, VMR 2009, Held as Part of HCI International 2009, San Diego, CA USA, July, 19-24, 2009, Proceedings Y1 - 2009 UR - https://doi.org/10.1007/978-3-642-02771-0_28 SN - 978-3-642-02770-3 U6 - https://doi.org/10.1007/978-3-642-02771-0_28 SP - 244 EP - 253 PB - Springer CY - Berlin, Heidelberg ER - TY - JOUR A1 - Struchholz, Holger A1 - Herder, Jens A1 - Leckschat, Dieter T1 - Sound radiation simulation of musical instruments based on interpolation and filtering of multi-channel recordings JF - Journal of the 3D-Forum Society N2 - With the virtual environment developed here, the characteristic sound radiation patterns of musical instruments can be experienced in real-time. The user may freely move around a musical instrument, thereby receiving acoustic and visual feedback in real-time. The perception of auditory and visual effects is intensified by the combination of acoustic and visual elements, as well as the option of user interaction. The simulation of characteristic sound radiation patterns is based on interpolating the intensities of a multichannel recording and offers a near-natural mapping of the sound radiation patterns. Additionally, a simple filter has been developed, enabling the qualitative simulation of an instrument’s characteristic sound radiation patterns to be easily implemented within real-time 3D applications. Both methods of simulating sound radiation patterns have been evaluated for a saxophone with respect to their functionality and validity by means of spectral analysis and an auditory experiment. KW - sound radiation pattern KW - audio interpolation KW - audio filtering KW - FHD KW - VSVR Y1 - 2006 VL - 20 IS - 1 SP - 41 EP - 47 ER - TY - CHAP A1 - Stocklein, Jorg A1 - Geiger, Christian A1 - Paelke, Volker A1 - Pogscheba, Patrick T1 - Poster: MVCE - a design pattern to guide the development of next generation user interfaces T2 - 2009 IEEE Symposium on 3D User Interfaces, 14.03.2009 - 15.03.2009, Lafayette KW - Poster Y1 - 2009 UR - http://ieeexplore.ieee.org/document/4811232/ SN - 978-1-4244-3965-2 U6 - https://doi.org/10.1109/3DUI.2009.4811232 SP - 153 EP - 154 PB - IEEE ER - TY - CHAP A1 - Stocklein, Jorg A1 - Geiger, Christian A1 - Paelke, Volker T1 - Mixed reality in the loop — design process for interactive mechatronical systems T2 - 2010 IEEE Virtual Reality Conference (VR), 20.03.2010 - 24.03.2010, Waltham Y1 - 2010 UR - http://ieeexplore.ieee.org/document/5444755/ SN - 978-1-4244-6237-7 U6 - https://doi.org/10.1109/VR.2010.5444755 SP - 303 EP - 304 PB - IEEE ER - TY - CHAP A1 - Simsch, Jonathan A1 - Herder, Jens ED - Chisik, Yoram T1 - SpiderFeedback - Visual Feedback for Orientation in Virtual TV Studios T2 - ACE'14, 11th Advances in Computer Entertainment Technology Conference, ACM, Funchal, Portugal N2 - A visual and spatial feedback system for orientation in virtual sets of virtual TV studios was developed and evaluated. It is based on a green proxy object, which moves around in the acting space by way of four transparent wires. A separate unit controls four winches and is connected to an engine, which renders the virtual set. A new developed plugin registers a virtual object’s position with the proxy object which imitates the virtual object’s movement on stage. This will allow actors to establish important eye contact with a virtual object and feel more comfortable in a virtual set. Furthermore, interaction with the virtual object and its proxy can be realised through a markerless actor tracking system. Several possible scenarios for user application were recorded and presented to experts in the broadcast industry, who evaluated the potential of SpiderFeedback in interviews and by questionnaires. KW - Mixed reality KW - visual feedback KW - stage flight system KW - presentation assistance KW - VSVR KW - Virtual (TV) Studio Y1 - 2014 UR - https://dl.acm.org/citation.cfm?doid=2663806.2663830 SN - 978-1-4503-2945-3 U6 - https://doi.org/10.1145/2663806.2663830 N1 - Sie haben Zugriff auf den Volltext innerhalb des HSD Campus. PB - ACM CY - New York ER - TY - CHAP A1 - Schulz, Florian A1 - Geiger, Christian A1 - Reckter, Holger T1 - ANTracks: generative mobile music composition T2 - Proceedings of the International Conference on Advances in Computer Enterntainment Technology - ACE '09, 29.10.2009 - 31.10.2009, Athens Y1 - 2009 UR - http://portal.acm.org/citation.cfm?doid=1690388 SN - 9781605588643 U6 - https://doi.org/10.1145/1690388.1690442 PB - ACM Press CY - New York ER - TY - CHAP A1 - Schmitt, Lothar M. A1 - Herder, Jens A1 - Bhalla, Subhash ED - Gorayska, Barbara ED - Nehaniv, Chrystopher L. ED - Marsh, Jonathon P. T1 - Information Retrieval and Database Architecture for Conventional Japanese Character Dictionaries T2 - Proceedings, Second International Conference on Cognitive Technology N2 - The cycle of abstraction-reconstruction which occurs as a fundamental principle in the development of culture and in cognitive processes is described and analyzed. This approach leads to recognition of boundary conditions for and directions of probable development of cognitive tools. It is shown how the transition from a conventional Japanese-English character dictionary to a multi-dimensional language database is an instance of such an abstraction-reconstruction cycle. The different phases of the design of a multi-dimensional language database based upon different computer software technologies are properly placed in this cycle. The methods used include the use of UNIX software tools, classical database methods as-well-as the use of search engines based upon full text search in this process. Several directions of application and extension for a multi-dimensional language database are discussed from the general point of view of an abstraction-reconstruction cycle. KW - abstraction-reconstruction cycle KW - database KW - dictionary KW - hypertext, search engine KW - retrieval methods KW - UNIX Y1 - 1997 SN - 0-8186-8084-9 SP - 200 EP - 217 PB - IEEE CY - Los Alamitos ER - TY - CHAP A1 - Ryskeldiev, Bektur A1 - Ochiai, Yoichi A1 - Cohen, Michael A1 - Herder, Jens T1 - Distributed Metaverse: Creating Decentralized Blockchain-based Model for Peer-to-peer Sharing of Virtual Spaces for Mixed Reality Applications T2 - Proceedings of the 9th Augmented Human International Conference N2 - Mixed reality telepresence is becoming an increasingly popular form of interaction in social and collaborative applications. We are interested in how created virtual spaces can be archived, mapped, shared, and reused among different applications. Therefore, we propose a decentralized blockchain-based peer-to-peer model of distribution, with virtual spaces represented as blocks. We demonstrate the integration of our system in a collaborative mixed reality application and discuss the benefits and limitations of our approach. KW - Blockchain KW - Groupware KW - Mixed Reality KW - Mobile Computing KW - Photospherical Imagery Y1 - 2018 UR - http://vsvr.medien.hs-duesseldorf.de/publications/ah2018-blockchain-streamspace-abstract.html SN - 978-1-4503-5415-8 U6 - https://doi.org/10.1145/3174910.3174952 SP - 7 EP - 9 PB - ACM ER - TY - CHAP A1 - Ryskeldiev, Bektur A1 - Igarashi, Toshiharu A1 - Zhang, Junjian A1 - Ochiai, Yoichi A1 - Cohen, Michael A1 - Herder, Jens T1 - Spotility: Crowdsourced Telepresence for Social and Collaborative Experiences in Mobile Mixed Reality T2 - ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '18) N2 - Live video streaming is becoming increasingly popular as a form of interaction in social applications. One of its main advantages is an ability to immediately create and connect a community of remote users on the spot. In this paper we discuss how this feature can be used for crowdsourced completion of simple visual search tasks (such as finding specific objects in libraries and stores, or navigating around live events) and social interactions through mobile mixed reality telepresence interfaces. We present a prototype application that allows users to create a mixed reality space with a photospherical imagery as a background and interact with other connected users through viewpoint, audio, and video sharing, as well as realtime annotations in mixed reality space. Believing in the novelty of our system, we conducted a short series of interviews with industry professionals on the possible applications of our system. We discuss proposed use-cases for user evaluation, as well as outline future extensions of our system. KW - Groupware KW - Mixed reality KW - Mobile computing KW - Remote collaboration KW - Spatial media KW - M KW - FHD Y1 - 2018 UR - http://vsvr.medien.hs-duesseldorf.de/publications/cscw2018-spotility-abstract.html SN - 978-1-4503-6018-0 U6 - https://doi.org/10.1145/3272973.3274100 N1 - Zugriff auf den Volltext via ACM-Datenbank SP - 373 EP - 376 PB - ACM CY - New York ER - TY - CHAP A1 - Ryskeldiev, Bektur A1 - Cohen, Michael A1 - Herder, Jens T1 - Applying rotational tracking and photospherical imagery to immersive mobile telepresence and live video streaming groupware T2 - Proceeding SA '17 SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications, Article No. 5 N2 - Mobile live video streaming is becoming an increasingly popular form of interaction both in social media and remote collaboration scenarios. However, in most cases the streamed video does not take mobile devices' spatial data into account (e.g., the viewers do not know the spatial orientation of a streamer), or use such data only in specific scenarios (e.g., to navigate around a spherical video stream). KW - spatial media KW - rotational tracking KW - mixed reality KW - live streaming KW - social media KW - telepresence KW - mobile computing KW - groupware KW - photospherical imagery Y1 - 2017 UR - https://dl.acm.org/citation.cfm?doid=3132787.3132813 SN - 978-1-4503-5410-3 U6 - https://doi.org/10.1145/3132787.3132813 PB - ACM CY - New York ER - TY - CHAP A1 - Reckter, Holger A1 - Geiger, Christian A1 - Singer, Jurgen A1 - Streuber, Stephan T1 - Tech-note: Iterative design and test of a multimodal experience T2 - 2009 IEEE Symposium on 3D User Interfaces, 14.03.2009 - 15.03.2009, Lafayette Y1 - 2009 UR - http://ieeexplore.ieee.org/document/4811213/ SN - 978-1-4244-3965-2 U6 - https://doi.org/10.1109/3DUI.2009.4811213 SP - 99 EP - 102 PB - IEEE ER - TY - CHAP A1 - Rattay, Oliver A1 - Geiger, Christian A1 - Herder, Jens A1 - Goebbels, Gernot A1 - Nikitin, Igor ED - Gausemeier, Jürgen ED - Grafe, Michael T1 - Zweihändige Interaktion in VR-Umgebungen T2 - Augmented & Virtual Reality in der Produktentstehung N2 - Einfach benutzbare VR-Anwendungen erfordern andere Interaktionstechniken als konventionelle Desktop-Anwendungen mit Maus, Tastatur und Desktop-Metapher zur Verfügung stellen. Da solche Ansätze in Konzeption und Realisierung deutlicher komplexer sind, müssen diese mit Sorgfalt ausgewählt werden. Folgt man der Argumentation, dass VR eine natürliche Interaktion mit virtuellen Objekten ermöglicht, so führt dies fast zwangsläufig zu zweihändigen Interaktionstechniken für virtuelle Umgebungen, da Benutzer in realen Umgebungen gewohnt sind, fast ausschlieï‚lich zweihändig zu agieren. In diesem Beitrag geben wir eine Übersicht über den Stand der Technik im Bereich zweihändiger Interaktion, leiten Anforderungen an eine Entwicklung zweihändiger Interaktionstechniken in VR ab und beschreiben einen eigenen Ansatz. Dabei geht es um die zweihändige Interaktion bei der Simulation flexibler biegeschlaffer Bauteile (z. B. Schlauchverbindungen). KW - 3D Interaktion KW - Zweihändige Eingabe KW - Simulation biegeschlaffer Objekte KW - FHD KW - VSVR Y1 - 2007 SN - 978-3-939350-28-6 VL - 209 SP - 315 EP - 332 PB - Heinz Nixdorf Institut, Universität Paderborn CY - Paderborn ER - TY - CHAP A1 - Paul, Felix A1 - Herder, Jens ED - Herder, Jens ED - Geiger, Christian ED - Dörner, Ralf ED - Grimm, Paul T1 - A model-based filtering approach for real-time human motion data T2 - Workshop Proceedings / Tagungsband: Virtuelle und Erweiterte Realität – 15. Workshop der GI-Fachgruppe VR/AR N2 - Acquiring human motion data from video images plays an important role in the field of computer vision. Ground truth tracking systems require markers to create high quality motion data. But in many applications it is desired to work without markers. In recent years affordable hardware for markerless tracking systems was made available at a consumer level. Efficient depth camera systems based on Time-of-Flight sensors and structured light systems have made it possible to record motion data in real time. However, the gap between the quality of marker-based and markerless systems is high. The error sources of a markerless motion tracking pipeline are discussed and a model-based filter is proposed, which adapts depending on spatial location. The proposed method is then proven to be more robust and accurate than the unfiltered data stream and can be used to visually enhance the presence of an actor within a virtual environment in live broadcast productions. KW - Virtual (TV) Studio Y1 - 2018 UR - http://vsvr.medien.hs-duesseldorf.de/publications/gi-vrar2018-filter/ SN - 978-3-8440-6215-1 U6 - https://doi.org/10.2370/9783844062151 SP - 37 EP - 44 PB - Shaker Verlag CY - Herzogenrath ER - TY - CHAP A1 - Owetschkin, Konstantin A1 - Meyer, Laurid A1 - Geiger, Christian A1 - Drochtert, Daniel ED - Billinghurst, Mark ED - Karlsson, Börje T1 - Mobile virtual archery T2 - SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications on - SA '13, 19.11.2013 - 22.11.2013, Hong Kong Y1 - 2013 UR - http://dl.acm.org/citation.cfm?doid=2543651 SN - 9781450326339 U6 - https://doi.org/10.1145/2543651.2543684 PB - ACM Press CY - New York ER - TY - JOUR A1 - Novotny, Tom A1 - Jaensch, Kai A1 - Herder, Jens T1 - A Database Driven and Virtual Reality supported Environment for Marketing Studies JF - Journal of the 3D-Forum Society N2 - In today’s market research mechanisms multi modal technologies are significant tools to perform flexible and price efficient studies for not only consumer products but also consumer goods. Current appraisal mechanisms in combination with applied computer graphics can improve the assessment of a product’s launch in the very early design phase or an innovation process. The combination of online questionnaires, Virtual Reality (VR) applications and a database management system offers a powerful tool to let a consumer judge products as well as innovated goods even without having produced a single article. In this paper we present an approach of consumer good studies consisting of common as well as interactive VR product presentations and online questionnaires bases on a bidirectional database management solution to configure and manage numerous studies, virtual sets, goods and participants in an effective way to support the estimation of the received data. Non-programmers can create their test environment including a VR scenario very quickly without any effort. Within the extensive knowledge of consumer goods, marketing instruments can be defined to shorten and improve the rollout process in the early product stages. KW - virtual environments KW - databases KW - marketing studies KW - FHD KW - VSVR Y1 - 2005 VL - 19 IS - 4 SP - 95 EP - 101 ER - TY - CHAP A1 - Möser, Annika A1 - Reufer, Thomas A1 - Geiger, Christian ED - Romão, Teresa ED - Correia, Nuno ED - Inami, Masahiko ED - Kato, Hirokasu ED - Prada, Rui ED - Terada, Tsutomu ED - Dias, Eduardo ED - Chambel, Teresa T1 - Multitouch and pen interaction for 3D configuration of virtual yachts at trade fairs T2 - Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology - ACE '11, Lisbon, 08.11.2011 - 11.11.2011 Y1 - 2011 UR - http://dl.acm.org/citation.cfm?doid=2071423 SN - 9781450308274 U6 - https://doi.org/10.1145/2071423.2071514 PB - ACM Press CY - New York ER - TY - CHAP A1 - Myszkowski, Karol A1 - Okuneva, Galina A1 - Herder, Jens A1 - Kunii, Tosiyasu L. A1 - Ibusuki, Masumi ED - Earnshaw, Rae A. ED - Huw, Jones ED - John, Vince T1 - Visual Simulation of the Chewing Process for Dentistry T2 - Visualization & Modeling N2 - CAD/CAM techniques are increasingly used in dentistry for the design and fabrication of teeth estorations. Important concerns are the correction of articulation problems that existed before treatment and the prevention of treatment-generated problems. These require interactive evaluation of the occlusal surfaces of teeth during mastication. Traditional techniques based on the use of casts with mechanical articulators require manual adjustment of occlusal surfaces, which becomes impractical when hard restoration materials like porcelain are used; they are also time and labor consuming and provide little visual information. We present new visual tools and a related user interface for global articulation simulation, developed for the Intelligent Dental Care System project. The aim of the simulation is visual representation of characteristics relevant to the chewing process. The simulation is based on the construction of distance maps, which are visual representations of the distributions of the distances of points in a tooth to the opposite jaw. We use rasterizing graphics hardware for fast calculation of the distance maps. Distance maps are used for collision detection and for the derivation of various characteristics showing the distribution of load on the teeth and the chewing capability of the teeth. Such characteristics can be calculated for particular positions of the jaws; cumulative characteristics are used to describe the properties of jaw movement. This information may be used for interactive design of the occlusal surfaces of restorations and for jaw articulation diagnosis. We also demonstrate elements of a user interface that exploit metaphors familiar to dentists from everyday practice. Y1 - 1997 SN - 0-12-227738-4 SP - 419 EP - 438 PB - Academic Press CY - London ER - TY - CHAP A1 - Myszkowski, Karol A1 - Okuneva, Galina A1 - Herder, Jens A1 - Kunii, Tosiyasu L. A1 - Ibusuki, Masumi T1 - Visual Simulation of the Chewing Process for Dentistry T2 - Visualization & Modelling, International Conf., 5-7 December, 1995 N2 - CAD/CAM techniques are increasingly used in dentistry for the design and fabrication of teeth restorations. Important concerns are the correction of articulation problems that existed beforetreatment and the prevention of treatment-generated problems. These require interactive evaluation of the occlusal surfaces of teeth during mastication. Traditional techniques based on the use of casts with mechanical articulators require manual adjustment of occlusal surfaces, which becomes impractical when hard restoration materials like porcelain are used; they are also time and labor consuming and provide little visual information. We present new visual tools and a related user interface for global articulation simulation, developed for the Intelligent Dental Care System project. The aim of the simulation is visual representation of characteristics relevant to the chewing process. The simulation is based on the construction of distance maps, which are visual representations of the distributions of the distances of points in a tooth to the opposite jaw. We use rasterizing graphics hardware for fast calculation of the distance maps. Distance maps are used for collision detection and for the derivation of various characteristics showing the distribution of load on the teeth and the chewing capability of the teeth. Such characteristics can be calculated for particular positions of the jaws; cumulative characteristics are used to describe the properties of jaw movement. This information may be used for interactive design of the occlusal surfaces of restorations and for jaw articulation diagnosis. We also demonstrate elements of a user interface that exploit metaphors familiar to dentists from everyday practice. Y1 - 1995 CY - Leeds ER - TY - CHAP A1 - Myszkowski, Karol A1 - Herder, Jens A1 - Kunii, Tosiyasu L. A1 - Ibusuki, Masumi T1 - Visualization and analysis of occlusion for human jaws using a "functionally generated path" T2 - IS&T/SPIE Symp. on Electronic Imaging, Visual Data Exploration and Analysis III N2 - Dynamic characteristics of occlusion during lower jaw motion are useful in the diagnosis of jaw articulation problems and in computer-aided design/manufacture of teeth restorations. The Functionally Generated Path (FGP), produced as a surface which envelops the actual occlusal surface of the moving opponent jaw, can be used for compact representation of dynamic occlusal relations. In traditional dentistry FGP is recorded as a bite impression in a patient’s mouth. We propose an efficient computerized technique for FGP reconstruction and validate it through implementation and testing. The distance maps between occlusal surfaces of jaws, calculated for multiple projection directions and accumulated for mandibular motion, provide information for FGP computation. Rasterizing graphics hardware is used for fast calculation of the distance maps. Real-world data are used: the scanned shape of teeth and the measured motion of the lower jaw. We show applications of FGP to analysis of the occlusion relations and occlusal surface design for restorations. Y1 - 1996 U6 - https://doi.org/10.1117/12.234684 SP - 360 EP - 367 PB - The International Society for Optical Engineering CY - San Jose ER - TY - CHAP A1 - Mayer, Christian A1 - Pogscheba, Patrick A1 - Marinos, Dionysios A1 - Wöldecke, Björn A1 - Geiger, Christian ED - Chisik, Yoram ED - Geiger, Christian ED - Hasegawa, Shoichi T1 - An audio-visual music installation with dichotomous user interactions T2 - Proceedings of the 11th Conference on Advances in Computer Entertainment Technology, Funchal, 11.11.2014-14.11.2014 Y1 - 2014 UR - https://dl.acm.org/doi/proceedings/10.1145/2663806 SN - 9781450329453 U6 - https://doi.org/10.1145/2663806.2663842 SP - 1 EP - 6 PB - ACM CY - New York ER - TY - CHAP A1 - Martens, William L. A1 - Herder, Jens A1 - Shiba, Yoshiki T1 - A filtering model for efficient rendering of the spatial image of an occluded virtual sound source T2 - 137th Regular Meeting of the Acoustical Society of America and the 2nd Convention of the European Acoustics Association N2 - Rendering realistic spatial sound imagery for complex virtual environments must take into account the effects of obstructions such as reflectors and occluders. It is relatively well understood how to calculate the acoustical consequence that would be observed at a given observation point when an acoustically opaque object occludes a sound source. But the interference patterns generated by occluders of various geometries and orientations relative to the virtual source and receiver are computationally intense if accurate results are required. In many applications, however, it is sufficient to create a spatial image that is recognizable by the human listener as the sound of an occluded source. In the interest of improving audio rendering efficiency, a simplified filtering model was developed and its audio output submitted to psychophysical evaluation. Two perceptually salient components of occluder acoustics were identified that could be directly related to the geometry and orientation of a simple occluder. Actual occluder impulse responses measured in an anechoic chamber resembled the responses of a model incorporating only a variable duration delay line and a low-pass filter with variable cutoff frequenc KW - audio rendering KW - first-order reflection KW - human perception KW - occluder Y1 - 1999 PB - Acoustical Society of America, European Acoustics Association CY - Berlin ER - TY - CHAP A1 - Martens, William L. A1 - Herder, Jens T1 - Perceptual criteria for eliminating reflectors and occluders from the rendering of environmental sound T2 - 137th Regular Meeting of the Acoustical Society of America and the 2nd Convention of the European Acoustics Association N2 - Given limited computational resources available for the rendering of spatial sound imagery, we seek to determine effective means for choosing whatcomponents of the rendering will provide the most audible differences in the results. Rather than begin with an analytic approach that attempts to predict audible differences on the basis of objective parameters, we chose to begin with subjective tests of how audibly different the rendering result may be heard to be when that result includes two types of sound obstruction: reflectors and occluders. Single-channel recordings of 90 short speech sounds were made in an anechoic chamber in the presence and absence of these two types of obstructions, and as the angle of those obstructions varied over a 90 degree range. These recordings were reproduced over a single loudspeaker in that anechoic chamber, and listeners were asked to rate how confident they were that the recording of each of these 90 stimuli included an obstruction. These confidence ratings can be used as an integral component in the evaluation function used to determine which reflectors and occluders are most important for rendering. KW - audio rendering KW - first-order reflection KW - human perception KW - level of detail KW - occluder KW - sound spatialization resource management Y1 - 1999 PB - Acoustical Society of America, European Acoustics Association CY - Berlin ER - TY - CHAP A1 - Marinos, Dionysios A1 - Wöldecke, Björn A1 - Geiger, Christian A1 - Schwirten, Tobias ED - Romão, Teresa ED - Correia, Nuno ED - Inami, Masahiko ED - Kato, Hirokasu ED - Prada, Rui ED - Terada, Tsutomu ED - Dias, Eduardo ED - Chambel, Teresa T1 - Design of a touchless multipoint musical interface in a virtual studio environment T2 - Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology - ACE '11, 08.11.2011 - 11.11.2011, Lisbon Y1 - 2011 UR - http://dl.acm.org/citation.cfm?doid=2071423 SN - 9781450308274 U6 - https://doi.org/10.1145/2071423.2071464 PB - ACM Press CY - New York ER - TY - CHAP A1 - Marinos, Dionysios A1 - Wöldecke, Björn A1 - Geiger, Christian ED - Richir, Simon T1 - Prototyping natural interactions in virtual studio environments by demonstration T2 - Proceedings of the Virtual Reality International Conference: Laval Virtual, 20.03.2013-22.03.2013, Laval Y1 - 2013 UR - https://dl.acm.org/doi/proceedings/10.1145/2466816 SN - 9781450318754 U6 - https://doi.org/10.1145/2466816.2466819 SP - 1 EP - 8 PB - ACM CY - New York ER - TY - CHAP A1 - Marinos, Dionysios A1 - Woldecke, Bjorn A1 - Geiger, Christian T1 - Poster: Prototyping natural interactions in virtual studio environments by demonstrationby - Combining spatial mapping with gesture following T2 - 2013 IEEE Symposium on 3D User Interfaces (3DUI), 16.03.2013 - 17.03.2013, Orlando KW - Poster Y1 - 2013 UR - http://ieeexplore.ieee.org/document/6550224/ SN - 978-1-4673-6098-2 U6 - https://doi.org/10.1109/3DUI.2013.6550224 SP - 153 EP - 154 PB - IEEE ER - TY - CHAP A1 - Marinos, Dionysios A1 - Geiger, Christian A1 - Schwirten, Tobias A1 - Göbel, Sebastian ED - Krüger, Antonio ED - Schöning, Johannes ED - Wigdor, Daniel ED - Haller, Michael T1 - Multitouch navigation in zoomable user interfaces for large diagrams T2 - ACM International Conference on Interactive Tabletops and Surfaces - ITS '10, 07.11.2010 - 10.11.2010, Saarbrücken Y1 - 2010 UR - http://portal.acm.org/citation.cfm?doid=1936652 SN - 9781450303996 U6 - https://doi.org/10.1145/1936652.1936713 PB - ACM Press CY - New York ER - TY - CHAP A1 - Marinos, Dionysios A1 - Geiger, Christian A1 - Herder, Jens T1 - Large-Area Moderator Tracking and Demonstrational Configuration of Position Based Interactions for Virtual Studio T2 - EuroITV '12 Proceedings of the 10th European Conference on Interactive TV and Video N2 - In this paper we introduce a system for tracking persons walking or standing on a large planar surface and for using the acquired data to easily configure position based interactions for virtual studio productions. The tracking component of the system, radarTRACK, is based on a laser scanner device capable of delivering interaction points on a large configurable plane. By using the device on the floor it is possible to use the delivered data to detect feet positions and derive the position and orientation of one or more users in real time. The second component of the system, named OscCalibrator, allows for the easy creation of multidimensional linear mappings between input and output parameters and the routing of OSC messages within a single modular design environment. We demonstrate the use of our system to flexibly create position-based interactions in a virtual studio environment. KW - body tracking KW - OSC mapping KW - virtual studio interaction KW - measurement KW - design KW - reliability KW - experimentation KW - human factors KW - VSVR KW - Virtual (TV) Studio Y1 - 2012 UR - https://dl.acm.org/citation.cfm?id=2325639 SN - 978-1-4503-1107-6 U6 - https://doi.org/10.1145/2325616.2325639 SP - 105 EP - 114 PB - ACM CY - New York ER - TY - CHAP A1 - Marinos, Dionysios A1 - Geiger, Christian ED - Grimshaw, Mark ED - Walther-Hansen, Mads T1 - Facilitating the creation of natural interactions for live audiovisual performances T2 - Proceedings of the 9th Audio Mostly on A Conference on Interaction With Sound - AM '14, Aalborg, 01.10.2014 - 03.10.2014 Y1 - 2014 UR - http://dl.acm.org/citation.cfm?doid=2636879 SN - 9781450330329 U6 - https://doi.org/10.1145/2636879.2636893 SP - 1 EP - 6 PB - ACM Press CY - New York ER - TY - CHAP A1 - Marinos, Dionysios A1 - Geiger, Christian T1 - An immersive multiuser music generation interface T2 - Proceedings of the International Conference on Advances in Computer Enterntainment Technology - ACE '09, 29.10.2009 - 31.10.2009, Athens Y1 - 2009 UR - http://portal.acm.org/citation.cfm?doid=1690388 SN - 9781605588643 U6 - https://doi.org/10.1145/1690388.1690486 PB - ACM Press CY - New York ER - TY - CHAP A1 - Ludwig, Philipp A1 - Büchel, Joachim A1 - Herder, Jens A1 - Vonolfen, Wolfgang T1 - InEarGuide - A Navigation and Interaction Feedback System using In Ear Headphones for Virtual TV Studio Productions T2 - 9. Workshop Virtuelle und Erweiterte Realität der GI-Fachgruppe VR/AR N2 - This paper presents an approach to integrate non-visual user feedback in today's virtual tv studio productions. Since recent studies showed that systems providing vibro-tactile feedback are not sufficient for replacing the common visual feedback, we developed an audio-based solution using an in ear headphone system, enabling a talent to move, avoid and point to virtual objects in a blue or green box. The system consists of an optical head tracking system, a wireless in ear monitor system and a workstation, which performs all application and audio processing. Using head related transfer functions, the talent gets directional and distance cues. Past research showed, that generating reflections of the sounds and simulating the acoustics of the virtual room helps the listener to conceive the acoustical feedback, we included this technique as well. In a user study with 15 participants the performance of the system was evaluated. KW - Navigation KW - virtual TV KW - erweiterte Realität KW - VSVR KW - Virtual (TV) Studio Y1 - 2012 CY - Düsseldorf ER - TY - CHAP A1 - Lehmann, Anke A1 - Geiger, Christian A1 - Woldecke, Bjorn A1 - Stocklein, Jorg T1 - Poster: Design and evaluation of 3D content with wind output T2 - 2009 IEEE Symposium on 3D User Interfaces, 14.03.2009 - 15.03.2009, Lafayette KW - Poster Y1 - 2009 UR - http://ieeexplore.ieee.org/document/4811231/ SN - 978-1-4244-3965-2 U6 - https://doi.org/10.1109/3DUI.2009.4811231 SP - 151 EP - 152 PB - IEEE ER - TY - CHAP A1 - Ladwig, Philipp A1 - Pech, Alexander A1 - Dorner, Ralf A1 - Geiger, Christian T1 - Unmasking Communication Partners: A Low-Cost AI Solution for Digitally Removing Head-Mounted Displays in VR-Based Telepresence T2 - 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), Utrecht, 14.12.2020 - 18.12.2020 KW - Mirevi Y1 - 2020 UR - https://doi.org/10.1109/AIVR50618.2020.00025 SN - 978-1-7281-7463-1 U6 - https://doi.org/10.1109/AIVR50618.2020.00025 SP - 82 EP - 90 PB - IEEE ER - TY - CHAP A1 - Ladwig, Philipp A1 - Herder, Jens A1 - Geiger, Christian T1 - Towards Precise, Fast and Comfortable Immersive Polygon Mesh Modelling: Capitalising the Results of Past Research and Analysing the Needs of Professionals T2 - ICAT-EGVE 2017 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments N2 - More than three decades of ongoing research in immersive modelling has revealed many advantages of creating objects in virtual environments. Even though there are many benefits, the potential of immersive modelling has only been partly exploited due to unresolved problems such as ergonomic problems, numerous challenges with user interaction and the inability to perform exact, fast and progressive refinements. This paper explores past research, shows alternative approaches and proposes novel interaction tools for pending problems. An immersive modelling application for polygon meshes is created from scratch and tested by professional users of desktop modelling tools, such as Autodesk Maya, in order to assess the efficiency, comfort and speed of the proposed application with direct comparison to professional desktop modelling tools. KW - Human-centered computing KW - Virtual reality KW - Interaction techniques KW - Interaction design process and methods KW - Information systems Y1 - 2017 UR - http://vsvr.medien.hs-duesseldorf.de/publications/egve2017-mod-abstract.html U6 - https://doi.org/10.2312/egve.20171360 SP - 22 EP - 24 PB - The Eurographics Association ER - TY - CHAP A1 - Ladwig, Philipp A1 - Geiger, Christian ED - Auer, Michael E. ED - Langmann, Reinhard T1 - A Literature Review on Collaboration in Mixed Reality T2 - Smart Industry & Smart Education. Proceedings of the 15th International Conference on Remote Engineering and Virtual Instrumentation Y1 - 2019 UR - https://doi.org/10.1007/978-3-319-95678-7_65 SN - 978-3-319-95677-0 U6 - https://doi.org/10.1007/978-3-319-95678-7_65 VL - Lecture Notes in Networks and Systems SP - 591 EP - 600 PB - Springer International Publishing CY - Cham ER - TY - CHAP A1 - Ladwig, Philipp A1 - Evers, Kester A1 - Jansen, Eric J. A1 - Fischer, Ben A1 - Nowottnik, David A1 - Geiger, Christian T1 - MotionHub: Middleware for Unification of Multiple Body Tracking Systems T2 - Proceedings of the 7th International Conference on Movement and Computing: MOCO '20: 7th International Conference on Movement and Computing, Jersey City, 15.07.2020-17.07.2020 Y1 - 2020 UR - https://dl.acm.org/doi/proceedings/10.1145/3401956 SN - 9781450375054 U6 - https://doi.org/10.1145/3401956.3404185 SP - 1 EP - 8 PB - ACM CY - New York ER - TY - JOUR A1 - Kunii, Tosiyasu L. A1 - Herder, Jens A1 - Myszkowski, Karol A1 - Okunev, Oleg A1 - Okuneva, Galina A1 - Ibusuki, Masumi T1 - Articulation Simulation for an Intelligent Dental Care System JF - Displays N2 - CAD/CAM techniques are used increasingly in dentistry for design and fabrication of teeth restorations. An important issue is preserving occlusal contacts of teeth after restoration. Traditional techniques based on the use of casts with mechanical articulators require manual adjustment of occlusal surface, which becomes impractical when hard restoration materials like porcelain are used; they are also time and labor consuming. Most existing computer systems ignore completely such an articulation check, or perform the check at the level of a tooth and its immediate neighbors. We present a new mathematical model and a related user interface for global articulation simulation, developed for the Intelligent Dental Care System project. The aim of the simulation is elimination of the use of mechanical articulators and manual adjustment in the process of designing dental restorations and articulation diagnostic. The mathematical model is based upon differential topological modeling of the jawbs considered as a mechanical system. The user interface exploits metaphors that are familiar to dentists from everyday practice. A new input device designed specifically for use with articulation simulation is proposed. Y1 - 1994 VL - 15 IS - 3 SP - 181 EP - 188 ER - TY - CHAP A1 - Klapdohr, Monika A1 - Wöldecke, Björn A1 - Marinos, Dionysios A1 - Herder, Jens A1 - Geiger, Christian A1 - Vonolfen, Wolfgang T1 - Vibrotactile Pitfalls: Arm Guidance for Moderators in Virtual TV Studios T2 - HC '10 Proceedings of the 13th International Conference on Humans and Computers N2 - For this study, an experimental vibrotactile feedback system was developed to help actors with the task of moving their arm to a certain place in a virtual tv studio under live conditions. Our intention is to improve interaction with virtual objects in a virtual set, which are usually not directly visible to the actor, but only on distant displays. Vibrotactile feedback might improve the appearance on tv because an actor is able to look in any desired direction (camera or virtual object) or to read text on a teleprompter while interacting with a virtual object. Visual feedback in a virtual studio lacks spatial relation to the actor, which impedes the adjustment of the desired interaction. The five tactors of the implemented system which are mounted on the tracked arm give additional information like collision, navigation and activation. The user study for the developed system shows that the duration for reaching a certain target is much longer in case no visual feedback is given, but the accuracy is similar. In this study, subjects reported that an activation signal indicating the arrival at the target of a drag & drop task was helpful. In this paper, we discuss the problems we encountered while developing such a vibrotactile display. Keeping these pitfalls in mind could lead to better feedback systems for actors in virtual studio environments. KW - vibrotactile feedback KW - Virtual (TV) Studio KW - augmented reality KW - FHD KW - VSVR Y1 - 2010 UR - https://dl.acm.org/citation.cfm?id=1994506 SP - 72 EP - 80 PB - University of Aizu Press CY - Aizu-Wakamatsu ER - TY - CHAP A1 - Kierepka, Oliver A1 - Brosda, Constantin A1 - Geiger, Christian ED - Herrlich, Marc ED - Malaka, Rainer ED - Masuch, Maic T1 - The Soundtrack Of Your Life T2 - Entertainment Computing - ICEC 2012, 11th, September 26-29, 2012, Bremen, Proceedings Y1 - 2012 SN - 978-3-642-33541-9 U6 - https://doi.org/10.1007/978-3-642-33542-6_47 SP - 437 EP - 440 PB - Springer CY - Berlin, Heidelberg ER - TY - JOUR A1 - Juttner, Carsten A1 - Herder, Jens T1 - Lighting an Interactive Scene in Real-time with a GPU and Video Textures JF - Journal of the 3D-Forum Society N2 - The presentation of virtual environments in real time has always been a demanding task. Specially designed graphics hardware is necessary to deal with the large amounts of data these applications typically produce. For several years the chipsets that were used allowed only simple lighting models and fixed algorithms. But recent development has produced new graphics processing units (GPUs) that are much faster and more programmable than their predecessors. This paper presents an approach to take advantage of these new features. It uses a video texture as part of the lighting calculations for the passenger compartment of a virtual train and was run on the GPU of a recent PC graphics card. The task was to map the varying illumination of a filmed landscape onto the virtual objects and also onto another video texture (showing two passengers), thereby enhancing the realism of the scene. KW - graphics processing unit KW - shader programming KW - video textures KW - virtual prototyping KW - FHD KW - VSVR Y1 - 2006 VL - 20 IS - 1 SP - 22 EP - 28 ER - TY - JOUR A1 - Jens Herder, T1 - Optimization of Sound Spatialization Resource Management through Clustering JF - Journal of the 3D-Forum Society N2 - Level-of-detail is a concept well-known in computer graphics to reduce the number of rendered polygons. Depending on the distance to the subject (viewer), the objects’ representation is changed. A similar concept is the clustering of sound sources for sound spatialization. Clusters can be used to hierarchically organize mixelsand to optimize the use of resources, by grouping multiple sources together into a single representative source. Such a clustering process should minimize the error of position allocation of elements, perceived as angle and distance, and also differences between velocity relative to the sink (i.e., Doppler shift). Objects with similar direction of motion and speed (relative to sink) in the same acoustic resolution cone and with similar distance to a sink can be grouped together. KW - audio rendering KW - clustering, and human perception KW - Resource Management KW - Sound Spatialization KW - VSVR Y1 - 1999 VL - 13 IS - 3 SP - 59 EP - 65 ER - TY - GEN A1 - Jarosch, Monika A1 - Herder, Jens A1 - Langmann, Mathias T1 - Entwicklung einer AR-Applikation zur kosteneffektiven volumetrischen Erfassung von Baugruben T2 - gis.Science N2 - Die volumetrische Erfassung von Aushüben auf Baustellen ist ein kostenrelevanter Faktor und wird auch heute im täglichen Baustellenbetrieb oft noch in manueller Detailarbeit durchgeführt. Kostengünstige Sensoren zur Tiefenerfassung ermöglichen die halbautomatische Erfassung von Baugruben. Augmented Reality (AR) kann für diesen Prozess das nötige Feedback liefern. Vorgestellt wird ein Prototyp, bestehend aus einem Tablet mit integrierter Kamera und einem Lidar-Scanner. Es wird die Erfassung des Volumens bezüglich Nutzbarkeit und Genauigkeit mit Einsatz von AR getestet und evaluiert. Zur Bestimmung des Volumens wird unter Verwendung von Strahlen mit Unterstützung einer Grafik-Engine ein Algorithmus entwickelt. Der Algorithmus ist robust gegen nicht vollständig geschlossene Volumen. Die Bedienung, Überprüfung und Visualisierung findet durch praktischen Einsatz von AR statt. KW - Volumenbestimmung KW - Augmented Reality KW - Baustelle KW - LIDAR KW - VSVR Y1 - 2022 UR - https://gispoint.de/artikelarchiv/gis/2022/gisscience-ausgabe-22022/7427-entwicklung-einer-ar-applikation-zur-kosteneffektiven-volumetrischen-erfassung-von-baugruben.html SN - 2698-4571 N1 - Der Artikel ist als PDF beim Verlag herunterladbar. Dieses wurde nach 3 Monaten freigeschaltet. Vorher war ein Abonnement notwendig. VL - 2022 IS - 2 SP - 75 EP - 83 ER - TY - CHAP A1 - Ishikawa, Kimitaka A1 - Hirose, Minefumi A1 - Herder, Jens T1 - A Sound Spatialization Server for a Speaker Array as an Integrated Part of a Virtual Environment T2 - IEEE YUFORIC Germany 98 N2 - Spatial sound plays an important role in virtual reality environments, allowing orientation in space, giving a feeling of space, focusing the user on events in the scene, and substituting missing feedback cues (e.g., force feedback). The sound spatialization framework of the University of Aizu, which supports number of spatialization backends, has been extended to include a sound spatialization server for a multichannel loudspeaker array (Pioneer Sound Field Control System). Our goal is that the spatialization server allows easy integration into virtual environments. Modeling of distance cues, which are essential for full immersion, is discussed. Furthermore, the integration of this prototype into different applications allowed us to reveal the advantages and problems of spatial sound for virtual reality environments. KW - distance cue KW - loudspeaker array KW - psychoacoustic KW - sound spatialization server Y1 - 1998 UR - http://vsvr.medien.hs-duesseldorf.de/publications/ve98-spatial-server/welcome.html PB - IEEE CY - Stuttgart ER - TY - CHAP A1 - Huldtgren, Alina A1 - Vormann, Anja A1 - Geiger, Christian ED - Helfert, Markus ED - Holzinger, Andreas ED - Ziefle, Martina ED - Fred, Ana ED - O'Donoghue, John ED - Röcker, Carsten T1 - Mapping Memories for People with Dementia T2 - Information and Communication Technologies for Ageing Well and e-Health Y1 - 2015 SN - 978-3-319-27694-6 U6 - https://doi.org/10.1007/978-3-319-27695-3_10 SP - 165 EP - 184 PB - Springer International Publishing CY - Cham ER - TY - CHAP A1 - Huldtgren, Alina A1 - Vormann, Anja A1 - Geiger, Christian T1 - Reminiscence Map - Insights to Design for People with Dementia from a Tangible Prototype T2 - Proceedings of the 1st International Conference on Information and Communication Technologies for Ageing Well and e-Health, Lisbon, 20.05.2015 - 22.05.2015 Y1 - 2015 UR - http://www.scitepress.org/DigitalLibrary/Link.aspx?doi=10.5220/0005442702330242 SN - 978-989-758-102-1 U6 - https://doi.org/10.5220/0005442702330242 SP - 233 EP - 242 PB - SCITEPRESS - Science and Technology Publications ER - TY - CHAP A1 - Huldtgren, Alina A1 - Mertl, Fabian A1 - Vormann, Anja A1 - Geiger, Christian ED - Abascal, Julio ED - Barbosa, Simone ED - Fetter, Mirko ED - Gross, Tom ED - Palanque, Philippe ED - Winckler, Marco T1 - Probing the Potential of Multimedia Artefacts to Support Communication of People with Dementia T2 - Human-Computer Interaction – INTERACT 2015 Y1 - 2015 SN - 978-3-319-22697-2 U6 - https://doi.org/10.1007/978-3-319-22698-9_6 SP - 71 EP - 79 PB - Springer International Publishing CY - Cham ER - TY - JOUR A1 - Huldtgren, Alina A1 - Mertl, Fabian A1 - Vormann, Anja A1 - Geiger, Christian T1 - Reminiscence of People With Dementia Mediated by Multimedia Artifacts JF - Interacting with Computers Y1 - 2017 U6 - https://doi.org/10.1093/iwc/iwx005 VL - 29 IS - 5 SP - 679 EP - 696 PB - Oxford University Press ER - TY - CHAP A1 - Huldtgren, Alina A1 - Mertl, Fabian A1 - Vormann, Anja A1 - Geiger, Christian T1 - Reminiscence of People with Dementia Mediated by a Tangible Multimedia Book T2 - Proceedings of the International Conference on Information and Communication Technologies for Ageing Well and e-Health,, Rome, 21.04.2016 - 22.04.2016 Y1 - 2016 UR - http://www.scitepress.org/DigitalLibrary/Link.aspx?doi=10.5220/0005758801910201 SN - 978-989-758-180-9 U6 - https://doi.org/10.5220/0005758801910201 SP - 191 EP - 201 PB - SCITEPRESS - Science and Technology Publications ER - TY - CHAP A1 - Huldtgren, Alina A1 - Mayer, Christian A1 - Kierepka, Oliver A1 - Geiger, Christian ED - Chisik, Yoram T1 - Towards serendipitous urban encounters with SoundtrackOfYourLife T2 - Proceedings of the 11th Conference on Advances in Computer Entertainment Technology, Funchal, 11.11.2014-14.11.2014 Y1 - 2014 UR - https://dl.acm.org/doi/proceedings/10.1145/2663806 SN - 9781450329453 U6 - https://doi.org/10.1145/2663806.2663836 SP - 1 EP - 8 PB - ACM CY - New York ER - TY - JOUR A1 - Honno, Kuniaki A1 - Suzuki, Kenji A1 - Herder, Jens T1 - Distance and Room Effects Control for the PSFC, an Auditory Display using a Loudspeaker Array JF - Journal of the 3D-Forum Society N2 - The Pioneer Sound Field Controller (PSFC), a loudspeaker array system, features realtime configuration of an entire sound field, including sound source direction, virtual distance, and context of simulated environment (room characteristics: room size and liveness) for each of two sound sources. In the PSFC system, there is no native parameter to specify the distance between the sound source and sound sink (listener) and also no function to control it directrly. This paper suggests the method to control virtual distance using basic parameters: volume, room size and liveness. The implementation of distance cue is an important aspect of 3D sounds. Virtual environments supporting room effects like reverberation not only gain realism but also provide additional information to users about surrounding space. The context switch of different aural attributes is done by using an API of the Sound Spatialization Framework. Therefore, when the sound sink move through two rooms, like a small bathroom and a large living room, the context of the sink switches and different sound is obtained. KW - VSVR Y1 - 2000 VL - 14 IS - 4 SP - 146 EP - 151 ER - TY - CHAP A1 - Honno, Kuniaki A1 - Suzuki, Kenji A1 - Herder, Jens T1 - Distance and Room Effects Control for the PSFC, an Auditory Display using a Loudspeaker Array T2 - Third International Conference on Human and Computer N2 - The Pioneer Sound Field Controller (PSFC), a loudspeaker array system, features realtime configuration of an entire sound field,including sound source direction, virtual distance, and context of simulated environment (room characteristics: room size and liveness)for each of two sound sources. In the PSFC system, there is no native parameter to specify the distance between the sound source and sound sink (listener) and also no function to control it directrly. This paper suggests the method to control virtual distance using basic parameters: volume, room size and liveness. The implementation of distance cue is an important aspect of 3D sounds. Virtual environments supporting room effects like reverberation not only gain realism but also provide additional information to users about surrounding space. The context switch of different aural attributes is done by using an API of the Sound Spatialization Framework. Therefore, when the sound sink move through two rooms, like a small bathroom and a large living room, the context of the sink switches and different sound is obtained. KW - VSVR Y1 - 2000 SP - 71 EP - 76 PB - University of Aizu CY - Aizu-Wakamatsu ER - TY - JOUR A1 - Hesse, Jan A1 - König, Rainer A1 - Logi, Filippo A1 - Herder, Jens T1 - A Prototype of an Interface Builder for the Common Lisp Interface Manager - CLIB JF - ACM Sigplan Notices N2 - The Common Lisp Interface Manager (CLIM) is used to develop graphical user interfaces for Lisp-basedapplications. With the prototype of the CLIM interface Builder (CLIB) the programmer can generate code for CLIM interactively. The developing process will be fast and less prone to errors. With this new tool, the interactive rapid prototyping reduces costs of a specification phase. Here we present the concept and first results of the prototype of CLIB. Y1 - 1993 U6 - https://doi.org/10.1145/163114.163116 VL - 28 IS - 8 SP - 19 EP - 28 PB - Forschungszentrum Informatik (FZI), Technical Expert Systems and Robotics ER - TY - JOUR A1 - Herder, Jens A1 - Yamazaki, Yasuhiro T1 - A Chatspace Deploying Spatial Audio for Enhanced Conferencing JF - Journal of the 3D-Forum Society KW - VSVR Y1 - 2000 VL - 15 IS - 1 ER - TY - CHAP A1 - Herder, Jens A1 - Yamazaki, Yasuhiro T1 - A Chatspace Deploying Spatial Audio for Enhanced Conferencing T2 - Third International Conference on Human and Computer KW - VSVR Y1 - 2000 SP - 197 EP - 202 PB - University of Aizu CY - Aizu-Wakamatsu ER - TY - JOUR A1 - Herder, Jens A1 - Wörzberger, Ralf A1 - Twelker, Uwe A1 - Albertz, Stefan T1 - Use of Virtual Environments in the Promotion and Evaluation of Architectural Designs JF - Journal of the 3D-Forum Society N2 - Virtual environments can create a realistic impression of an architectural space during the architectural design process, providing a powerful tool for evaluation and promotion during a project’s early stages. In comparison to pre-rendered animations, such as walkthroughs based on CAD models, virtual environments can offer intuitive interaction and a more life like experience. Advanced virtual environments allow users to change realtime rendering features with a few manipulations, switching between different versions while still maintaining sensory immersion. This paper reports on an experimental project in which architectural models are being integrated into interactive virtual environments, and includes demonstrations of both the possibilities and limitations of such applications in evaluating, presenting and promoting architectural designs. KW - virtual environments KW - architectural design KW - interactive walkthrough KW - design review KW - VSVR Y1 - 2002 VL - 16 IS - 4 SP - 117 EP - 122 ER - TY - CHAP A1 - Herder, Jens A1 - Wörzberger, Ralf A1 - Juttner, Carsten A1 - Twelker, Uwe ED - Gausemeier, Jürgen ED - Grafe, Michael T1 - Verwendung von Grafikkarten-Prozessoren (GPUs) für eine interaktive Produktvisualisierung in Echtzeit unter Verwendung von Shadern und Videotexturen T2 - Augmented and Virtual Reality in der Produktentstehung N2 - Die Visualisierung von Produkten in Echtzeit ist in vielen Bereichen ein hilfreicher Schritt, um potentiellen Kunden eine Vorstellung vom Einsatzgebiet und einen Überblick über die finale Anwendung zu erlauben. In den letzten Jahren haben neue Technologien in der Grafikkartenindustrie dazu geführt, dass früher nur auf teuren Grafikworkstations verfügbare Möglichkeiten nun auch mit relativ kostengünstigen Karten, welche für den Einsatz in Standard-PCs konzipiert wurden, realisierbar sind. Es wird an einem Modellentwurf des Innenraums des People Cargo Movers gezeigt, wie die Beleuchtung innerhalb einer Echtzeitvisualisierung durch Shader realisiert werden kann. Als Lichtquelle wird dabei eine Landschaftsaufnahme herangezogen, welche als eine von mehreren Videotexturen eingebunden wurde. Außerdem werden real im virtuellen Studio gefilmte Personen im Innenraum gleichermaï‚en über Videotexturen dargestellt und ebenfalls durch die Landschaft beleuchtet. KW - 3D-Echtzeitrendering KW - GPU KW - shader KW - Video Texturen KW - virtual prototyping KW - Echtzeitanwendung KW - FHD KW - VSVR Y1 - 2005 VL - 167 SP - 23 EP - 36 PB - Heinz Nixdorf Institut, Universität Paderborn CY - Paderborn ER - TY - CHAP A1 - Herder, Jens A1 - Wilke, Michael A1 - Heimbach, Julia A1 - Göbel, Sebastian A1 - Marinos, Dionysios T1 - Simple Actor Tracking for Virtual TV Studios Using a Photonic Mixing Device T2 - 12th International Conference on Human and Computer N2 - Virtual TV studios use actor tracking systems for resolving the occlusion of computer graphics and studio camera image. The actor tracking delivers the distance between actor and studio camera. We deploy a photonic mixing device, which captures a depth map and a luminance image at low resolution. The renderer engines gets one depth value per actor using the OSC protocol. We describe the actor recognition algorithm based on the luminance image and the depth value calculation. We discuss technical issues like noise and calibration. KW - actor tracking KW - photonic mixing device KW - virtual studio KW - video processing KW - FHD KW - VSVR Y1 - 2009 CY - Hamamatsu / Aizu-Wakamatsu / Düsseldorf ER - TY - CHAP A1 - Herder, Jens A1 - Vonolfen, Wolfgang A1 - Griesert, Arnfried A1 - Heuer, Stefan A1 - Hoffmann, Ansgar A1 - Höppner, Bernd T1 - Interactive Virtual Set Applications for Post Production T2 - University of Aizu 2004 – Seventh International Conference on Human N2 - Virtual set environments for broadcasting become more sophisticated as well as the visual quality improves. Realtime interaction and production-specific visualization implemented through plugin mechanism enhance the existing systems like the 3DK. This work presents the integration of the Intersense IS-900 SCT camera tracking and 3D interaction into the 3DK virtual studio environment. The main goal of this work is the design of a virtual studio environment for post productions, which includes video output as well as media streaming formats such as MPEG-4. The systems allows high quality offline rendering during post production and 3D interaction by the moderator during the recording. KW - interaction KW - tracking KW - virtual set environments KW - Virtual (TV) Studio KW - post production KW - MPEG-4 KW - FHD KW - VSVR Y1 - 2004 CY - Aizu-Wakamatsu ER - TY - CHAP A1 - Herder, Jens A1 - Takeda, Shinpei A1 - Vermeegen, Kai A1 - Davin, Till A1 - Berners, Dominique A1 - Ryskeldiev, Bektur A1 - Zimmer, Christian A1 - Druzetic, Ivana A1 - Geiger, Christian T1 - Mixed Reality Art Experiments - Immersive Access to Collective Memories T2 - ISEA2019, Proceedings, 25th International Symposium on Electronic Art, Gwangju, South Korea, June 22-28, 2019 N2 - We report about several experiments on applying mixed reality technology in the context of accessing collective memories from atomic bombs, Holocaust and Second World War. We discuss the impact of Virtual Reality, Augmented Virtuality and Augmented Reality for specific memorial locations. We show how to use a virtual studio for demonstrating an augmented reality application for a specific location in a remote session within a video conference. Augmented Virtuality is used to recreate the local environment, thus providing a context and helping the participants recollect emotions related to a certain place. This technique demonstrates the advantages of using virtual (VR) and augmented (AR) reality environments for rapid prototyping and pitching project ideas in a live remote setting. KW - Mixed Reality KW - Augmented Reality KW - Augmented Virtuality KW - Rapid Prototyping KW - Video Conferencing Y1 - 2019 UR - http://www.isea-archives.org/docs/2019/ISEA2019_Proceedings.pdf SP - 334 EP - 341 PB - IESA CY - Gwangju ER - TY - CHAP A1 - Herder, Jens A1 - Novotny, Thomas T1 - Spatial Sound Design and Interaction for Virtual Environments in the Promotion of Architectural Designs T2 - Third International Workshop on Spatial Media N2 - Virtual environment walkthrough applications are generally enhanced by a user’s interactions within a simulated architectural space, but the enhancement that stems from changes in spatial sound that are coupled with a user’s behavior are particularly important, especially within regard to creating a sense of place. When accompanied by stereoscopic image synthesis, spatial sound can immerse the user in a high-realism virtual copy of the real world. An advanced virtual environment that allow users to change realtime rendering features with a few manipulations has been shown to enable switching between different versions of a modeled space while maintaining sensory immersion. This paper reports on an experimental project in which an architectural model is being integrated into such an interactive virtual environment. The focus is on the spatial sound design for supporting interaction, including demonstrations of both the possibilities and limitations of such applications in presenting and promoting architectural designs, as well as in three-dimensional sketching. KW - spatial sound design KW - sketching KW - interaction KW - virtual environments KW - architectural design KW - interactive walkthrough KW - design review KW - VSVR Y1 - 2003 SP - 7 EP - 11 CY - Aizu-Wakamatsu ER - TY - CHAP A1 - Herder, Jens A1 - Neider, Christian A1 - Kinuwaki, Shinichi T1 - HDR-based lighting estimation for virtual studio (TV) environments T2 - 10th International Conference on Human and Computer N2 - Two high dynamic range HDR environments maps based on video streams from fish-eye lens cameras are used for generating virtual lights in a virtual set renderer. The task of realistic virtual light setup of scenes using captured environment maps might be eased as well as visual quality improves. We discuss the light setting problem for virtual studio tv productions which have mixed scenes of real objects, actors, virtual objects and virtual backgrounds. Benefits of hdr interactive light control are that the real light in the studio does not have to be remodeled and the artistic impression by using the light in the studio is also captured. An analysis of system requirements identifies technical challenges. We discuss the properties of a prototype system including test production. KW - HDR environment maps KW - light interaction KW - tracking KW - virtual set environments KW - Virtual (TV) Studio KW - video processing KW - FHD KW - VSVR Y1 - 2007 SP - 111 EP - 117 CY - Düsseldorf, Aizu-Wakamatsu ER - TY - CHAP A1 - Herder, Jens A1 - Myszkowski, Karol A1 - Kunii, Tosiyasu L. A1 - Ibusuki, Masumi ED - Weghorst, Suzanne J. ED - Sieburg, Hans B. ED - Morgan, Karen S. T1 - A Virtual Reality Interface to an Intelligent Dental Care System T2 - Medicine Meets Virtual Reality 4 Y1 - 1996 SP - 17 EP - 20 PB - IOS Press CY - Amsterdam ER - TY - CHAP A1 - Herder, Jens A1 - Kronenwett, Ralf A1 - Lambertz, Simone A1 - Kiefer, Georg A1 - Freihoff, Johann ED - Heinecke, A. M. ED - Paul, H. T1 - Interaktive Echtzeit-3D-Visualisierung Webbasierte Darstellung: Mobilisierung und Homing von Blutstammzellen T2 - Mensch and Computer 2006: Mensch und Computer im Struktur Wandel N2 - Die interaktive Echtzeit 3D-Visualisierung Mobilisierung und Homing von Blutstammzellen wurde konzipiert, um ein sehr komplexes medizinisches Wissen mit den Mitteln der 3-dimensionalen Visualisierung in Echtzeit und des Internets sowie der daraus resultierenden Interaktivität aufzubereiten. Dies musste auf einer Ebene geschehen, die es hinterher auch jedem Nicht-Mediziner erlaubt, die grundlegenden biologischen und medizinischen Sachverhalte nachzuvollziehen. Das Resultat: Eine informative und didaktische Anwendung, aus einer Mischung von interaktiven 3D-Stationen und erklärenden 3D-Animationen. Diskutiert werden die Methodik der Konzeptionsphase und die Interaktionstechniken. KW - Interaktionsmodellierung KW - Visualisierung KW - Immersion KW - Visualisierung KW - eLearning KW - Blutstammzellen KW - Lehre KW - VSVR KW - Virtual Reality Y1 - 2006 SP - 405 EP - 409 PB - Oldenbourg Verlag CY - München ER - TY - CHAP A1 - Herder, Jens A1 - Jaensch, Kai A1 - Horst, Bruno A1 - Novotny, Thomas ED - Gausemeier, Jürgen ED - Grafe, Michael T1 - Testmärkte in einer Virtuellen Umgebung - Die Bestimmung von Preisabsatzfunktionen zur Unterstützung des Innovationsmanagements T2 - Augmented and Virtual Reality in der Produktentstehung N2 - Multimediale Technologien werden in der Marktforschung immer stärker eingesetzt, um flexible und kostengünstige Studien durchzuführen. Im Innovationsprozess kann dabei auf die langjährigen Erfahrungen zurückgegriffen werden, die durch den Einsatz der Computersimulation in der technischen Produktentwicklung zustande gekommen sind. In sehr frühen Phasen des Innovationsprozesses können durch Einsatz der neuen Technologien die Markteinführungskonzepte für neue Produkte getestet werden. Die Applikationen der virtuellen Realität bieten ein einzigartiges Potential, neue Produkte einschlieï‚lich des Marketingkonzeptes zu testen, ohne dass dieses Produkt bereits physisch vorhanden sein muss. Am Beispiel eines Elementes des Marketingkonzeptes, der Preispolitik, zeigt die vorliegende Studie auf, welches Potential die virtuelle Kaufsituation von Produkten bietet. Der Fokus des Projektes liegt auf der interaktiven Produktpräsentation in einer virtuellen Umgebung, die in eine Online-Befragung mit zusätzlichen Werbefilmen eingebettet ist. Visuell hochwertige 3D-Produktpräsentationen versetzen den Probanden in eine virtuelle Einkaufsumgebung, die einem realen Szenario entspricht. Die virtuellen Produkte werden in mehreren Kaufentscheidungsrunden zu unterschiedlichen Preisen angeboten. Der Preisuntersuchung geht eine Präsentation ausgewählter Werbespots sowie eine produktbezogene Befragung voraus. Im Anschluss an die virtuellen Preisentscheidungen werden die Eindrücke sowie einige Kontrollgröen abgefragt. In weitergehenden Studien dieser Art können die Wirkungen mehrerer Marketing-Instrumente zu einem Zeitpunkt untersucht werden, in dem sich die Produkte noch im Entwicklungsprozess befinden. Auf diesem Weg lassen sich auch Wettbewerbsvorteile bestehender Produkte effizienter erkennen und nutzen. Mit den hoch entwickelten Computer- und Visualisierungstechnologien ist ein mächtiges Werkzeug entstanden, das bereits für kommerzielle Präsentationen und Produktstudien eingesetzt wird. Zukünftig kann es auch in Kombination mit Internetanwendungen und klassischen Methoden der Marktforschung zu einem sehr frühen Zeitpunkt umfassende Erkenntnisse über ein Produkt liefern. KW - Virtuelle Umgebungen KW - 3D-Rendering KW - Mensch-Maschine-Kommunikation KW - Innovationsmanagement KW - Preisabsatzfunktion KW - Testmarkt KW - Produkttest KW - Markteinführungskonzept KW - FHD KW - VSVR Y1 - 2004 SN - 3-935433-58-1 VL - 149 SP - 97 EP - 110 PB - Heinz Nixdorf Institut, Universität Paderborn CY - Paderborn ER - TY - CHAP A1 - Herder, Jens A1 - Jaensch, Kai A1 - Garbe, Katharina ED - Gausemeier, Jürgen ED - Grafe, Michael T1 - Haptische Interaktionen in Testumgebungen für Produktpräsentation in Virtuellen Umgebungen T2 - Augmented and Virtual Reality in der Produktentstehung N2 - Durch den vermehrten Einsatz von multimedialen Technologien werden in der Marktforschung die Möglichkeiten der Durchführung flexibler und kostengünstiger Studien gegeben. In sehr frühen Phasen des Innovationsprozesses als Teil der Marktforschung können durch Einsatz von Virtuellen Umgebungen die Markteinführungskonzepte für neue Produkte getestet werden. Mittels Anwendungen der Virtuellen Realität können neue Produkte einschlieï‚lich des Marketingkonzeptes auch haptisch getestet werden, ohne dass dieses Produkt bereits physisch vorhanden sein muss. Informationen werden dem Benutzer in Virtuellen Umgebungen hauptsächlich visuell und ergänzend auditiv übermittelt. Verbreitete Benutzerschnittstellen sind Interaktionsgeräte wie Stylus und Wand. Durch die haptische Wahrnehmung werden Informationen menschengerechter, effektiver und intuitiver wahrgenommen. Objekte in einer virtuellen Umgebung können durch den Einsatz haptischer Interaktionsgeräte ertastet und erfühlt werden und machen dadurch eine differenziertere Beurteilung und Einschätzung durch den Benutzer eben dieser Objekte möglich. Der Fokus des vorliegenden Projektes liegt daher auf der interaktiven haptischen Produktpräsentation in einer virtuellen Einkaufsumgebung, die in Online-Befragungen mit zusätzlichen Werbefilmen eingebettet ist. Als Nebenprodukt wurde das Werkzeug Open Inventor um Knoten zur Modellierung von haptischen Szeneneigenschaften erweitert. KW - Haptik KW - Virtuelle Umgebungen KW - Interaktion KW - Mensch-Maschine-Kommunikation KW - Testumgebung KW - Produkttest KW - FHD KW - VSVR Y1 - 2006 SN - 3-939350-07-9 VL - 188 SP - 87 EP - 99 PB - Heinz Nixdorf Institut, Universität Paderborn CY - Paderborn ER - TY - CHAP A1 - Herder, Jens A1 - Geiger, Christian A1 - Lehmann, Anke A1 - Vierjahn, Tom A1 - Wöldecke, Björn ED - Gausemeier, Jürgen ED - Grafe, Michael T1 - Designstrategien für den Einsatz von vibrotaktielem Feedback in Mixed Reality Anwendungen T2 - Augmented & Virtual Reality in der Produktentstehung KW - Mixed Reality KW - Human Computer Interaktion KW - Vibrotaktiles Feedback KW - Haptik Y1 - 2009 SN - 978-3-939350-71-2 VL - 232 SP - 225 EP - 240 PB - Heinz Nixdorf Institut, Universität Paderborn CY - Paderborn ER - TY - JOUR A1 - Herder, Jens A1 - Cohen, Michael T1 - The Helical Keyboard: Perspectives for Spatial Auditory Displays and Visual Music JF - Journal of New Music Research N2 - Auditory displays with the ability to dynamically spatialize virtual sound sources under real-time conditions enable advanced applications for art and music. A listener can be deeply immersed while interacting and participating in the experience. We review some of those applications while focusing on the Helical Keyboard project and discussing the required technology. Inspired by the cyclical nature of octaves and helical structure of a scale, a model of a piano-style keyboard was prepared, which was then geometrically warped into a helicoidal configuration, one octave/revolution, pitch mapped to height and chroma. It can be driven by MIDI events, real-time or sequenced, which stream is both synthesized and spatialized by a spatial sound display. The sound of the respective notes is spatialized with respect to sinks, avatars of the human user, by default in the tube of the helix. Alternative coloring schemes can be applied, including a color map compatible with chromastereoptic eyewear. The graphical display animates polygons, interpolating between the notes of a chord across the tube of the helix. Recognition of simple chords allows directionalization of all the notes of a major triad from the position of its musical root. The system is designed to allow, for instance, separate audition of harmony and melody, commonly played by the left and right hands, respectively, on a normal keyboard. Perhaps the most exotic feature of the interface is the ability to fork oneís presence, replicating subject instead of object by installing multiple sinks at arbitrary places around a virtual scene so that, for example, harmony and melody can be separately spatialized, using two heads to normalize the octave; such a technique effectively doubles the helix from the perspective of a single listener. Rather than a symmetric arrangement of the individual helices, they are perceptually superimposed in-phase, co-extensively, so that corresponding notes in different registers are at the same azimuth. KW - 3D audio KW - virtual reality KW - computer music KW - spatialization KW - spatial media KW - visual music KW - VSVR Y1 - 2002 VL - 31 IS - 3 SP - 269 EP - 281 ER - TY - CHAP A1 - Herder, Jens A1 - Cohen, Michael ED - Gorayska, Barbara ED - Nehaniv, Chrystopher L. ED - Marsh, Jonathon P. T1 - Enhancing Perspicuity of Objects in Virtual Reality Environments T2 - Proceedings, Second International Conference on Cognitive Technology N2 - In an information-rich Virtual Reality (VR) environment, the user is immersed in a world containing many objects providing that information. Given the finite computational resources of any computer system, optimization is required to ensure that the most important information is presented to the user as clearly as possible and in a timely fashion. In particular, what is desired are means whereby the perspicuity of an object may be enhanced when appropriate. An object becomes more perspicuous when the information it provides to the user becomes more readily apparent. Additionally, if a particular object provides high-priority information, it would be advantageous to make that object obtrusive as well as highly perspicuous. An object becomes more obtrusive if it draws attention to itself (or equivalently, if it is hard to ignore). This paper describes a technique whereby objects may dynamically adapt their representation in a user's environment according to a dynamic priority evaluation of the information each object provides. The three components of our approach are: - an information manager that evaluates object information priority, - an enhancement manager that tabulates rendering features associated with increasing object perspicuity and obtrusion as a function of priority, and - a resource manager that assigns available object rendering resources according to features indicated by the enhancement manager for the priority set for each object by the information manager. We consider resources like visual space (pixels), sound spatialization channels (mixels), MIDI/audio channels, and processing power, and discuss our approach applied to different applications. Assigned object rendering features are implemented locally at the object level (e.g., object facing the user using the billboard node in VRML 2.0) or globally, using helper applications (e.g., active spotlights, semi-automatic cameras). KW - autonomous actors KW - obtrusion KW - perspicuity KW - spatial media KW - spatialization KW - user interface design man-machine interfaces KW - Virtual Reality Y1 - 1997 SN - 0-8186-8084-9 SP - 228 EP - 237 PB - IEEE CY - Los Alamitos ER - TY - CHAP A1 - Herder, Jens A1 - Cohen, Michael T1 - Sound Spatialization Resource Management in Virtual Reality Environments T2 - ASVA’97 ‐- Int. Symp. on Simulation, Visualization and Auralization for Acoustic Research and Education N2 - In a virtual reality environment users are immersed in a scene with objects which might produce sound. The responsibility of a VR environment is to present these objects, but a system has only limited resources, including spatialization channels (mixels), MIDI/audio channels, and processing power. The sound spatialization resource manager controls sound resources and optimizes fidelity (presence) under given conditions. For that a priority scheme based on human psychophysical hearing is needed. Parameters for spatialization priorities include intensity calculated from volume and distance, orientation in the case of non-uniform radiation patterns, occluding objects, frequency spectrum (low frequencies are harder to localize), expected activity, and others. Objects which are spatially close together (depending on distance and direction) can be mixed. Sources that can not be spatialized can be treated as a single ambient sound source. Important for resource management is the resource assignment, i.e., minimizing swap operations, which makes it desirable to look-ahead and predict upcoming events in a scene. Prediction is achieved by monitoring objects’ speed and past evaluation values. Fidelity is contrasted for Zifferent kind of resource restrictions and optimal resource assignment based upon unlimited dynamic scene look-ahead. To give standard and comparable results, the VRML 2.0 specification is used as an application programmer interface. Applicability is demonstrated with a helical keyboard, a polyphonic MIDI stream driven animation including user interaction (user moves around, playing together with programmed notes). The developed sound spatialization resource manager gives improved spatialization fidelity under runtime constraints. Application programmers and virtual reality scene designers are freed from the burden of assigning and predicting the sound sources. Y1 - 1997 SP - 407 EP - 414 CY - Tokyo ER - TY - CHAP A1 - Herder, Jens A1 - Brosda, Constantin A1 - Djuderija, Sascha A1 - Drochtert, Daniel A1 - Genc, Ömer A1 - Joeres, Stephan A1 - Kellerberg, Patrick A1 - Looschen, Simon A1 - Geiger, Christian A1 - Wöldecke, Björn T1 - TouchPlanVS - A Tangible Multitouch Planning System for Virtual TV Studio Productions T2 - 2011 IEEE Symposium on 3D User Interfaces (3DUI) N2 - This article presents a new approach of integrating tangible user feedback in todays virtual TV studio productions. We describe a tangible multitouch planning system, enabling multiple users to prepare and customize scene flow and settings. Users can collaboratively view and interact with virtual objects by using a tangible user interface on a shared multitouch surface. The in a 2D setting created TV scenes are simultaneously rendered on an external monitor, using a production/target renderer in 3D. Thereby the user experiences a closer reproduction of a final production. Subsequently, users are able to join together the scenes into one complex plot. Within the developing process, a video prototype of the system shows the user interaction and enables early reviews and evaluations. The requirement analysis is based on expert interviews. KW - augmented KW - virtual realities KW - multimedia information systems KW - FHD KW - VSVR KW - Virtual (TV) Studio Y1 - 2011 UR - https://ieeexplore.ieee.org/document/5759226 SN - 978-1-4577-0064-4 U6 - https://doi.org/10.1109/3DUI.2011.5759226 SP - 103 EP - 104 PB - IEEE CY - Singapore ER - TY - CHAP A1 - Herder, Jens T1 - Tools and widgets for spatial sound authoring T2 - CompuGraphics ' 97, Sixth International Conference on Computational Graphics and Visualization Techniques: Graphics in the Internet Age, Vilamoura, Portugal N2 - Broader use of virtual reality environments and sophisticated animations spawn a need for spatial sound. Until now, spatial sound design has been based very much on experience and trial and error. Most effects are hand-crafted, because good design tools for spatial sound do not exist. This paper discusses spatial sound authoring and its applications, including shared virtual reality environments based on VRML. New utilities introduced by this research are an inspector for sound sources, an interactive resource manager, and a visual soundscape manipulator. The tools are part of a sound spatialization framework and allow a designer/author of multimedia content to monitor and debug sound events. Resource constraints like limited sound spatialization channels can also be simulated. KW - spatial sound KW - virtual reality environments KW - multimedia KW - spatialization KW - spatial media KW - vizualization KW - user interface design KW - man-machine interfaces Y1 - 1997 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:hbz:due62-opus-896 UR - http://vsvr.medien.hs-duesseldorf.de/publications/cg97-tawfssa/welcome.html SN - 972-8342-02-0 N1 - Zugriff auf die Konferenzveröffentlichung über den angegebene URL conference paper available via URL SP - 87 EP - 95 CY - Portugal ER - TY - JOUR A1 - Herder, Jens T1 - Sound Spatialization Framework: An Audio Toolkit for Virtual Environments JF - Journal of the 3D-Forum Society N2 - The Sound Spatialization Framework is a C++ toolkit and development environment for providing advanced sound spatialization for virtual reality and multimedia applications. The Sound Spatialization Framework provides many powerful display and user-interface features not found in other sound spatialization software packages. It provides facilities that go beyond simple sound source spatialization: visualization and editing of the soundscape, multiple sinks, clustering of sound sources, monitoring and controlling resource management, support for various spatialization backends, and classes for MIDI animation and handling. Keywords: sound spatialization, resource management, virtual environments, spatial sound authoring, user interface design, human-machine interfaces KW - sound spatialization KW - resource management KW - virtual environments KW - spatial sound authoring KW - user interface design KW - human-machine interfaces Y1 - 1998 VL - 12 IS - 3 SP - 17 EP - 22 ER - TY - CHAP A1 - Herder, Jens T1 - Interactive Content Creation with Virtual Set Environments T2 - Fourth International Conference on Human and Computer N2 - Digital broadcasting enables interactive \sc tv, which presents new challenges for interactive content creation. Besides the technology for streaming and viewing, tools and systems are under development that extend traditional \sc tv studios with virtual set environments. This presentation reviews current technology and describes the requirements for such systems. Interoperability over the production, streaming, and viewer levels requires open interfaces. As the technology allow more interaction, it becomes inherent difficult to control the quality of the viewers experience KW - VSVR KW - digital broadcasting Y1 - 2001 PB - University of Aizu CY - Aizu-Wakamatsu ER - TY - CHAP A1 - Herder, Jens T1 - Challenges of Virtual Sets: From Broadcasting to Interactive Media T2 - Seventh International Workshop on Human N2 - Virtual sets have evolved from computer-generated, prerendered 2D backgrounds to realtime, responsive 3D computer graphics and are nowadays standard repertoire of broadcasting divisions. The graphics, which are combined with real video feed becoming moresophisticated, real looking and more responsive. We will look at the recent developments and suggest further developments like integration of spatial audio into the studio production and generating interactive media streams. Educational institutes recognize the demands of the rising media industry and established new courses on media technology like the Duesseldorf University of Applied Sciences. KW - Education KW - Interactive Media KW - Sound Spatialization KW - Virtual Sets KW - Virtual (TV) Studio KW - VSVR Y1 - 2000 SP - 13 EP - 17 PB - University of Aizu CY - Aizu-Wakamatsu ER - TY - JOUR A1 - Herder, Jens T1 - Interactive Content Creation with Virtual Set Environments JF - Journal of the 3D-Forum Society N2 - Digital broadcasting enables interactive \sc tv studios with virtual set environments. This presentation reviews current technology and describes the requirements for such systems. Interoperability over the production, streaming, and viewer levels requires open interfaces. As the technology allow more interaction, it becomes inherent difficult to control the quality of the viewers experience. KW - Interactive Media KW - Sound Spatialization KW - Virtual Sets KW - virtual studio KW - VSVR Y1 - 2001 VL - 15 IS - 4 SP - 53 EP - 56 ER - TY - CHAP A1 - Herder, Jens T1 - Applications of Spatial Auditory Displays in the Context of Art and Music T2 - Human Supervision and Control in Engineering and Music KW - VSVR Y1 - 2001 PB - Universität Kassel CY - Kassel ER - TY - THES A1 - Herder, Jens T1 - A Sound Spatialization Resource Management Framework N2 - In a virtual reality environment, users are immersed in a scene with objects which might produce sound. The responsibility of a VR environment is to present these objects, but a practical system has only limited resources, including spatialization channels (mixels), MIDI/audio channels, and processing power. A sound spatialization resource manager, introduced in this thesis, controls sound resources and optimizes fidelity (presence) under given conditions, using a priority scheme based on psychoacoustics. Objects which are spatially close together can be coalesced by a novel clustering algorithm, which considers listener localization errors. Application programmers and VR scene designers are freed from the burden of assigning mixels and predicting sound source locations. The framework includes an abstract interface for sound spatialization backends, an API for the VR environments, and multimedia authoring tools. KW - audio rendering KW - human perception KW - Resource Management KW - Sound Spatialization Y1 - 1999 UR - http://vsvr.medien.hs-duesseldorf.de/publications/phd99-abstract.html PB - University of Tsukuba CY - Tsukuba ER - TY - CHAP A1 - Herder, Jens T1 - Optimization of Sound Spatialization Resource Management through Clustering T2 - Second International Conference on Human and Computer N2 - Level-of-detail is a concept well-known in computer graphics to reduce the number of rendered polygons. Depending on the distance to the subject (viewer), the objects’ representation is changed. A similar concept is the clustering of sound sources for sound spatialization. Clusters can be used to hierarchically organize mixels and to optimize the use of resources, by grouping multiple sources together into a single representative ource. Such a clustering process should minimize the error of position allocation of elements, perceived as angle and distance, and also differences between velocity relative to the sink (i.e., Doppler shift). Objects with similar direction of motion and speed (relative to sink) in the same acoustic resolution cone and with similar distance to a sink can be grouped together. KW - audio rendering KW - clustering, and human perception KW - Resource Management KW - Sound Spatialization Y1 - 1999 SP - 1 EP - 7 CY - Aizu-Wakamatsu ER - TY - GEN A1 - Herder, Jens T1 - Interactive Sound Spatialization - a Primer T2 - MM News, University of Aizu Multimedia Center N2 - Sound spatialization is a technology which puts sound into the three dimensional space, so that it has a perceivable direction and distance. Interactive means mutually or reciprocally active. Interaction is when one action (e.g., user moves mouse) has direct or immediate influence to other actions (e.g., processing by a computer: graphics change in size). Based on this definition an introduction to sound reproduction using DVD and virtual environments is given and illustrated by applications (e.g., virtual converts). KW - DVD KW - Interactivity KW - Resource Management KW - Sound Spatialization KW - Virtual Concerts KW - VSVR Y1 - 2000 UR - http://vsvr.medien.hs-duesseldorf.de/publications/mmnews2000-8.pdf VL - 8 SP - 8 EP - 12 ER - TY - JOUR A1 - Herder, Jens T1 - Visualization of a Clustering Algorithm of Sound Sources based on Localization Errors JF - Journal of the 3D-Forum Society N2 - A module for soundscape monitoring and visualizing resource management processes was extended for presenting clusters, generated by a novel sound source clustering algorithm. This algorithm groups multiple sound sources together into a single representative source, considering localization errors depending on listener orientation. Localization errors are visualized for each cluster using resolution cones. Visualization is done in runtime and allows understanding and evaluation of the clustering algorithm. KW - audio rendering, clustering KW - human perception KW - Resource Management KW - Sound Spatialization KW - Visualization Y1 - 1999 VL - 13 IS - 3 SP - 66 EP - 70 ER - TY - CHAP A1 - Herder, Jens T1 - Visualization of a Clustering Algorithm of Sound Sources based on Localization Errors T2 - Second International Conference on Human and Computer N2 - A module for soundscape monitoring and visualizing resource management processes was extended for presenting clusters, generated by a novel sound source clustering algorithm. This algorithm groups multiple sound sources together into a single representative source, considering localization errors depending on listener orientation. Localization errors are visualized for each cluster using resolution cones. Visualization is done in runtime and allows understanding and evaluation of the clustering algorithm. KW - audio rendering, clustering KW - human perception KW - Resource Management KW - Sound Spatialization KW - Visualization Y1 - 1999 SP - 1 EP - 5 CY - Aizu-Wakamatsu ER - TY - JOUR A1 - Herder, Jens T1 - Tools and Widgets for Spatial Sound Authoring JF - Computer Networks & ISDN Systems Y1 - 1998 VL - 30 IS - 20-21 SP - 1933 EP - 1940 PB - Elsevier ER - TY - GEN A1 - Herder, Jens T1 - Konzeption, Implementierung und Integration einer Komponente zur inkrementellen Bezeichner- und Operatoranalyse innerhalb des PSGs N2 - Der Programmier System Generator - PSG - des Fachgebiets Praktische Informatik in Darmstadt erzeugt aus einer Sprachdefinition eine sprachspezifische Programmierumgebung. Diese besteht u. a. aus einem Editor, welcher syntaktische und semantische Fehler von Programmfragmenten, die nicht vollständig sein müssen, erkennen kann. Dem Benutzer werden per Menü Fehlerkorrekturen angeboten. Neben der freien Texteingabe besteht die Möglichkeit, den Text nur mit Hilfe von Menüs zu verfeinern. Teil dieses Editors ist die Bezeichneranalyse. Sie dient als Hilfsmittel für den Benutzer, indem für jede Stelle eines Programmfragmentes die gültigen Bezeichner ausgegeben werden können. Die Kontextanalyse setzt die Berechnung auf den von der Bezeichneranalyse erzeugten Daten auf, um semantische Fehler zu erkennen. Die bis zu dieser Arbeit verwendete Bezeichneranalyse im PSG unterstützt nur einfache Sprachkonzepte (z. B. Fortran und Pascal). Die Gültigkeitskonzepte der Bezeichner von weiterentwickelten Sprachen (z. B. Modula-2, CHILL, Ada oder Pascal-XT) sind nicht vollständig modellierbar. Wir stellen ein neues Konzept zur Definition und Berechnung der Bezeichneranalyse vor, das alle uns bekannten Sprachen mit statischer Typbindung unterstützt. Hierfür haben wir die Sprache BIS - Bezeichneridentifikationssprache - definiert. Die Methode ist verwandt mid dem Zwischencode für geordnete Attributierte Grammatiken. Für jeden Knoten des Abstrakten Syntaxbaumes wird mit Hilfe von BIS ein Code für eine abstrakte Maschine, welche die Bezeichneranalyse durchführt, geschrieben. Im Gegensatz zu herkömlichen Methoden (verkettete Symboltabellen) wird für jeden Punkt innerhalb eines Programmes for der Anfrage durch den Benutzer oder der Kontextanalyse die Menge der gültigen Bezeichner berechnet. Die Kosten für eine Anfrage sind dadurch minimal. Diese abstrakte Maschine teilt sich in zwei unabhängige Maschinen auf, zum einen in die S-Maschine, die die speziellen Operationen der Bezeichneranalyse durchführt, und zum anderen in die G-Maschine, die den Datenfluss und die Auswertung steuert. Diese Aufteilung ermöglicht den Austausch der S-Maschine durch eine andere, welche neue Anwendungsgebiete erschliesst, z. B. die eines Praeprozessors. Die G-Maschine arbeitet inkrementell; es werden nur die Codeschablonen neu ausgewertet, deren geerbten Attribute sich geändert haben. Dazu müssen die Daten, die in einer Codeschablone hinein- und hinausfliessen, abgelegt werden. Dies ergibt bei grossen Programmfragmenten eine immense Rechenzeiteinsparung auf Kosten des Speicherplatzes. Die Funktionsweise wird an einer kleinen Beispielsprache demonstriert, die zu Pascal ähnlich ist. Diese besitzt Konstrukte zum Import und Export von Daten und Datentypen zwischen Programmfragmenten. Im Prototyp kann die inkrementelle Arbeitsweise abgeschaltet werden und ermöglicht einen guten Vergleich der Verfahren. T2 - Specification, Implementation and Integration of a Module for Incremental Identifier and Operator Analysis in the PSG (Programming System Generator) KW - Februar Y1 - 1992 CY - Darmstadt ER - TY - CHAP A1 - Herder, Jens T1 - Matching Light for Virtual Studio TV Productions T2 - 9th International Conference on Human and Computer N2 - High dynamic range environments maps based on still images or video streams are used for computer animation or interactive systems. The task of realistic light setup of scenes using captured environment maps might be eased as well as the visual quality improves. In this article, we discuss the light setting problem for virtual studio (tv) layout and system become more complex to handle this new feature of studio light capturing. The analysis of system requirements identifies the technical challenges. KW - VSVR KW - Animation KW - Virtual (TV) Studio Y1 - 2006 SP - 158 EP - 162 CY - Aizu-Wakamatsu ER - TY - CHAP A1 - Göbel, Sebastian A1 - Geiger, Christian A1 - Heinze, Christin A1 - Marinos, Dionysios ED - Santucci, Giuseppe T1 - Creating a virtual archery experience T2 - Proceedings of the International Conference on Advanced Visual Interfaces - AVI '10, 26.05.2010 - 28.05.2010, ROma Y1 - 2010 UR - http://portal.acm.org/citation.cfm?doid=1842993 SN - 9781450300766 U6 - https://doi.org/10.1145/1842993.1843056 PB - ACM Press CY - New York ER - TY - JOUR A1 - Griesert, Arnfried A1 - Walczak, Oliver A1 - Herder, Jens T1 - Interactive Realtime Terrain Visualization for Virtual Set Applications JF - Journal of the 3D-Forum Society N2 - Virtual set environments for broadcasting become more sophisticated as well as the visual quality improves. Realtime interaction and production-specific visualization implemented through plugin mechanism enhance the existing systems like the virtual studio software 3DK. This work presents an algorithm which can dynamically manage textures of high resolution by prefetching them depending on their requirement in memory and map them on a procedural mesh in realtime. The main goal application of this work is the virtual representation of a flight over a landscape as part of weather reports in virtual studios and the interaction by the moderator. KW - 3D KW - VSVR KW - Virtual (TV) Studio Y1 - 2003 VL - 17 IS - 4 SP - 20 EP - 26 ER - TY - CHAP A1 - Geiger, Christian A1 - Thiele, Simon A1 - Meyer, Laurid A1 - Meyer, Stefan A1 - Hören, Lutz A1 - Drochtert, Daniel ED - Reidsma, Dennis ED - Katayose, Haruhiro ED - Nijholt, Anton T1 - Goin’ Goblins - Iterative Design of an Entertaining Archery Experience T2 - Advances in Computer Entertainment. 10th International Conference, ACE 2013, Boekelo, The Netherlands, November 12-15, 2013. Proceedings Y1 - 2013 SN - 978-3-319-03160-6 U6 - https://doi.org/10.1007/978-3-319-03161-3_20 VL - 8253 SP - 284 EP - 295 PB - Springer International Publishing CY - Cham ER - TY - CHAP A1 - Geiger, Christian A1 - Stoecklein, Joerg A1 - Klompmaker, Florian A1 - Fritze, Robin ED - Inakage, Masa ED - Lee, Newton ED - Tscheligi, Manfred ED - Bernhaupt, Regina ED - Natkin, Stephane T1 - Development of an augmented reality game by extendinga 3D authoring system T2 - Proceedings of the international conference on Advances in computer entertainment technology - ACE '07, 13.06.2007 - 15.06.2007, Salzburg Y1 - 2007 UR - http://portal.acm.org/citation.cfm?doid=1255047 SN - 9781595936400 U6 - https://doi.org/10.1145/1255047.1255099 PB - ACM Press CY - New York ER - TY - CHAP A1 - Geiger, Christian A1 - Stocklein, Jorg A1 - Berssenbrugge, Jan A1 - Paelke, Volker T1 - Mixed Reality Design of Control Strategies T2 - Volume 2: 29th Computers and Information in Engineering Conference, Parts A and B, 30.08.2009 - 02.09.2009, San Diego Y1 - 2009 UR - https://asmedigitalcollection.asme.org/IDETC-CIE/proceedings/IDETC-CIE2009/48999/1621/335536 SN - 978-0-7918-4899-9 U6 - https://doi.org/10.1115/DETC2009-87350 SP - 1621 EP - 1628 PB - ASMEDC ER - TY - CHAP A1 - Geiger, Christian A1 - Reckter, Holger A1 - Paschke, David A1 - Schulz, Florian T1 - Poster: Evolution of a Theremin-Based 3D-Interface for Music Synthesis T2 - 2008 IEEE Symposium on 3D User Interfaces, 08.03.2008 - 09.03.2008, Reno KW - Poster Y1 - 2008 UR - https://doi.org/10.1109/3DUI.2008.4476618 SN - 978-1-4244-2047-6 U6 - https://doi.org/10.1109/3DUI.2008.4476618 SP - 163 EP - 164 PB - IEEE ER - TY - CHAP A1 - Geiger, Christian A1 - Reckter, Holger A1 - Dumitrescu, Roman A1 - Kahl, Sascha A1 - Berssenbrügge, Jan ED - Jacko, Julie A. T1 - A Zoomable User Interface for Presenting Hierarchical Diagrams on Large Screens T2 - Human-Computer Interaction. Novel Interaction Methods and Techniques, 13th International Conference, HCI International 2009, San Diego, CA, USA, July 19-24, 2009, Proceedings, Part II Y1 - 2009 SN - 978-3-642-02576-1 U6 - https://doi.org/10.1007/978-3-642-02577-8_87 VL - 5611 SP - 791 EP - 800 PB - Springer CY - Berlin, Heidelberg ER - TY - CHAP A1 - Geiger, Christian A1 - Rattay, Oliver T1 - TubeMouse - A Two-Handed Input Device for Flexible Objects T2 - 2008 IEEE Symposium on 3D User Interfaces, 08.03.2008 - 09.03.2008, Reno Y1 - 2008 UR - http://ieeexplore.ieee.org/document/4476587/ SN - 978-1-4244-2047-6 U6 - https://doi.org/10.1109/3DUI.2008.4476587 SP - 27 EP - 34 PB - IEEE ER - TY - CHAP A1 - Geiger, Christian A1 - Paelke, Volker A1 - Gansen, Ivonne ED - Hutchison, David ED - Kanade, Takeo ED - Kittler, Josef ED - Kleinberg, Jon M. ED - Mattern, Friedemann ED - Mitchell, John C. ED - Naor, Moni ED - Nierstrasz, Oscar ED - Pandu Rangan, C. ED - Steffen, Bernhard ED - Sudan, Madhu ED - Terzopoulos, Demetri ED - Tygar, Dough ED - Vardi, Moshe Y. ED - Weikum, Gerhard ED - Göbel, Stefan ED - Malkewitz, Rainer ED - Iurgel, Ido T1 - Navigating by Following Stories T2 - Technologies for Interactive Digital Storytelling and Entertainment, Third International Conference, TIDSE 2006, Darmstadt, Germany, December 4-6, 2006, Proceedings Y1 - 2006 UR - https://doi.org/10.1007/11944577_32 SN - 978-3-540-49934-3 U6 - https://doi.org/10.1007/11944577_32 SP - 324 EP - 333 PB - Springer CY - Berlin, Heidelberg ER - TY - CHAP A1 - Geiger, Christian A1 - Hogen, Michael A1 - Hornig, Jörn A1 - Schaar, Michael ED - Butz, Andreas ED - Greenberg, Saul ED - Bakker, Saskia ED - Loke, Lian ED - de Luca, Alexander T1 - Datenreise: : digital bits made tangible T2 - Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction - TEI '14, 16.02.2014 - 19.02.2014, Munich Y1 - 2013 UR - http://dl.acm.org/citation.cfm?doid=2540930 SN - 9781450326353 U6 - https://doi.org/10.1145/2540930.2540945 SP - 283 EP - 284 PB - ACM Press CY - New York ER - TY - CHAP A1 - Geiger, Christian A1 - Herder, Jens A1 - Göbel, Sebastian A1 - Heinze, Christin A1 - Marinos, Dionysios T1 - Design and Virtual Studio Presentation of a Traditional Archery Simulator T2 - Proceedings of the Entertainment Interfaces Track 2010 at Interaktive Kulturen, Duisburg, Germany, September 12-15, 2010 N2 - In this paper we describe the design of a virtual reality simulator for traditional intuitive archery. Traditional archers aim without a target figure. Good shooting results require an excellent body-eye coordination that allows the user to perform identical movements when drawing the bow. Our simulator provides a virtual archery experience and supports the user to learn and practice the motion sequence of traditional archery in a virtual environment. We use an infrared tracking system to capture the user’s movements in order to correct his movement. To provide a realistic haptic feedback a real bow is used as interaction device. Our system provides a believable user experience and supports the user to learn how to shoot in the traditional way. Following a user-centered iterative design approach we developed a number of prototypes and evaluated them for refinement in sequent iteration cycles. For illustration purposes we created a short video clip in our virtual studio about this project that presents the main ideas in an informative yet entertaining way. KW - vr archery KW - 3D interaction KW - interactive sport simulation KW - user experience KW - user-centered design KW - Lehre KW - VSVR KW - Virtual Reality Y1 - 2010 UR - https://dl.gi.de/handle/20.500.12116/7385;jsessionid=149F7CDB1184309727393899BD806939 UR - http://ceur-ws.org/Vol-634/Entertainment-Interfaces-Proceedings03.pdf SP - 37 EP - 44 CY - Duisburg ER - TY - CHAP A1 - Geiger, Christian A1 - Fritze, Robin A1 - Lehmann, Anke A1 - Stöcklein, Jörg ED - Schmidt, Albrecht ED - Gellersen, Hans ED - van den Hoven, Elise ED - Mazalek, Ali ED - Holleis, Paul ED - Villar, Nicolas T1 - HYUI: a visual framework for prototyping hybrid user interfaces T2 - Proceedings of the 2nd international conference on Tangible and embedded interaction - TEI '08, 18.02.2008 - 20.02.2008, Bonn Y1 - 2008 UR - http://portal.acm.org/citation.cfm?doid=1347390 SN - 9781605580043 U6 - https://doi.org/10.1145/1347390.1347406 PB - ACM Press CY - New York ER - TY - CHAP A1 - Garbe, Katharina A1 - Herbst, Iris A1 - Herder, Jens T1 - Spatial Audio for Augmented Reality T2 - 10th International Conference on Human and Computer N2 - Using spatial audio successfully for augmented reality (AR) applications is a challenge, but is awarded with an improved user experience. Thus, we have extended the AR/VR framework \sc Morgan with spatial audio to improve users orientation in an AR application. In this paper, we investigate the users’ capability to localize and memorize spatial sounds (registered with virtual or real objects). We discuss two scenarios. In the first scenario, the user localizes only sound sources and in the second scenario the user memorizes the location of audio-visual objects. Our results reflect spatial audio performance within the application domain and show which technology pitfalls still exist. Finally, we provide design recommendations for spatial audio AR environments. KW - spatial audio KW - augmented reality KW - sound interaction KW - FHD KW - VSVR Y1 - 2007 SP - 53 EP - 58 CY - Düsseldorf, Aizu-Wakamatsu ER - TY - CHAP A1 - Flasko, Matthias A1 - Pogscheba, Patrick A1 - Herder, Jens A1 - Vonolfen, Wolfgang T1 - Heterogeneous binocular camera-tracking in a Virtual Studio T2 - 8. Workshop Virtuelle und Erweiterte Realität der GI-Fachgruppe VR/AR N2 - This paper presents a tracking of parts of a human body in a virtual TV studio environment. The tracking is based on a depth camera and a HD studio camera and aims at a realistic interaction between the actor and the computer generated environment. Stereo calibration methods are used to match corresponding pixels of both cameras (HD color and depth image). Hence the images were rectified and column aligned. The disparity is used to correct the depth image pixel by pixel. This image registration results in row and column aligned images where ghost regions are in the depth image resulting from occlusion. Both images are used to generate foreground masks with chroma and depth keying. The color image is taken for skin color segmentation to determine and distinguish the actor’s hands and face. In the depth image the flesh colored regions were used to determine their spatial position. The extracted positions were augmented by virtual objects. The scene is rendered correctly with virtual camera parameters which were calculated from the camera calibration parameters. Generated computer graphics with alpha value are combined with the HD color images. This compositing shows interaction with augmented objects for verification. The additional depth information results in changing the size of objects next to the hands when the actor moves around. KW - virtual studio KW - camera-tracking KW - VSVR Y1 - 2011 CY - Wedel ER -