TY - CHAP A1 - Amano, Katsumi A1 - Matsushita, Fumio A1 - Yanagawa, Hirofumi A1 - Cohen, Michael A1 - Herder, Jens A1 - Koba, Yoshiharu A1 - Tohyama, Mikio T1 - The Pioneer sound field control system at the University of Aizu Multimedia Center T2 - RO-MAN '96 Tsukuba N2 - The PSFC, or Pioneer sound field control system, is a DSP-driven hemispherical 14-loudspeaker array, installed at the University of Aizu Multimedia Center. Collocated with a large screen rear-projection stereographic display the PSFC features realtime control of virtual room characteristics and direction of two separate sound channels, smoothly steering them around a configurable soundscape. The PSFC controls an entire sound field, including sound direction, virtual distance, and simulated environment (reverb level, room size and liveness) for each source. It can also configure a dry (DSP-less) switching matrix for direct directionalization. The PSFC speaker dome is about 14 m in diameter, allowing about twenty users at once to comfortably stand or sit near its sweet spot. KW - Acoustic reflection KW - Auditory displays KW - Control systems KW - Delay effects KW - Electronic mail KW - Large screen displays KW - Loudspeakers KW - Multimedia systems KW - Reverberation KW - Size control Y1 - 1996 SN - 0-7803-3253-9 U6 - https://doi.org/10.1109/ROMAN.1996.568887 SP - 495 EP - 499 PB - IEEE CY - Piscataway ER - TY - JOUR A1 - Amano, Katsumi A1 - Matsushita, Fumio A1 - Yanagawa, Hirofumi A1 - Cohen, Michael A1 - Herder, Jens A1 - Martens, William A1 - Koba, Yoshiharu A1 - Tohyama, Mikio T1 - A Virtual Reality Sound System Using Room-Related Transfer Functions Delivered Through a Multispeaker Array: the PSFC at the University of Aizu Multimedia Center JF - TVRSJ N2 - The PSFC, or Pioneer Sound Field Controller, is a DSP-driven hemispherical loudspeaker array, installed at the University of Aizu Multimedia Center. The PSFC features realtime manipulation of the primary components of sound spatialization for each of two audio sources located in a virtual environment, including the content (apparent direction and distance) and context (room characteristics: reverberation level, room size and liveness). In an alternate mode, it can also direct the destination of the two separate input signals across 14 loudspeakers, manipulating the direction of the virtual sound sources with no control over apparent distance other than that afforded by source loudness (including no simulated environmental reflections or reverberation). The PSFC speaker dome is about 10 m in diameter, accommodating about fifty simultaneous users, including about twenty users comfortably standing or sitting near its ``sweet spot,'' the area in which the illusions of sound spatialization are most vivid. Collocated with a large screen rear-projection stereographic display, the PSFC is intended for advanced multimedia and virtual reality applications. KW - audio signal processing, audio telecommunications KW - auralization KW - calm technology KW - directional mixing console KW - multichannel sound reproduction KW - room-related transfer functions KW - roomware KW - sound localization KW - virtual conferencing environment Y1 - 1998 U6 - https://doi.org/10.18974/tvrsj.3.1_1 VL - 3 IS - 1 SP - 1 EP - 12 PB - J-STAGE ER - TY - CHAP A1 - Ayten, Hüseyin A1 - Herder, Jens A1 - Vonolfen, Wolfgang T1 - Visual Acceptance Evaluation of Soft Shadow Algorithms for Virtual TV Studios T2 - HC '10 Proceedings of the 13th International Conference on Humans and Computers N2 - Shadows in computer graphics are an important rendering aspect for spatial objects. For realtime computer applications such as games, it is essential to represent shadows as accurate as possible. Also, various tv stations work with virtual studio systems instead of real studio sets. Especially for those systems, a realistic impression of the rendered and mixed scene is important. One challenge, hence, is the creation of a natural shadow impression. This paper presents the results of an empirical study to compare the performance and quality of different shadow mapping methods. For this test, a prototype studio renderer was developed. A percentage closer filter (pcf) with a number of specific resolutions is used to minimize the aliasing issue. More advanced algorithms which generate smooth shadows like the percentage closer soft shadow (pcss) method as well as the variance shadow maps (vsm) method are analysed. Different open source apis are used to develop the virtual studio renderer, giving the benefit of permanent enhancement. The Ogre 3D graphic engine is used to implement the rendering system, benefiting from various functions and plugins. The transmission of the tracking data is accomplished with the vrpn server/client and the Intersense api. The different shadow algorithms are compared in a virtual studio environment which also casts real shadows and thus gives a chance for a direct comparison throughout the empirical user study. The performance is measured in frames per secon KW - Virtual (TV) Studio KW - soft shadow KW - realtime rendering KW - augmented reality KW - algorithmus KW - FHD KW - experimentation KW - verification KW - VSVR Y1 - 2010 UR - https://dl.acm.org/citation.cfm?id=1994505 SP - 66 EP - 71 PB - University of Aizu Press CY - Aizu-Wakamatsu ER - TY - CHAP A1 - Ballester Ripoll, Marina A1 - Herder, Jens A1 - Ladwig, Philipp A1 - Vermeegen, Kai ED - Pfeiffer, Thies ED - Fröhlich, Julia ED - Kruse, Rolf T1 - Comparison of two Gesture Recognition Sensors for Virtual TV Studios T2 - GI-VRAR, Workshop Proceedings / Tagungsband: Virtuelle und Erweiterte Realität – 13. Workshop der GI-Fachgruppe VR/AR, N2 - In order to improve the interactivity between users and computers, recent technologies focus on incorporating gesture recognition into interactive systems. The aim of this article is to evaluate the effectiveness of using a Myo control armband and the Kinect 2 for recognition of gestures in order to interact with virtual objects in a weather report scenario. The Myo armband has an inertial measurement unit and is able to read electrical activity produced by skeletal muscles, which can be recognized as gestures, which are trained by machine learning. A Kinect sensor was used to build up a dataset which contains motion recordings of 8 different gestures and was also build up by a gesture training machine learning algorithm. Both input methods, the Kinect 2 and the Myo armband, were evaluated with the same interaction patterns in a user study, which allows a direct comparison and reveals benefits and limits of each technique. KW - Gesture recognition KW - Interaction KW - Kinect KW - Myo KW - Virtual (TV) Studio KW - Lehre Y1 - 2016 UR - http://vsvr.medien.hs-duesseldorf.de/publications/gi-vrar2016-gesture-abstract.html SN - 978-3-8440-4718-9 PB - Shaker Verlag CY - Herzogenrath ER - TY - CHAP A1 - Baranowski, Artur A1 - Utzig, Sebastian A1 - Fischer, Philipp A1 - Gerndt, Andreas A1 - Herder, Jens ED - Herder, Jens ED - Geiger, Christian ED - Dörner, Ralf ED - Grimm, Paul T1 - 3D spacecraft configuration using immersive AR technology T2 - Workshop Proceedings / Tagungsband: Virtuelle und Erweiterte Realität – 15. Workshop der GI-Fachgruppe VR/AR N2 - In this paper we propose an integrated immersive augmented reality solution for a software tool supporting spacecraft design and verification. The spacecraft design process relies on expertise in many domains, such as thermal and structural engineering. The various subsystems of a spacecraft are highly interdependent and have differing requirements and constraints. In this context, interactive visualizations play an important role in making expert knowledge accessible. Recent immersive display technologies offer new ways of presenting and interacting with computer-generated content. Possibilities and challenges for spacecraft configuration employing these technologies are explored and discussed. A user interface design for an application using the Microsoft HoloLens is proposed. To this end, techniques for selecting a spacecraft component and manipulating its position and orientation in 3D space are developed and evaluated. Thus, advantages and limitations of this approach to spacecraft configuration are revealed and discussed. KW - spacecraft configuration KW - human computer interaction KW - augmented reality KW - 3D user interfaces KW - HoloLens Y1 - 2018 UR - http://vsvr.medien.hs-duesseldorf.de/publications/gi-vrar2018-ar-space/ SN - 978-3-8440-6215-1 U6 - https://doi.org/10.2370/9783844062151 SP - 71 EP - 82 PB - Shaker Verlag CY - Herzogenrath ER - TY - CHAP A1 - Becker, Thomas A1 - Herder, Jens T1 - Cost effective tangibles using fiducials for infrared multi-touch frames T2 - 15th International Conference on Human and Computer N2 - The late immersion of multi-touch sensitive displays enables the use of tangibles on multi-touch screens. There a several wide spread and/or sophisticated solutions to fulfill this need but they seem to have some flaws. One popular system at the time of writing is an overlay frame that can be placed on a normal display with the corresponding size. The frame creates a grid with infrared light emitting diodes. The disruption of this grid can be detected and messages with the positions are sent via usb to a connected computer. This system is quite robust in matters of ambient light insensitivity and also fast to calibrate. Unfortunately it is not created with the recognition of tangibles in mind and printed patterns can not be resolved. This article summarizes an attempt to create fiducials that are recognized by an infrared multi-touch frame as fingers. Those false fingers are checked by a software for known patterns. Once a known pattern (= fiducial) has been recognized its position and orientation are send with the finger positions towards the interactive software. The usability is tested with an example application where tangibles and finger touches are used in combination. KW - low cost multi-touch infrared overlay frame KW - fiducial tangible recognition KW - FHD Y1 - 2012 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:hbz:due62-opus-16011 UR - http://vsvr.medien.hs-duesseldorf.de/publications/hc2012-fiducials-abstract.html N1 - Copyright 2012 University of Aizu Press CY - Hamamatsu/Aizu-Wakamatsu/Duesseldorf ER - TY - CHAP A1 - Brettschneider, Nico A1 - Herder, Jens A1 - de Mooij, Jeroen A1 - Ryskeldiev, Bektur ED - Herder, Jens T1 - Audio vs. Visual Avatars as Guides in Virtual Environments T2 - 21th International Conference on Human and Computer, HC-2018, March 27–28, 2019, Shizuoka University, Hamamatsu, Japan. N2 - Through constant technical progress, multi-user virtual reality is transforming towards a social activity that is no longer only used by remote users, but also in large-scale location-based experiences. We evaluate the usage of realtime-tracked avatars in co-located business-oriented applications in a "guide-user-scenario" in comparison to audio only instructions. The present study examined the effect of an avatar-guide on the user-related factors of Spatial Presence, Social Presence, User Experience and Task Load in order to propose design guidelines for co-located collaborative immersive virtual environments. Therefore, an application was developed and a user study with 40 participants was conducted in order to compare both guiding techniques of a realtime-tracked avatar guide and a non-visualised guide with otherwise constant conditions. Results reveal that the avatar-guide enhanced and stimulated communicative processes while facilitating interaction possibilities and creating a higher sense of mental immersion for users. Furthermore, the avatar-guide appeared to make the storyline more engaging and exciting while helping users adapt to the medium of virtual reality. Even though no assertion could be made concerning the Task Load factor, the avatar-guide achieved a higher subjective value on User Experience. Due to the results, avatars can be considered valuable social elements in the design of future co-located collaborative virtual environments. KW - Virtual Reality KW - Co-located Collaborations KW - Networked Immersive Virtual Environments KW - Head-mounted Display KW - Avatars KW - Lehre Y1 - 2019 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:hbz:due62-opus-23859 UR - https://vsvr.medien.hs-duesseldorf.de/publications/hc2018-avatar/ PB - Hochschule Düsseldorf CY - Düsseldorf ER - TY - CHAP A1 - Brosda, Constantin A1 - Daemen, Jeff A1 - Djuderija, Sascha A1 - Joeres, Stephan A1 - Langer, Oleg A1 - Schweitzer, Andre A1 - Wilhelm, Andreas A1 - Herder, Jens T1 - TouchPlanVS Lite - A Tablet-based Tangible Multitouch Planning System for Virtual TV Studio Productions T2 - Proceedings of the 2012 Joint International Conference on Human-Centered Computer Environments N2 - This paper presents a mobile approach of integrating tangible user feedback in today’s virtual TV studio productions. We describe a tangible multitouch planning system, enabling a single user to prepare and customize scene flow and settings. Users can view and interact with virtual objects by using a tangible user interface on a capacitive multitouch surface. In a 2D setting created TV scenes are simultaneously rendered as separate view using a production/target renderer in 3D. Thereby the user experiences a closer reproduction of a final production and set assets can be reused. Subsequently, a user can arrange scenes on a timeline while maintaining different versions/sequences. The system consists of a tablet and a workstation, which does all application processing and rendering. The tablet is just an interface connected via wireless LAN. KW - virtual studio KW - planning tools KW - tangibles KW - capacitive touch screens KW - application streaming KW - VSVR KW - Virtual (TV) Studio Y1 - 2012 UR - https://dl.acm.org/citation.cfm?doid=2160749.2160764 SN - 978-1-4503-1191-5 SP - 64 EP - 67 PB - ACM CY - New York ER - TY - CHAP A1 - Burga, Jose A1 - Daemen, Jeff A1 - Djuderija, Sascha A1 - Gnehr, Maren A1 - Goossens, Lars A1 - Hartz, Sven A1 - Haufs-Brusberg, Peter A1 - Herder, Jens A1 - Ibrahim, Mohammed A1 - Koop, Nikolas A1 - Leske, Christophe A1 - Meyer, Laurid A1 - Müller, Antje A1 - Salgert, Björn A1 - Schroeder, Richard A1 - Thiele, Simon T1 - Four Metamorphosis States in a Distributed Virtual (TV) Studio: Human, Cyborg, Avatar, and Bot T2 - 10th International Conference on Visual Media Production (CVMP 2013), London N2 - The major challenge in virtual studio technology is the interaction between the actor and virtual objects. Within a distributed live production, two locally separated markerless tracking systems where used simultaneously alongside a virtual studio. The production was based on a fully tracked actor, cyborg (half actor, half graphics), avatar, and a bot. All participants could interact and throw a virtual disc. This setup is compared and mapped to Milgram’s continuum and technical challenges are described. KW - TV KW - Distributed Virtual KW - Studio KW - Human KW - Cyborg KW - Avatar KW - Bot KW - VSVR Y1 - 2013 CY - London ER - TY - RPRT A1 - Christianson, Kiel A1 - Herder, Jens T1 - Mini-lectures in Computer Science on the WWW N2 - The task of the Center for Language Research is to provide content-based English language instruction for students of computer science and engineering. As such, we find ourselves at the confluence of many of the streams currently running through the English Language Teaching profession, including English for Science and Technology (EST), English for Academic Purposes (EAP), English for Specific Purposes (ESP), Computer-assisted language learning (CALL), content-based instruction, and multimedia applications in foreign language pedagogy. This paper describes our initial attempts to construct a number of World Wide Web pages where students will be able to study EST, EAP, and computer science topics on their own in a multimedia environment. KW - English as a foreign language KW - teaching KW - web and video supported learning KW - Lehre Y1 - 1995 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:hbz:due62-opus-854 CY - Aizu ER - TY - CHAP A1 - Cohen, Michael A1 - Herder, Jens ED - Göbel, Martin ED - Landauer, Jürgen ED - Lang, Ulrich ED - Wapler, Matthias T1 - Symbolic representations of exclude and include for audio sources and sinks: Figurative suggestions of mute/solo & cue and deafen/confide & harken T2 - Virtual Environments ’98, Proceedings of the Eurographics Workshop Y1 - 1998 SN - 3-211-83233-5 U6 - https://doi.org/10.1007/978-3-7091-7519-4_23 SP - 235 EP - 242 PB - Springer-Verlag CY - Stuttgart ER - TY - JOUR A1 - Cohen, Michael A1 - Herder, Jens A1 - L. Martens, William T1 - Cyberspatial Audio Technology T1 - available in Japanese as well - Acoustical Society of Japan, Vol. 55, No. 10, pp. 730-731 JF - The Journal of the Acoustical Society of Japan (E) N2 - Cyberspatial audio applications are distinguished from the broad range of spatial audio applications in a number of important ways that help to focus this review. Most significant is that cyberspatial audio is most often designed to be responsive to user inputs. In contrast to non-interactive auditory displays, cyberspatial auditory displays typically allow active exploration of the virtual environment in which users find themselves. Thus, at least some portion of the audio presented in a cyberspatial environment must be selected, processed, or otherwise rendered with minimum delay relative to user input. Besides the technological demands associated with realtime delivery of spatialized sound, the type and quality of auditory experiences supported are also very different from those associated with displays that support stationary sound localization. Y1 - 1999 U6 - https://doi.org/10.1250/ast.20.389 N1 - available in Japanese as well - Acoustical Society of Japan, Vol. 55, No. 10, pp. 730-731 VL - 20 IS - 6 SP - 389 EP - 395 ER - TY - CHAP A1 - Cohen, Michael A1 - Herder, Jens A1 - Martens, William T1 - Panel: Eartop computing and cyberspatial audio technology T2 - IEEE-VR2001: IEEE Virtual Reality KW - VSVR Y1 - 2001 SN - 0-7695-0948-7 SP - 322 EP - 323 PB - IEEE CY - Yokohama ER - TY - CHAP A1 - Daemen, Jeff A1 - Haufs-Brusberg, Peter A1 - Herder, Jens T1 - Markerless Actor Tracking for Virtual (TV) Studio Applications T2 - 2013 International Joint Conference on Awareness Science and Technology & Ubi-Media Computing (iCAST 2013 & UMEDIA 2013) N2 - Virtual (tv) studios gain much more acceptance through improvements in computer graphics and camera tracking. Still commercial studios cannot have full interaction between actors and virtual scene because actors data are not completely digital available as well as the feedback for actors is still not sufficient. Markerless full body tracking might revolutionize virtual studio technology as it allows better interaction between real and virtual world. This article reports about using a markerless actor tracking in a virtual studio with a tracking volume of nearly 40 cubic meter enabling up to three actors within the green box. The tracking is used for resolving the occlusion between virtual objects and actors so that the Tenderer can output automatically a mask for virtual objects in the foreground in case the actor is behind. It is also used for triggering functions scripted within the Tenderer engine, which are attached to virtual objects, starting any kind of action (e.g., animation). Last but not least the system is used for controlling avatars within the virtual set. All tracking and rendering is done within a studio frame rate of 50 Hz with about 3 frames delay. The markerless actor tracking within virtual studios is evaluated by experts using an interview approach. The statistical evaluation is based on a questionnaire. KW - Cameras KW - Tracking KW - TV KW - Skeleton KW - Engines KW - Delays KW - Production KW - VSVR KW - Virtual (TV) Studio Y1 - 2013 UR - https://ieeexplore.ieee.org/document/6765544 SN - 978-1-4799-2364-9 U6 - https://doi.org/10.1109/ICAwST.2013.6765544 SP - 790 EP - 795 PB - IEEE CY - Aizu-Wakamatsu ER - TY - CHAP A1 - Daemen, Jeff A1 - Herder, Jens A1 - Koch, Cornelius A1 - Ladwig, Philipp A1 - Wiche, Roman A1 - Wilgen, Kai T1 - Semi-Automatic Camera and Switcher Control for Live Broadcast T2 - TVX '16 Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video, Chicago, Illinois, USA — June 22 - 24, 2016 N2 - Live video broadcasting requires a multitude of professional expertise to enable multi-camera productions. Robotic systems allow the automation of common and repeated tracking shots. However, predefined camera shots do not allow quick adjustments when required due to unpredictable events. We introduce a modular automated robotic camera control and video switch system, based on fundamental cinematographic rules. The actors' positions are provided by a markerless tracking system. In addition, sound levels of actors' lavalier microphones are used to analyse the current scene. An expert system determines appropriate camera angles and decides when to switch from one camera to another. A test production was conducted to observe the developed prototype in a live broadcast scenario and served as a video-demonstration for an evaluation. KW - automated robotic camera system KW - actor tracking KW - switcher control KW - scene analysis KW - film rules KW - automated shot control KW - Virtual (TV) Studio Y1 - 2016 UR - http://vsvr.medien.hs-duesseldorf.de/publications/tvx2016-rob-abstract.html SN - 978-1-4503-4067-0 U6 - https://doi.org/10.1145/2932206.2933559 SP - 129 EP - 134 PB - ACM CY - New York ER - TY - JOUR A1 - Daemen, Jeff A1 - Herder, Jens A1 - Koch, Cornelius A1 - Ladwig, Philipp A1 - Wiche, Roman A1 - Wilgen, Kai T1 - Halbautomatische Steuerung von Kamera und Bildmischer bei Live-Übertragungen JF - Fachzeitschrift für Fernsehen, Film und Elektronische Medien N2 - Live-Video-Broadcasting mit mehreren Kameras erfordert eine Vielzahl von Fachkenntnissen. Robotersysteme ermöglichen zwar die Automatisierung von gängigen und wiederholten Tracking-Aufnahmen, diese erlauben jedoch keine kurzfristigen Anpassungen aufgrund von unvorhersehbaren Ereignissen. In diesem Beitrag wird ein modulares, automatisiertes Kamerasteuerungs- und Bildschnitt-System eingeführt, das auf grundlegenden kinematografischen Regeln basiert. Die Positionen der Akteure werden durch ein markerloses Tracking-System bereitgestellt. Darüber hinaus werden Tonpegel der Lavaliermikrofone der Akteure zur Analyse der aktuellen Szene verwendet. Ein Expertensystem ermittelt geeignete Kamerawinkel und entscheidet, wann von einer Kamera auf eine andere umgeschaltet werden soll. Eine Testproduktion wurde durchgeführt, um den entwickelten Prototyp in einem Live-Broadcast-Szenario zu beobachten und diente als Videodemonstration für eine Evaluierung. KW - Halbautomatische Roboterkamerasteuerung KW - Verfolgen von Darstellern KW - Bildmischer KW - Szenenanalyse KW - Filmregeln KW - Automatische Bildauswahl KW - Virtual (TV) Studio Y1 - 2017 N1 - Der Artikel ist eine Übersetzung von dem Konferenzbeitrag "Semi-Automatic Camera and Switcher Control for Live Broadcast", International Conference on Interactive Experiences for Television and Online Video, TVX'2016, Chicago, IL, USA, ACM, DOI=10.1145/2932206.2933559, June 22-24, 2016. IS - 11 SP - 501 EP - 505 PB - Schiele & Schön ER - TY - CHAP A1 - Davin, Till A1 - Herder, Jens ED - Weier, Martin ED - Bues, Matthias ED - Wechner, Reto T1 - Real-Time Relighting of Video Streams for Augmented Virtuality Scenes T2 - GI VR / AR Workshop. Gesellschaft für Informatik e.V. KW - Virtual (TV) Studio Y1 - 2021 U6 - https://doi.org/10.18420/vrar2021_6 PB - Gesellschaft für Informatik e.V. (GI) CY - Bonn ER - TY - CHAP A1 - Deppe, Robert A1 - Nemitz, Oliver A1 - Herder, Jens ED - Herder, Jens ED - Geiger, Christian ED - Dörner, Ralf ED - Grimm, Paul T1 - Augmented reality for supporting manual non-destructive ultrasonic testing of metal pipes and plates T2 - Workshop Proceedings / Tagungsband: Virtuelle und Erweiterte Realität – 15. Workshop der GI-Fachgruppe VR/AR N2 - We describe an application of augmented reality technology for non-destructive testing of products in the metal-industry. The prototype is created with hard- and software, that is usually employed in the gaming industry, and delivers positions for creating ultra- sonic material scans (C-scans). Using a stereo camera in combination with an hmd enables realtime visualisation of the probes path, as well as the setting of virtual markers on the specimen. As a part of the implementation the downhill simplex optimization algorithm is implemented to fit the specimen to a cloud of recorded surface points. The accuracy is statistically tested and evaluated with the result, that the tracking system is accurate up to ca. 1-2 millimeters in well set-up conditions. This paper is of interest not only for research institutes of the metal-industry, but also for any areas of work, in which the enhancement with augmented reality is possible and a precise tracking is necessary. KW - Nondestructive Testing KW - Ultrasonic KW - Augmented Reality KW - Tracking KW - Stereo camera KW - M Y1 - 2018 UR - http://vsvr.medien.hs-duesseldorf.de/publications/gi-vrar2018-ar-in-ndt/ SN - 978-3-8440-6215-1 U6 - https://doi.org/10.2370/9783844062151 SP - 45 EP - 52 PB - Shaker Verlag CY - Herzogenrath ER - TY - CHAP A1 - Fiedler, Jannik A1 - Rilling, Stefan A1 - Bogen, Manfred A1 - Herder, Jens ED - Braz, José T1 - Multimodal interaction techniques in scientific data visualization: An analytical survey T2 - In Proceedings of the 10th International Conference on Computer Graphics Theory and Applications (GRAPP-2015) N2 - The interpretation process of complex data sets makes the integration of effective interaction techniques crucial. Recent work in the field of human-computer interaction has shown that there is strong evidence that multimodal user interaction, i.e. the integration of various input modalities and interaction techniques into one comprehensive user interface, can improve human performance when interacting with complex data sets. However, it is still unclear which factors make these user interfaces superior to unimodal user interfaces. The contribution of this work is an analytical comparison of a multimodal and a unimodal user interface for a scientific visualization application. We show that multimodal user interaction with simultaneously integrated speech and gesture input improves user performance regarding efficiency and ease of use. KW - Interaction KW - Mulitmodal KW - Interaction Techniques KW - 3-D Interaction KW - Immersive Environments KW - VSVR Y1 - 2015 SN - 978-989-758-087-1 U6 - https://doi.org/10.5220/0005296404310437 SP - 431 EP - 437 PB - SCITEPRESS CY - s. l. ER - TY - CHAP A1 - Flasko, Matthias A1 - Pogscheba, Patrick A1 - Herder, Jens A1 - Vonolfen, Wolfgang T1 - Heterogeneous binocular camera-tracking in a Virtual Studio T2 - 8. Workshop Virtuelle und Erweiterte Realität der GI-Fachgruppe VR/AR N2 - This paper presents a tracking of parts of a human body in a virtual TV studio environment. The tracking is based on a depth camera and a HD studio camera and aims at a realistic interaction between the actor and the computer generated environment. Stereo calibration methods are used to match corresponding pixels of both cameras (HD color and depth image). Hence the images were rectified and column aligned. The disparity is used to correct the depth image pixel by pixel. This image registration results in row and column aligned images where ghost regions are in the depth image resulting from occlusion. Both images are used to generate foreground masks with chroma and depth keying. The color image is taken for skin color segmentation to determine and distinguish the actor’s hands and face. In the depth image the flesh colored regions were used to determine their spatial position. The extracted positions were augmented by virtual objects. The scene is rendered correctly with virtual camera parameters which were calculated from the camera calibration parameters. Generated computer graphics with alpha value are combined with the HD color images. This compositing shows interaction with augmented objects for verification. The additional depth information results in changing the size of objects next to the hands when the actor moves around. KW - virtual studio KW - camera-tracking KW - VSVR Y1 - 2011 CY - Wedel ER -