TY - CHAP A1 - Daemen, Jeff A1 - Herder, Jens A1 - Koch, Cornelius A1 - Ladwig, Philipp A1 - Wiche, Roman A1 - Wilgen, Kai T1 - Semi-Automatic Camera and Switcher Control for Live Broadcast T2 - TVX '16 Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video, Chicago, Illinois, USA — June 22 - 24, 2016 N2 - Live video broadcasting requires a multitude of professional expertise to enable multi-camera productions. Robotic systems allow the automation of common and repeated tracking shots. However, predefined camera shots do not allow quick adjustments when required due to unpredictable events. We introduce a modular automated robotic camera control and video switch system, based on fundamental cinematographic rules. The actors' positions are provided by a markerless tracking system. In addition, sound levels of actors' lavalier microphones are used to analyse the current scene. An expert system determines appropriate camera angles and decides when to switch from one camera to another. A test production was conducted to observe the developed prototype in a live broadcast scenario and served as a video-demonstration for an evaluation. KW - automated robotic camera system KW - actor tracking KW - switcher control KW - scene analysis KW - film rules KW - automated shot control KW - Virtual (TV) Studio Y1 - 2016 UR - http://vsvr.medien.hs-duesseldorf.de/publications/tvx2016-rob-abstract.html SN - 978-1-4503-4067-0 U6 - https://doi.org/10.1145/2932206.2933559 SP - 129 EP - 134 PB - ACM CY - New York ER - TY - CHAP A1 - Davin, Till A1 - Herder, Jens ED - Weier, Martin ED - Bues, Matthias ED - Wechner, Reto T1 - Real-Time Relighting of Video Streams for Augmented Virtuality Scenes T2 - GI VR / AR Workshop. Gesellschaft für Informatik e.V. KW - Virtual (TV) Studio Y1 - 2021 U6 - https://doi.org/10.18420/vrar2021_6 PB - Gesellschaft für Informatik e.V. (GI) CY - Bonn ER - TY - CHAP A1 - Wöldecke, Björn A1 - Marinos, Dionysios A1 - Pogscheba, Patrick A1 - Geiger, Christian A1 - Herder, Jens A1 - Schwirten, Tobias T1 - radarTHEREMIN - Creating Musical Expressions in a Virtual Studio Environment T2 - 2011 IEEE International Symposium on VR Innovation N2 - In this paper we describe a prototypical system for live musical performance in a virtual studio environment. The performer stands in front of the studio camera and interacts with an infrared-laser-based multi-touch device. The final TV image shows the performer interacting with a virtual screen which is augmented in front of herself. To overcome the problem of the performer not seeing this virtual screen in reality, we use a special hexagonal grid to facilitate the performer's awareness of this novel Theremin-like virtual musical instrument. KW - multi-point interfaces KW - musical expression KW - virtual studio KW - VSVR KW - Virtual (TV) Studio Y1 - 2011 UR - https://ieeexplore.ieee.org/document/5759671 SN - 978-1-4577-0055-2 U6 - https://doi.org/10.1109/ISVRI.2011.5759671 SP - 345 EP - 346 PB - IEEE CY - Singapore ER - TY - CHAP A1 - Martens, William L. A1 - Herder, Jens T1 - Perceptual criteria for eliminating reflectors and occluders from the rendering of environmental sound T2 - 137th Regular Meeting of the Acoustical Society of America and the 2nd Convention of the European Acoustics Association N2 - Given limited computational resources available for the rendering of spatial sound imagery, we seek to determine effective means for choosing whatcomponents of the rendering will provide the most audible differences in the results. Rather than begin with an analytic approach that attempts to predict audible differences on the basis of objective parameters, we chose to begin with subjective tests of how audibly different the rendering result may be heard to be when that result includes two types of sound obstruction: reflectors and occluders. Single-channel recordings of 90 short speech sounds were made in an anechoic chamber in the presence and absence of these two types of obstructions, and as the angle of those obstructions varied over a 90 degree range. These recordings were reproduced over a single loudspeaker in that anechoic chamber, and listeners were asked to rate how confident they were that the recording of each of these 90 stimuli included an obstruction. These confidence ratings can be used as an integral component in the evaluation function used to determine which reflectors and occluders are most important for rendering. KW - audio rendering KW - first-order reflection KW - human perception KW - level of detail KW - occluder KW - sound spatialization resource management Y1 - 1999 PB - Acoustical Society of America, European Acoustics Association CY - Berlin ER - TY - CHAP A1 - Cohen, Michael A1 - Herder, Jens A1 - Martens, William T1 - Panel: Eartop computing and cyberspatial audio technology T2 - IEEE-VR2001: IEEE Virtual Reality KW - VSVR Y1 - 2001 SN - 0-7695-0948-7 SP - 322 EP - 323 PB - IEEE CY - Yokohama ER - TY - CHAP A1 - Herder, Jens T1 - Optimization of Sound Spatialization Resource Management through Clustering T2 - Second International Conference on Human and Computer N2 - Level-of-detail is a concept well-known in computer graphics to reduce the number of rendered polygons. Depending on the distance to the subject (viewer), the objects’ representation is changed. A similar concept is the clustering of sound sources for sound spatialization. Clusters can be used to hierarchically organize mixels and to optimize the use of resources, by grouping multiple sources together into a single representative ource. Such a clustering process should minimize the error of position allocation of elements, perceived as angle and distance, and also differences between velocity relative to the sink (i.e., Doppler shift). Objects with similar direction of motion and speed (relative to sink) in the same acoustic resolution cone and with similar distance to a sink can be grouped together. KW - audio rendering KW - clustering, and human perception KW - Resource Management KW - Sound Spatialization Y1 - 1999 SP - 1 EP - 7 CY - Aizu-Wakamatsu ER - TY - JOUR A1 - Jens Herder, T1 - Optimization of Sound Spatialization Resource Management through Clustering JF - Journal of the 3D-Forum Society N2 - Level-of-detail is a concept well-known in computer graphics to reduce the number of rendered polygons. Depending on the distance to the subject (viewer), the objects’ representation is changed. A similar concept is the clustering of sound sources for sound spatialization. Clusters can be used to hierarchically organize mixelsand to optimize the use of resources, by grouping multiple sources together into a single representative source. Such a clustering process should minimize the error of position allocation of elements, perceived as angle and distance, and also differences between velocity relative to the sink (i.e., Doppler shift). Objects with similar direction of motion and speed (relative to sink) in the same acoustic resolution cone and with similar distance to a sink can be grouped together. KW - audio rendering KW - clustering, and human perception KW - Resource Management KW - Sound Spatialization KW - VSVR Y1 - 1999 VL - 13 IS - 3 SP - 59 EP - 65 ER - TY - CHAP A1 - Fiedler, Jannik A1 - Rilling, Stefan A1 - Bogen, Manfred A1 - Herder, Jens ED - Braz, José T1 - Multimodal interaction techniques in scientific data visualization: An analytical survey T2 - In Proceedings of the 10th International Conference on Computer Graphics Theory and Applications (GRAPP-2015) N2 - The interpretation process of complex data sets makes the integration of effective interaction techniques crucial. Recent work in the field of human-computer interaction has shown that there is strong evidence that multimodal user interaction, i.e. the integration of various input modalities and interaction techniques into one comprehensive user interface, can improve human performance when interacting with complex data sets. However, it is still unclear which factors make these user interfaces superior to unimodal user interfaces. The contribution of this work is an analytical comparison of a multimodal and a unimodal user interface for a scientific visualization application. We show that multimodal user interaction with simultaneously integrated speech and gesture input improves user performance regarding efficiency and ease of use. KW - Interaction KW - Mulitmodal KW - Interaction Techniques KW - 3-D Interaction KW - Immersive Environments KW - VSVR Y1 - 2015 SN - 978-989-758-087-1 U6 - https://doi.org/10.5220/0005296404310437 SP - 431 EP - 437 PB - SCITEPRESS CY - s. l. ER - TY - CHAP A1 - Herder, Jens A1 - Ladwig, Philipp A1 - Vermeegen, Kai A1 - Hergert, Dennis A1 - Busch, Florian A1 - Klever, Kevin A1 - Holthausen, Sebastian A1 - Ryskeldiev, Bektur T1 - Mixed Reality Experience - How to Use a Virtual (TV) Studio for Demonstration of Virtual Reality Applications T2 - GRAPP 2018 - 13th International Conference on Computer Graphics Theory and Applications N2 - The article discusses the question of “How to convey the experience in a virtual environment to third parties?” and explains the different technical implementations which can be used for live streaming and recording of a mixed reality experience. The real-world applications of our approach include education, entertainment, e- sports, tutorials, and cinematic trailers, which can benefit from our research by finding a suitable solution for their needs. We explain and outline our Mixed Reality systems as well as discuss the experience of recorded demonstrations of different VR applications, including the need for calibrated camera lens parameters based on realtime encoder values. KW - Virtual Reality KW - Mixed Reality KW - Augmented Virtuality KW - Virtual (TV) Studio KW - Camera Tracking KW - Lehre Y1 - 2018 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:hbz:due62-opus-15823 UR - http://vsvr.medien.hs-duesseldorf.de/publications/grapp2018-mr-openvr-abstract.html SN - 978-989-758-287-5 N1 - Zweitveröffentlichung - Originalpublikation liegt auf: http://www.scitepress.org/DigitalLibrary SP - 281 EP - 287 PB - INSTICC CY - Setubal - Portugal ER - TY - CHAP A1 - Herder, Jens A1 - Takeda, Shinpei A1 - Vermeegen, Kai A1 - Davin, Till A1 - Berners, Dominique A1 - Ryskeldiev, Bektur A1 - Zimmer, Christian A1 - Druzetic, Ivana A1 - Geiger, Christian T1 - Mixed Reality Art Experiments - Immersive Access to Collective Memories T2 - ISEA2019, Proceedings, 25th International Symposium on Electronic Art, Gwangju, South Korea, June 22-28, 2019 N2 - We report about several experiments on applying mixed reality technology in the context of accessing collective memories from atomic bombs, Holocaust and Second World War. We discuss the impact of Virtual Reality, Augmented Virtuality and Augmented Reality for specific memorial locations. We show how to use a virtual studio for demonstrating an augmented reality application for a specific location in a remote session within a video conference. Augmented Virtuality is used to recreate the local environment, thus providing a context and helping the participants recollect emotions related to a certain place. This technique demonstrates the advantages of using virtual (VR) and augmented (AR) reality environments for rapid prototyping and pitching project ideas in a live remote setting. KW - Mixed Reality KW - Augmented Reality KW - Augmented Virtuality KW - Rapid Prototyping KW - Video Conferencing Y1 - 2019 UR - http://www.isea-archives.org/docs/2019/ISEA2019_Proceedings.pdf SP - 334 EP - 341 PB - IESA CY - Gwangju ER - TY - CHAP A1 - Herder, Jens T1 - Matching Light for Virtual Studio TV Productions T2 - 9th International Conference on Human and Computer N2 - High dynamic range environments maps based on still images or video streams are used for computer animation or interactive systems. The task of realistic light setup of scenes using captured environment maps might be eased as well as the visual quality improves. In this article, we discuss the light setting problem for virtual studio (tv) layout and system become more complex to handle this new feature of studio light capturing. The analysis of system requirements identifies the technical challenges. KW - VSVR KW - Animation KW - Virtual (TV) Studio Y1 - 2006 SP - 158 EP - 162 CY - Aizu-Wakamatsu ER - TY - CHAP A1 - Daemen, Jeff A1 - Haufs-Brusberg, Peter A1 - Herder, Jens T1 - Markerless Actor Tracking for Virtual (TV) Studio Applications T2 - 2013 International Joint Conference on Awareness Science and Technology & Ubi-Media Computing (iCAST 2013 & UMEDIA 2013) N2 - Virtual (tv) studios gain much more acceptance through improvements in computer graphics and camera tracking. Still commercial studios cannot have full interaction between actors and virtual scene because actors data are not completely digital available as well as the feedback for actors is still not sufficient. Markerless full body tracking might revolutionize virtual studio technology as it allows better interaction between real and virtual world. This article reports about using a markerless actor tracking in a virtual studio with a tracking volume of nearly 40 cubic meter enabling up to three actors within the green box. The tracking is used for resolving the occlusion between virtual objects and actors so that the Tenderer can output automatically a mask for virtual objects in the foreground in case the actor is behind. It is also used for triggering functions scripted within the Tenderer engine, which are attached to virtual objects, starting any kind of action (e.g., animation). Last but not least the system is used for controlling avatars within the virtual set. All tracking and rendering is done within a studio frame rate of 50 Hz with about 3 frames delay. The markerless actor tracking within virtual studios is evaluated by experts using an interview approach. The statistical evaluation is based on a questionnaire. KW - Cameras KW - Tracking KW - TV KW - Skeleton KW - Engines KW - Delays KW - Production KW - VSVR KW - Virtual (TV) Studio Y1 - 2013 UR - https://ieeexplore.ieee.org/document/6765544 SN - 978-1-4799-2364-9 U6 - https://doi.org/10.1109/ICAwST.2013.6765544 SP - 790 EP - 795 PB - IEEE CY - Aizu-Wakamatsu ER - TY - JOUR A1 - Juttner, Carsten A1 - Herder, Jens T1 - Lighting an Interactive Scene in Real-time with a GPU and Video Textures JF - Journal of the 3D-Forum Society N2 - The presentation of virtual environments in real time has always been a demanding task. Specially designed graphics hardware is necessary to deal with the large amounts of data these applications typically produce. For several years the chipsets that were used allowed only simple lighting models and fixed algorithms. But recent development has produced new graphics processing units (GPUs) that are much faster and more programmable than their predecessors. This paper presents an approach to take advantage of these new features. It uses a video texture as part of the lighting calculations for the passenger compartment of a virtual train and was run on the GPU of a recent PC graphics card. The task was to map the varying illumination of a filmed landscape onto the virtual objects and also onto another video texture (showing two passengers), thereby enhancing the realism of the scene. KW - graphics processing unit KW - shader programming KW - video textures KW - virtual prototyping KW - FHD KW - VSVR Y1 - 2006 VL - 20 IS - 1 SP - 22 EP - 28 ER - TY - CHAP A1 - Marinos, Dionysios A1 - Geiger, Christian A1 - Herder, Jens T1 - Large-Area Moderator Tracking and Demonstrational Configuration of Position Based Interactions for Virtual Studio T2 - EuroITV '12 Proceedings of the 10th European Conference on Interactive TV and Video N2 - In this paper we introduce a system for tracking persons walking or standing on a large planar surface and for using the acquired data to easily configure position based interactions for virtual studio productions. The tracking component of the system, radarTRACK, is based on a laser scanner device capable of delivering interaction points on a large configurable plane. By using the device on the floor it is possible to use the delivered data to detect feet positions and derive the position and orientation of one or more users in real time. The second component of the system, named OscCalibrator, allows for the easy creation of multidimensional linear mappings between input and output parameters and the routing of OSC messages within a single modular design environment. We demonstrate the use of our system to flexibly create position-based interactions in a virtual studio environment. KW - body tracking KW - OSC mapping KW - virtual studio interaction KW - measurement KW - design KW - reliability KW - experimentation KW - human factors KW - VSVR KW - Virtual (TV) Studio Y1 - 2012 UR - https://dl.acm.org/citation.cfm?id=2325639 SN - 978-1-4503-1107-6 U6 - https://doi.org/10.1145/2325616.2325639 SP - 105 EP - 114 PB - ACM CY - New York ER - TY - GEN A1 - Herder, Jens T1 - Konzeption, Implementierung und Integration einer Komponente zur inkrementellen Bezeichner- und Operatoranalyse innerhalb des PSGs N2 - Der Programmier System Generator - PSG - des Fachgebiets Praktische Informatik in Darmstadt erzeugt aus einer Sprachdefinition eine sprachspezifische Programmierumgebung. Diese besteht u. a. aus einem Editor, welcher syntaktische und semantische Fehler von Programmfragmenten, die nicht vollständig sein müssen, erkennen kann. Dem Benutzer werden per Menü Fehlerkorrekturen angeboten. Neben der freien Texteingabe besteht die Möglichkeit, den Text nur mit Hilfe von Menüs zu verfeinern. Teil dieses Editors ist die Bezeichneranalyse. Sie dient als Hilfsmittel für den Benutzer, indem für jede Stelle eines Programmfragmentes die gültigen Bezeichner ausgegeben werden können. Die Kontextanalyse setzt die Berechnung auf den von der Bezeichneranalyse erzeugten Daten auf, um semantische Fehler zu erkennen. Die bis zu dieser Arbeit verwendete Bezeichneranalyse im PSG unterstützt nur einfache Sprachkonzepte (z. B. Fortran und Pascal). Die Gültigkeitskonzepte der Bezeichner von weiterentwickelten Sprachen (z. B. Modula-2, CHILL, Ada oder Pascal-XT) sind nicht vollständig modellierbar. Wir stellen ein neues Konzept zur Definition und Berechnung der Bezeichneranalyse vor, das alle uns bekannten Sprachen mit statischer Typbindung unterstützt. Hierfür haben wir die Sprache BIS - Bezeichneridentifikationssprache - definiert. Die Methode ist verwandt mid dem Zwischencode für geordnete Attributierte Grammatiken. Für jeden Knoten des Abstrakten Syntaxbaumes wird mit Hilfe von BIS ein Code für eine abstrakte Maschine, welche die Bezeichneranalyse durchführt, geschrieben. Im Gegensatz zu herkömlichen Methoden (verkettete Symboltabellen) wird für jeden Punkt innerhalb eines Programmes for der Anfrage durch den Benutzer oder der Kontextanalyse die Menge der gültigen Bezeichner berechnet. Die Kosten für eine Anfrage sind dadurch minimal. Diese abstrakte Maschine teilt sich in zwei unabhängige Maschinen auf, zum einen in die S-Maschine, die die speziellen Operationen der Bezeichneranalyse durchführt, und zum anderen in die G-Maschine, die den Datenfluss und die Auswertung steuert. Diese Aufteilung ermöglicht den Austausch der S-Maschine durch eine andere, welche neue Anwendungsgebiete erschliesst, z. B. die eines Praeprozessors. Die G-Maschine arbeitet inkrementell; es werden nur die Codeschablonen neu ausgewertet, deren geerbten Attribute sich geändert haben. Dazu müssen die Daten, die in einer Codeschablone hinein- und hinausfliessen, abgelegt werden. Dies ergibt bei grossen Programmfragmenten eine immense Rechenzeiteinsparung auf Kosten des Speicherplatzes. Die Funktionsweise wird an einer kleinen Beispielsprache demonstriert, die zu Pascal ähnlich ist. Diese besitzt Konstrukte zum Import und Export von Daten und Datentypen zwischen Programmfragmenten. Im Prototyp kann die inkrementelle Arbeitsweise abgeschaltet werden und ermöglicht einen guten Vergleich der Verfahren. T2 - Specification, Implementation and Integration of a Module for Incremental Identifier and Operator Analysis in the PSG (Programming System Generator) KW - Februar Y1 - 1992 CY - Darmstadt ER - TY - CHAP A1 - Herder, Jens A1 - Kronenwett, Ralf A1 - Lambertz, Simone A1 - Kiefer, Georg A1 - Freihoff, Johann ED - Heinecke, A. M. ED - Paul, H. T1 - Interaktive Echtzeit-3D-Visualisierung Webbasierte Darstellung: Mobilisierung und Homing von Blutstammzellen T2 - Mensch and Computer 2006: Mensch und Computer im Struktur Wandel N2 - Die interaktive Echtzeit 3D-Visualisierung Mobilisierung und Homing von Blutstammzellen wurde konzipiert, um ein sehr komplexes medizinisches Wissen mit den Mitteln der 3-dimensionalen Visualisierung in Echtzeit und des Internets sowie der daraus resultierenden Interaktivität aufzubereiten. Dies musste auf einer Ebene geschehen, die es hinterher auch jedem Nicht-Mediziner erlaubt, die grundlegenden biologischen und medizinischen Sachverhalte nachzuvollziehen. Das Resultat: Eine informative und didaktische Anwendung, aus einer Mischung von interaktiven 3D-Stationen und erklärenden 3D-Animationen. Diskutiert werden die Methodik der Konzeptionsphase und die Interaktionstechniken. KW - Interaktionsmodellierung KW - Visualisierung KW - Immersion KW - Visualisierung KW - eLearning KW - Blutstammzellen KW - Lehre KW - VSVR KW - Virtual Reality Y1 - 2006 SP - 405 EP - 409 PB - Oldenbourg Verlag CY - München ER - TY - CHAP A1 - Herder, Jens A1 - Vonolfen, Wolfgang A1 - Griesert, Arnfried A1 - Heuer, Stefan A1 - Hoffmann, Ansgar A1 - Höppner, Bernd T1 - Interactive Virtual Set Applications for Post Production T2 - University of Aizu 2004 – Seventh International Conference on Human N2 - Virtual set environments for broadcasting become more sophisticated as well as the visual quality improves. Realtime interaction and production-specific visualization implemented through plugin mechanism enhance the existing systems like the 3DK. This work presents the integration of the Intersense IS-900 SCT camera tracking and 3D interaction into the 3DK virtual studio environment. The main goal of this work is the design of a virtual studio environment for post productions, which includes video output as well as media streaming formats such as MPEG-4. The systems allows high quality offline rendering during post production and 3D interaction by the moderator during the recording. KW - interaction KW - tracking KW - virtual set environments KW - Virtual (TV) Studio KW - post production KW - MPEG-4 KW - FHD KW - VSVR Y1 - 2004 CY - Aizu-Wakamatsu ER - TY - GEN A1 - Herder, Jens T1 - Interactive Sound Spatialization - a Primer T2 - MM News, University of Aizu Multimedia Center N2 - Sound spatialization is a technology which puts sound into the three dimensional space, so that it has a perceivable direction and distance. Interactive means mutually or reciprocally active. Interaction is when one action (e.g., user moves mouse) has direct or immediate influence to other actions (e.g., processing by a computer: graphics change in size). Based on this definition an introduction to sound reproduction using DVD and virtual environments is given and illustrated by applications (e.g., virtual converts). KW - DVD KW - Interactivity KW - Resource Management KW - Sound Spatialization KW - Virtual Concerts KW - VSVR Y1 - 2000 UR - http://vsvr.medien.hs-duesseldorf.de/publications/mmnews2000-8.pdf VL - 8 SP - 8 EP - 12 ER - TY - JOUR A1 - Griesert, Arnfried A1 - Walczak, Oliver A1 - Herder, Jens T1 - Interactive Realtime Terrain Visualization for Virtual Set Applications JF - Journal of the 3D-Forum Society N2 - Virtual set environments for broadcasting become more sophisticated as well as the visual quality improves. Realtime interaction and production-specific visualization implemented through plugin mechanism enhance the existing systems like the virtual studio software 3DK. This work presents an algorithm which can dynamically manage textures of high resolution by prefetching them depending on their requirement in memory and map them on a procedural mesh in realtime. The main goal application of this work is the virtual representation of a flight over a landscape as part of weather reports in virtual studios and the interaction by the moderator. KW - 3D KW - VSVR KW - Virtual (TV) Studio Y1 - 2003 VL - 17 IS - 4 SP - 20 EP - 26 ER - TY - CHAP A1 - Herder, Jens T1 - Interactive Content Creation with Virtual Set Environments T2 - Fourth International Conference on Human and Computer N2 - Digital broadcasting enables interactive \sc tv, which presents new challenges for interactive content creation. Besides the technology for streaming and viewing, tools and systems are under development that extend traditional \sc tv studios with virtual set environments. This presentation reviews current technology and describes the requirements for such systems. Interoperability over the production, streaming, and viewer levels requires open interfaces. As the technology allow more interaction, it becomes inherent difficult to control the quality of the viewers experience KW - VSVR KW - digital broadcasting Y1 - 2001 PB - University of Aizu CY - Aizu-Wakamatsu ER - TY - JOUR A1 - Herder, Jens T1 - Interactive Content Creation with Virtual Set Environments JF - Journal of the 3D-Forum Society N2 - Digital broadcasting enables interactive \sc tv studios with virtual set environments. This presentation reviews current technology and describes the requirements for such systems. Interoperability over the production, streaming, and viewer levels requires open interfaces. As the technology allow more interaction, it becomes inherent difficult to control the quality of the viewers experience. KW - Interactive Media KW - Sound Spatialization KW - Virtual Sets KW - virtual studio KW - VSVR Y1 - 2001 VL - 15 IS - 4 SP - 53 EP - 56 ER - TY - CHAP A1 - Schmitt, Lothar M. A1 - Herder, Jens A1 - Bhalla, Subhash ED - Gorayska, Barbara ED - Nehaniv, Chrystopher L. ED - Marsh, Jonathon P. T1 - Information Retrieval and Database Architecture for Conventional Japanese Character Dictionaries T2 - Proceedings, Second International Conference on Cognitive Technology N2 - The cycle of abstraction-reconstruction which occurs as a fundamental principle in the development of culture and in cognitive processes is described and analyzed. This approach leads to recognition of boundary conditions for and directions of probable development of cognitive tools. It is shown how the transition from a conventional Japanese-English character dictionary to a multi-dimensional language database is an instance of such an abstraction-reconstruction cycle. The different phases of the design of a multi-dimensional language database based upon different computer software technologies are properly placed in this cycle. The methods used include the use of UNIX software tools, classical database methods as-well-as the use of search engines based upon full text search in this process. Several directions of application and extension for a multi-dimensional language database are discussed from the general point of view of an abstraction-reconstruction cycle. KW - abstraction-reconstruction cycle KW - database KW - dictionary KW - hypertext, search engine KW - retrieval methods KW - UNIX Y1 - 1997 SN - 0-8186-8084-9 SP - 200 EP - 217 PB - IEEE CY - Los Alamitos ER - TY - CHAP A1 - Ludwig, Philipp A1 - Büchel, Joachim A1 - Herder, Jens A1 - Vonolfen, Wolfgang T1 - InEarGuide - A Navigation and Interaction Feedback System using In Ear Headphones for Virtual TV Studio Productions T2 - 9. Workshop Virtuelle und Erweiterte Realität der GI-Fachgruppe VR/AR N2 - This paper presents an approach to integrate non-visual user feedback in today's virtual tv studio productions. Since recent studies showed that systems providing vibro-tactile feedback are not sufficient for replacing the common visual feedback, we developed an audio-based solution using an in ear headphone system, enabling a talent to move, avoid and point to virtual objects in a blue or green box. The system consists of an optical head tracking system, a wireless in ear monitor system and a workstation, which performs all application and audio processing. Using head related transfer functions, the talent gets directional and distance cues. Past research showed, that generating reflections of the sounds and simulating the acoustics of the virtual room helps the listener to conceive the acoustical feedback, we included this technique as well. In a user study with 15 participants the performance of the system was evaluated. KW - Navigation KW - virtual TV KW - erweiterte Realität KW - VSVR KW - Virtual (TV) Studio Y1 - 2012 CY - Düsseldorf ER - TY - CHAP A1 - Vierjahn, Tom A1 - Wöldecke, Björn A1 - Geiger, Christian A1 - Herder, Jens T1 - Improved Direction Signalization Technique Employing Vibrotactile Feedback T2 - 11th Virtual Reality International Conference, VRIC'2009 N2 - Vibrotactile feedback via body-worn vibrating belts is a common means of direction signalization - e.g. for navigational tasks. Consequently such feedback devices are used to guide blind or visually impaired people but can also be used to support other wayfinding tasks - for instance, guiding actors in virtual studio productions. Recent effort has been made to simplify this task by integrating vibrotactile feedback into virtual studio applications. In this work we evaluate the accuracy of an improved direction signalization technique, utilizing a body-worn vibrotactile belt with a limited number of tactors, and compare it to other work. The results from our user study indicate that it is possible to signalize different directions accurately, even with a small number of tactors spaced by 90°. KW - tactile feedback KW - direction signalization KW - wayfinding KW - human factors KW - FHD KW - VSVR Y1 - 2009 SN - 2-9515730-8-1 SP - 1 EP - 8 ER - TY - CHAP A1 - Suzuki, Kenji A1 - Nishoji, Yuji A1 - Herder, Jens T1 - Implementation of Aural Attributes for Simulation of Room Effects in Virtual Environments T2 - ACM Multimedia 2000 N2 - The audio design for virtual environments includes simulation of acoustical room properties besides specifing sound sources and sinks and their behavior. Virtual environments supporting room reverberation not only gain realism but also provide additional information to the user about surrounding space. Catching the different sound properties by the different spaces requires partitioning the space by the properties of aural spaces. We define soundscape and aural attributes as an application and multimedia content interface. Calculated data on an abstract level is sent to spatialization backends. Part of this research was the implementation of a device driver for the Roland Sound Space Processor. This device not only directionalizes sound sources, but also controls room effects like reverberation. KW - Acoustic displays KW - Aural attributes KW - Room effects KW - Virtual environments KW - VSVR Y1 - 2000 SP - 439 EP - 441 PB - ACM CY - Los Angeles ER - TY - CHAP A1 - Flasko, Matthias A1 - Pogscheba, Patrick A1 - Herder, Jens A1 - Vonolfen, Wolfgang T1 - Heterogeneous binocular camera-tracking in a Virtual Studio T2 - 8. Workshop Virtuelle und Erweiterte Realität der GI-Fachgruppe VR/AR N2 - This paper presents a tracking of parts of a human body in a virtual TV studio environment. The tracking is based on a depth camera and a HD studio camera and aims at a realistic interaction between the actor and the computer generated environment. Stereo calibration methods are used to match corresponding pixels of both cameras (HD color and depth image). Hence the images were rectified and column aligned. The disparity is used to correct the depth image pixel by pixel. This image registration results in row and column aligned images where ghost regions are in the depth image resulting from occlusion. Both images are used to generate foreground masks with chroma and depth keying. The color image is taken for skin color segmentation to determine and distinguish the actor’s hands and face. In the depth image the flesh colored regions were used to determine their spatial position. The extracted positions were augmented by virtual objects. The scene is rendered correctly with virtual camera parameters which were calculated from the camera calibration parameters. Generated computer graphics with alpha value are combined with the HD color images. This compositing shows interaction with augmented objects for verification. The additional depth information results in changing the size of objects next to the hands when the actor moves around. KW - virtual studio KW - camera-tracking KW - VSVR Y1 - 2011 CY - Wedel ER - TY - CHAP A1 - Herder, Jens A1 - Neider, Christian A1 - Kinuwaki, Shinichi T1 - HDR-based lighting estimation for virtual studio (TV) environments T2 - 10th International Conference on Human and Computer N2 - Two high dynamic range HDR environments maps based on video streams from fish-eye lens cameras are used for generating virtual lights in a virtual set renderer. The task of realistic virtual light setup of scenes using captured environment maps might be eased as well as visual quality improves. We discuss the light setting problem for virtual studio tv productions which have mixed scenes of real objects, actors, virtual objects and virtual backgrounds. Benefits of hdr interactive light control are that the real light in the studio does not have to be remodeled and the artistic impression by using the light in the studio is also captured. An analysis of system requirements identifies technical challenges. We discuss the properties of a prototype system including test production. KW - HDR environment maps KW - light interaction KW - tracking KW - virtual set environments KW - Virtual (TV) Studio KW - video processing KW - FHD KW - VSVR Y1 - 2007 SP - 111 EP - 117 CY - Düsseldorf, Aizu-Wakamatsu ER - TY - CHAP A1 - Herder, Jens A1 - Jaensch, Kai A1 - Garbe, Katharina ED - Gausemeier, Jürgen ED - Grafe, Michael T1 - Haptische Interaktionen in Testumgebungen für Produktpräsentation in Virtuellen Umgebungen T2 - Augmented and Virtual Reality in der Produktentstehung N2 - Durch den vermehrten Einsatz von multimedialen Technologien werden in der Marktforschung die Möglichkeiten der Durchführung flexibler und kostengünstiger Studien gegeben. In sehr frühen Phasen des Innovationsprozesses als Teil der Marktforschung können durch Einsatz von Virtuellen Umgebungen die Markteinführungskonzepte für neue Produkte getestet werden. Mittels Anwendungen der Virtuellen Realität können neue Produkte einschlieï‚lich des Marketingkonzeptes auch haptisch getestet werden, ohne dass dieses Produkt bereits physisch vorhanden sein muss. Informationen werden dem Benutzer in Virtuellen Umgebungen hauptsächlich visuell und ergänzend auditiv übermittelt. Verbreitete Benutzerschnittstellen sind Interaktionsgeräte wie Stylus und Wand. Durch die haptische Wahrnehmung werden Informationen menschengerechter, effektiver und intuitiver wahrgenommen. Objekte in einer virtuellen Umgebung können durch den Einsatz haptischer Interaktionsgeräte ertastet und erfühlt werden und machen dadurch eine differenziertere Beurteilung und Einschätzung durch den Benutzer eben dieser Objekte möglich. Der Fokus des vorliegenden Projektes liegt daher auf der interaktiven haptischen Produktpräsentation in einer virtuellen Einkaufsumgebung, die in Online-Befragungen mit zusätzlichen Werbefilmen eingebettet ist. Als Nebenprodukt wurde das Werkzeug Open Inventor um Knoten zur Modellierung von haptischen Szeneneigenschaften erweitert. KW - Haptik KW - Virtuelle Umgebungen KW - Interaktion KW - Mensch-Maschine-Kommunikation KW - Testumgebung KW - Produkttest KW - FHD KW - VSVR Y1 - 2006 SN - 3-939350-07-9 VL - 188 SP - 87 EP - 99 PB - Heinz Nixdorf Institut, Universität Paderborn CY - Paderborn ER - TY - JOUR A1 - Daemen, Jeff A1 - Herder, Jens A1 - Koch, Cornelius A1 - Ladwig, Philipp A1 - Wiche, Roman A1 - Wilgen, Kai T1 - Halbautomatische Steuerung von Kamera und Bildmischer bei Live-Übertragungen JF - Fachzeitschrift für Fernsehen, Film und Elektronische Medien N2 - Live-Video-Broadcasting mit mehreren Kameras erfordert eine Vielzahl von Fachkenntnissen. Robotersysteme ermöglichen zwar die Automatisierung von gängigen und wiederholten Tracking-Aufnahmen, diese erlauben jedoch keine kurzfristigen Anpassungen aufgrund von unvorhersehbaren Ereignissen. In diesem Beitrag wird ein modulares, automatisiertes Kamerasteuerungs- und Bildschnitt-System eingeführt, das auf grundlegenden kinematografischen Regeln basiert. Die Positionen der Akteure werden durch ein markerloses Tracking-System bereitgestellt. Darüber hinaus werden Tonpegel der Lavaliermikrofone der Akteure zur Analyse der aktuellen Szene verwendet. Ein Expertensystem ermittelt geeignete Kamerawinkel und entscheidet, wann von einer Kamera auf eine andere umgeschaltet werden soll. Eine Testproduktion wurde durchgeführt, um den entwickelten Prototyp in einem Live-Broadcast-Szenario zu beobachten und diente als Videodemonstration für eine Evaluierung. KW - Halbautomatische Roboterkamerasteuerung KW - Verfolgen von Darstellern KW - Bildmischer KW - Szenenanalyse KW - Filmregeln KW - Automatische Bildauswahl KW - Virtual (TV) Studio Y1 - 2017 N1 - Der Artikel ist eine Übersetzung von dem Konferenzbeitrag "Semi-Automatic Camera and Switcher Control for Live Broadcast", International Conference on Interactive Experiences for Television and Online Video, TVX'2016, Chicago, IL, USA, ACM, DOI=10.1145/2932206.2933559, June 22-24, 2016. IS - 11 SP - 501 EP - 505 PB - Schiele & Schön ER - TY - CHAP A1 - Burga, Jose A1 - Daemen, Jeff A1 - Djuderija, Sascha A1 - Gnehr, Maren A1 - Goossens, Lars A1 - Hartz, Sven A1 - Haufs-Brusberg, Peter A1 - Herder, Jens A1 - Ibrahim, Mohammed A1 - Koop, Nikolas A1 - Leske, Christophe A1 - Meyer, Laurid A1 - Müller, Antje A1 - Salgert, Björn A1 - Schroeder, Richard A1 - Thiele, Simon T1 - Four Metamorphosis States in a Distributed Virtual (TV) Studio: Human, Cyborg, Avatar, and Bot T2 - 10th International Conference on Visual Media Production (CVMP 2013), London N2 - The major challenge in virtual studio technology is the interaction between the actor and virtual objects. Within a distributed live production, two locally separated markerless tracking systems where used simultaneously alongside a virtual studio. The production was based on a fully tracked actor, cyborg (half actor, half graphics), avatar, and a bot. All participants could interact and throw a virtual disc. This setup is compared and mapped to Milgram’s continuum and technical challenges are described. KW - TV KW - Distributed Virtual KW - Studio KW - Human KW - Cyborg KW - Avatar KW - Bot KW - VSVR Y1 - 2013 CY - London ER - TY - CHAP A1 - Yamazaki, Yasuhiro A1 - Herder, Jens T1 - Exploring Spatial Audio Conferencing Functionality in Multiuser Virtual Environments T2 - The Third International Conference on Collaborative Virtual Environments N2 - A chatspace was developed that allows conversation with 3D sound using networked streaming in a shared virtual environment. The system provides an interface to advanced audio features, such as a "whisper function" for conveying a confided audio stream. This study explores the use of spatial audio to enhance a user's experience in multiuser virtual environments. KW - chatspaces KW - groupware KW - narrowcasting functions KW - networked audio KW - spatial audio KW - VSVR Y1 - 2000 SP - 207 EP - 208 PB - ACM CY - San Francisco ER - TY - GEN A1 - Jarosch, Monika A1 - Herder, Jens A1 - Langmann, Mathias T1 - Entwicklung einer AR-Applikation zur kosteneffektiven volumetrischen Erfassung von Baugruben T2 - gis.Science N2 - Die volumetrische Erfassung von Aushüben auf Baustellen ist ein kostenrelevanter Faktor und wird auch heute im täglichen Baustellenbetrieb oft noch in manueller Detailarbeit durchgeführt. Kostengünstige Sensoren zur Tiefenerfassung ermöglichen die halbautomatische Erfassung von Baugruben. Augmented Reality (AR) kann für diesen Prozess das nötige Feedback liefern. Vorgestellt wird ein Prototyp, bestehend aus einem Tablet mit integrierter Kamera und einem Lidar-Scanner. Es wird die Erfassung des Volumens bezüglich Nutzbarkeit und Genauigkeit mit Einsatz von AR getestet und evaluiert. Zur Bestimmung des Volumens wird unter Verwendung von Strahlen mit Unterstützung einer Grafik-Engine ein Algorithmus entwickelt. Der Algorithmus ist robust gegen nicht vollständig geschlossene Volumen. Die Bedienung, Überprüfung und Visualisierung findet durch praktischen Einsatz von AR statt. KW - Volumenbestimmung KW - Augmented Reality KW - Baustelle KW - LIDAR KW - VSVR Y1 - 2022 UR - https://gispoint.de/artikelarchiv/gis/2022/gisscience-ausgabe-22022/7427-entwicklung-einer-ar-applikation-zur-kosteneffektiven-volumetrischen-erfassung-von-baugruben.html SN - 2698-4571 N1 - Der Artikel ist als PDF beim Verlag herunterladbar. Dieses wurde nach 3 Monaten freigeschaltet. Vorher war ein Abonnement notwendig. VL - 2022 IS - 2 SP - 75 EP - 83 ER - TY - CHAP A1 - Herder, Jens A1 - Cohen, Michael ED - Gorayska, Barbara ED - Nehaniv, Chrystopher L. ED - Marsh, Jonathon P. T1 - Enhancing Perspicuity of Objects in Virtual Reality Environments T2 - Proceedings, Second International Conference on Cognitive Technology N2 - In an information-rich Virtual Reality (VR) environment, the user is immersed in a world containing many objects providing that information. Given the finite computational resources of any computer system, optimization is required to ensure that the most important information is presented to the user as clearly as possible and in a timely fashion. In particular, what is desired are means whereby the perspicuity of an object may be enhanced when appropriate. An object becomes more perspicuous when the information it provides to the user becomes more readily apparent. Additionally, if a particular object provides high-priority information, it would be advantageous to make that object obtrusive as well as highly perspicuous. An object becomes more obtrusive if it draws attention to itself (or equivalently, if it is hard to ignore). This paper describes a technique whereby objects may dynamically adapt their representation in a user's environment according to a dynamic priority evaluation of the information each object provides. The three components of our approach are: - an information manager that evaluates object information priority, - an enhancement manager that tabulates rendering features associated with increasing object perspicuity and obtrusion as a function of priority, and - a resource manager that assigns available object rendering resources according to features indicated by the enhancement manager for the priority set for each object by the information manager. We consider resources like visual space (pixels), sound spatialization channels (mixels), MIDI/audio channels, and processing power, and discuss our approach applied to different applications. Assigned object rendering features are implemented locally at the object level (e.g., object facing the user using the billboard node in VRML 2.0) or globally, using helper applications (e.g., active spotlights, semi-automatic cameras). KW - autonomous actors KW - obtrusion KW - perspicuity KW - spatial media KW - spatialization KW - user interface design man-machine interfaces KW - Virtual Reality Y1 - 1997 SN - 0-8186-8084-9 SP - 228 EP - 237 PB - IEEE CY - Los Alamitos ER - TY - CHAP A1 - Ryskeldiev, Bektur A1 - Ochiai, Yoichi A1 - Cohen, Michael A1 - Herder, Jens T1 - Distributed Metaverse: Creating Decentralized Blockchain-based Model for Peer-to-peer Sharing of Virtual Spaces for Mixed Reality Applications T2 - Proceedings of the 9th Augmented Human International Conference N2 - Mixed reality telepresence is becoming an increasingly popular form of interaction in social and collaborative applications. We are interested in how created virtual spaces can be archived, mapped, shared, and reused among different applications. Therefore, we propose a decentralized blockchain-based peer-to-peer model of distribution, with virtual spaces represented as blocks. We demonstrate the integration of our system in a collaborative mixed reality application and discuss the benefits and limitations of our approach. KW - Blockchain KW - Groupware KW - Mixed Reality KW - Mobile Computing KW - Photospherical Imagery Y1 - 2018 UR - http://vsvr.medien.hs-duesseldorf.de/publications/ah2018-blockchain-streamspace-abstract.html SN - 978-1-4503-5415-8 U6 - https://doi.org/10.1145/3174910.3174952 SP - 7 EP - 9 PB - ACM ER - TY - JOUR A1 - Honno, Kuniaki A1 - Suzuki, Kenji A1 - Herder, Jens T1 - Distance and Room Effects Control for the PSFC, an Auditory Display using a Loudspeaker Array JF - Journal of the 3D-Forum Society N2 - The Pioneer Sound Field Controller (PSFC), a loudspeaker array system, features realtime configuration of an entire sound field, including sound source direction, virtual distance, and context of simulated environment (room characteristics: room size and liveness) for each of two sound sources. In the PSFC system, there is no native parameter to specify the distance between the sound source and sound sink (listener) and also no function to control it directrly. This paper suggests the method to control virtual distance using basic parameters: volume, room size and liveness. The implementation of distance cue is an important aspect of 3D sounds. Virtual environments supporting room effects like reverberation not only gain realism but also provide additional information to users about surrounding space. The context switch of different aural attributes is done by using an API of the Sound Spatialization Framework. Therefore, when the sound sink move through two rooms, like a small bathroom and a large living room, the context of the sink switches and different sound is obtained. KW - VSVR Y1 - 2000 VL - 14 IS - 4 SP - 146 EP - 151 ER - TY - CHAP A1 - Honno, Kuniaki A1 - Suzuki, Kenji A1 - Herder, Jens T1 - Distance and Room Effects Control for the PSFC, an Auditory Display using a Loudspeaker Array T2 - Third International Conference on Human and Computer N2 - The Pioneer Sound Field Controller (PSFC), a loudspeaker array system, features realtime configuration of an entire sound field,including sound source direction, virtual distance, and context of simulated environment (room characteristics: room size and liveness)for each of two sound sources. In the PSFC system, there is no native parameter to specify the distance between the sound source and sound sink (listener) and also no function to control it directrly. This paper suggests the method to control virtual distance using basic parameters: volume, room size and liveness. The implementation of distance cue is an important aspect of 3D sounds. Virtual environments supporting room effects like reverberation not only gain realism but also provide additional information to users about surrounding space. The context switch of different aural attributes is done by using an API of the Sound Spatialization Framework. Therefore, when the sound sink move through two rooms, like a small bathroom and a large living room, the context of the sink switches and different sound is obtained. KW - VSVR Y1 - 2000 SP - 71 EP - 76 PB - University of Aizu CY - Aizu-Wakamatsu ER - TY - CHAP A1 - Herder, Jens A1 - Geiger, Christian A1 - Lehmann, Anke A1 - Vierjahn, Tom A1 - Wöldecke, Björn ED - Gausemeier, Jürgen ED - Grafe, Michael T1 - Designstrategien für den Einsatz von vibrotaktielem Feedback in Mixed Reality Anwendungen T2 - Augmented & Virtual Reality in der Produktentstehung KW - Mixed Reality KW - Human Computer Interaktion KW - Vibrotaktiles Feedback KW - Haptik Y1 - 2009 SN - 978-3-939350-71-2 VL - 232 SP - 225 EP - 240 PB - Heinz Nixdorf Institut, Universität Paderborn CY - Paderborn ER - TY - CHAP A1 - Geiger, Christian A1 - Herder, Jens A1 - Göbel, Sebastian A1 - Heinze, Christin A1 - Marinos, Dionysios T1 - Design and Virtual Studio Presentation of a Traditional Archery Simulator T2 - Proceedings of the Entertainment Interfaces Track 2010 at Interaktive Kulturen, Duisburg, Germany, September 12-15, 2010 N2 - In this paper we describe the design of a virtual reality simulator for traditional intuitive archery. Traditional archers aim without a target figure. Good shooting results require an excellent body-eye coordination that allows the user to perform identical movements when drawing the bow. Our simulator provides a virtual archery experience and supports the user to learn and practice the motion sequence of traditional archery in a virtual environment. We use an infrared tracking system to capture the user’s movements in order to correct his movement. To provide a realistic haptic feedback a real bow is used as interaction device. Our system provides a believable user experience and supports the user to learn how to shoot in the traditional way. Following a user-centered iterative design approach we developed a number of prototypes and evaluated them for refinement in sequent iteration cycles. For illustration purposes we created a short video clip in our virtual studio about this project that presents the main ideas in an informative yet entertaining way. KW - vr archery KW - 3D interaction KW - interactive sport simulation KW - user experience KW - user-centered design KW - Lehre KW - VSVR KW - Virtual Reality Y1 - 2010 UR - https://dl.gi.de/handle/20.500.12116/7385;jsessionid=149F7CDB1184309727393899BD806939 UR - http://ceur-ws.org/Vol-634/Entertainment-Interfaces-Proceedings03.pdf SP - 37 EP - 44 CY - Duisburg ER - TY - JOUR A1 - Cohen, Michael A1 - Herder, Jens A1 - L. Martens, William T1 - Cyberspatial Audio Technology T1 - available in Japanese as well - Acoustical Society of Japan, Vol. 55, No. 10, pp. 730-731 JF - The Journal of the Acoustical Society of Japan (E) N2 - Cyberspatial audio applications are distinguished from the broad range of spatial audio applications in a number of important ways that help to focus this review. Most significant is that cyberspatial audio is most often designed to be responsive to user inputs. In contrast to non-interactive auditory displays, cyberspatial auditory displays typically allow active exploration of the virtual environment in which users find themselves. Thus, at least some portion of the audio presented in a cyberspatial environment must be selected, processed, or otherwise rendered with minimum delay relative to user input. Besides the technological demands associated with realtime delivery of spatialized sound, the type and quality of auditory experiences supported are also very different from those associated with displays that support stationary sound localization. Y1 - 1999 U6 - https://doi.org/10.1250/ast.20.389 N1 - available in Japanese as well - Acoustical Society of Japan, Vol. 55, No. 10, pp. 730-731 VL - 20 IS - 6 SP - 389 EP - 395 ER - TY - CHAP A1 - Becker, Thomas A1 - Herder, Jens T1 - Cost effective tangibles using fiducials for infrared multi-touch frames T2 - 15th International Conference on Human and Computer N2 - The late immersion of multi-touch sensitive displays enables the use of tangibles on multi-touch screens. There a several wide spread and/or sophisticated solutions to fulfill this need but they seem to have some flaws. One popular system at the time of writing is an overlay frame that can be placed on a normal display with the corresponding size. The frame creates a grid with infrared light emitting diodes. The disruption of this grid can be detected and messages with the positions are sent via usb to a connected computer. This system is quite robust in matters of ambient light insensitivity and also fast to calibrate. Unfortunately it is not created with the recognition of tangibles in mind and printed patterns can not be resolved. This article summarizes an attempt to create fiducials that are recognized by an infrared multi-touch frame as fingers. Those false fingers are checked by a software for known patterns. Once a known pattern (= fiducial) has been recognized its position and orientation are send with the finger positions towards the interactive software. The usability is tested with an example application where tangibles and finger touches are used in combination. KW - low cost multi-touch infrared overlay frame KW - fiducial tangible recognition KW - FHD Y1 - 2012 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:hbz:due62-opus-16011 UR - http://vsvr.medien.hs-duesseldorf.de/publications/hc2012-fiducials-abstract.html N1 - Copyright 2012 University of Aizu Press CY - Hamamatsu/Aizu-Wakamatsu/Duesseldorf ER - TY - CHAP A1 - Herder, Jens T1 - Cooperative Tools for Teaching : an Impact of a Network Environment T2 - Annual Report of the Information Systems and Technology Center, University of Aizu, October 1997 N2 - Education at the University of Aizu is focussed upon computer science. Besides being the subject matter of many courses, however, the computer also plays a vital role in the educational process itself, both in the distribution of instructional media, and in providing students with valuable practical experience. All students have unlimited access (24-hours-a-day) to individual networked workstations, most of which are multimedia-capable (even video capture is possible in two exercise rooms). Without software and content tailored for computer-aided instruction, the hardware becomes an expensive decoration. In any case, there is a need to better educate the instructors and students in the use of the equipment. In the interest of facilitating effective, collaborative use of network-based computers in teaching, this article explores the impact that a network environment can have on such activities. First, as a general overview, and to examine the motivation for the use of a network environment in teaching, this article reviews a range of different styles of collaboration. Then the article shows what kind of tools are available for use, within the context of what has come to be called Computer-Supported Cooperative Work (CSCW). KW - CAI KW - CAT KW - computer education KW - collaborative work KW - CSCW KW - groupware KW - FHD Y1 - 1997 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:hbz:due62-opus-827 SP - 3 EP - 8 CY - Aizu ER - TY - CHAP A1 - Ballester Ripoll, Marina A1 - Herder, Jens A1 - Ladwig, Philipp A1 - Vermeegen, Kai ED - Pfeiffer, Thies ED - Fröhlich, Julia ED - Kruse, Rolf T1 - Comparison of two Gesture Recognition Sensors for Virtual TV Studios T2 - GI-VRAR, Workshop Proceedings / Tagungsband: Virtuelle und Erweiterte Realität – 13. Workshop der GI-Fachgruppe VR/AR, N2 - In order to improve the interactivity between users and computers, recent technologies focus on incorporating gesture recognition into interactive systems. The aim of this article is to evaluate the effectiveness of using a Myo control armband and the Kinect 2 for recognition of gestures in order to interact with virtual objects in a weather report scenario. The Myo armband has an inertial measurement unit and is able to read electrical activity produced by skeletal muscles, which can be recognized as gestures, which are trained by machine learning. A Kinect sensor was used to build up a dataset which contains motion recordings of 8 different gestures and was also build up by a gesture training machine learning algorithm. Both input methods, the Kinect 2 and the Myo armband, were evaluated with the same interaction patterns in a user study, which allows a direct comparison and reveals benefits and limits of each technique. KW - Gesture recognition KW - Interaction KW - Kinect KW - Myo KW - Virtual (TV) Studio KW - Lehre Y1 - 2016 UR - http://vsvr.medien.hs-duesseldorf.de/publications/gi-vrar2016-gesture-abstract.html SN - 978-3-8440-4718-9 PB - Shaker Verlag CY - Herzogenrath ER - TY - CHAP A1 - Herder, Jens T1 - Challenges of Virtual Sets: From Broadcasting to Interactive Media T2 - Seventh International Workshop on Human N2 - Virtual sets have evolved from computer-generated, prerendered 2D backgrounds to realtime, responsive 3D computer graphics and are nowadays standard repertoire of broadcasting divisions. The graphics, which are combined with real video feed becoming moresophisticated, real looking and more responsive. We will look at the recent developments and suggest further developments like integration of spatial audio into the studio production and generating interactive media streams. Educational institutes recognize the demands of the rising media industry and established new courses on media technology like the Duesseldorf University of Applied Sciences. KW - Education KW - Interactive Media KW - Sound Spatialization KW - Virtual Sets KW - Virtual (TV) Studio KW - VSVR Y1 - 2000 SP - 13 EP - 17 PB - University of Aizu CY - Aizu-Wakamatsu ER - TY - CHAP A1 - Deppe, Robert A1 - Nemitz, Oliver A1 - Herder, Jens ED - Herder, Jens ED - Geiger, Christian ED - Dörner, Ralf ED - Grimm, Paul T1 - Augmented reality for supporting manual non-destructive ultrasonic testing of metal pipes and plates T2 - Workshop Proceedings / Tagungsband: Virtuelle und Erweiterte Realität – 15. Workshop der GI-Fachgruppe VR/AR N2 - We describe an application of augmented reality technology for non-destructive testing of products in the metal-industry. The prototype is created with hard- and software, that is usually employed in the gaming industry, and delivers positions for creating ultra- sonic material scans (C-scans). Using a stereo camera in combination with an hmd enables realtime visualisation of the probes path, as well as the setting of virtual markers on the specimen. As a part of the implementation the downhill simplex optimization algorithm is implemented to fit the specimen to a cloud of recorded surface points. The accuracy is statistically tested and evaluated with the result, that the tracking system is accurate up to ca. 1-2 millimeters in well set-up conditions. This paper is of interest not only for research institutes of the metal-industry, but also for any areas of work, in which the enhancement with augmented reality is possible and a precise tracking is necessary. KW - Nondestructive Testing KW - Ultrasonic KW - Augmented Reality KW - Tracking KW - Stereo camera KW - M Y1 - 2018 UR - http://vsvr.medien.hs-duesseldorf.de/publications/gi-vrar2018-ar-in-ndt/ SN - 978-3-8440-6215-1 U6 - https://doi.org/10.2370/9783844062151 SP - 45 EP - 52 PB - Shaker Verlag CY - Herzogenrath ER - TY - JOUR A1 - Kunii, Tosiyasu L. A1 - Herder, Jens A1 - Myszkowski, Karol A1 - Okunev, Oleg A1 - Okuneva, Galina A1 - Ibusuki, Masumi T1 - Articulation Simulation for an Intelligent Dental Care System JF - Displays N2 - CAD/CAM techniques are used increasingly in dentistry for design and fabrication of teeth restorations. An important issue is preserving occlusal contacts of teeth after restoration. Traditional techniques based on the use of casts with mechanical articulators require manual adjustment of occlusal surface, which becomes impractical when hard restoration materials like porcelain are used; they are also time and labor consuming. Most existing computer systems ignore completely such an articulation check, or perform the check at the level of a tooth and its immediate neighbors. We present a new mathematical model and a related user interface for global articulation simulation, developed for the Intelligent Dental Care System project. The aim of the simulation is elimination of the use of mechanical articulators and manual adjustment in the process of designing dental restorations and articulation diagnostic. The mathematical model is based upon differential topological modeling of the jawbs considered as a mechanical system. The user interface exploits metaphors that are familiar to dentists from everyday practice. A new input device designed specifically for use with articulation simulation is proposed. Y1 - 1994 VL - 15 IS - 3 SP - 181 EP - 188 ER - TY - CHAP A1 - Ryskeldiev, Bektur A1 - Cohen, Michael A1 - Herder, Jens T1 - Applying rotational tracking and photospherical imagery to immersive mobile telepresence and live video streaming groupware T2 - Proceeding SA '17 SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications, Article No. 5 N2 - Mobile live video streaming is becoming an increasingly popular form of interaction both in social media and remote collaboration scenarios. However, in most cases the streamed video does not take mobile devices' spatial data into account (e.g., the viewers do not know the spatial orientation of a streamer), or use such data only in specific scenarios (e.g., to navigate around a spherical video stream). KW - spatial media KW - rotational tracking KW - mixed reality KW - live streaming KW - social media KW - telepresence KW - mobile computing KW - groupware KW - photospherical imagery Y1 - 2017 UR - https://dl.acm.org/citation.cfm?doid=3132787.3132813 SN - 978-1-4503-5410-3 U6 - https://doi.org/10.1145/3132787.3132813 PB - ACM CY - New York ER - TY - CHAP A1 - Herder, Jens T1 - Applications of Spatial Auditory Displays in the Context of Art and Music T2 - Human Supervision and Control in Engineering and Music KW - VSVR Y1 - 2001 PB - Universität Kassel CY - Kassel ER - TY - JOUR A1 - Amano, Katsumi A1 - Matsushita, Fumio A1 - Yanagawa, Hirofumi A1 - Cohen, Michael A1 - Herder, Jens A1 - Martens, William A1 - Koba, Yoshiharu A1 - Tohyama, Mikio T1 - A Virtual Reality Sound System Using Room-Related Transfer Functions Delivered Through a Multispeaker Array: the PSFC at the University of Aizu Multimedia Center JF - TVRSJ N2 - The PSFC, or Pioneer Sound Field Controller, is a DSP-driven hemispherical loudspeaker array, installed at the University of Aizu Multimedia Center. The PSFC features realtime manipulation of the primary components of sound spatialization for each of two audio sources located in a virtual environment, including the content (apparent direction and distance) and context (room characteristics: reverberation level, room size and liveness). In an alternate mode, it can also direct the destination of the two separate input signals across 14 loudspeakers, manipulating the direction of the virtual sound sources with no control over apparent distance other than that afforded by source loudness (including no simulated environmental reflections or reverberation). The PSFC speaker dome is about 10 m in diameter, accommodating about fifty simultaneous users, including about twenty users comfortably standing or sitting near its ``sweet spot,'' the area in which the illusions of sound spatialization are most vivid. Collocated with a large screen rear-projection stereographic display, the PSFC is intended for advanced multimedia and virtual reality applications. KW - audio signal processing, audio telecommunications KW - auralization KW - calm technology KW - directional mixing console KW - multichannel sound reproduction KW - room-related transfer functions KW - roomware KW - sound localization KW - virtual conferencing environment Y1 - 1998 U6 - https://doi.org/10.18974/tvrsj.3.1_1 VL - 3 IS - 1 SP - 1 EP - 12 PB - J-STAGE ER - TY - CHAP A1 - Herder, Jens A1 - Myszkowski, Karol A1 - Kunii, Tosiyasu L. A1 - Ibusuki, Masumi ED - Weghorst, Suzanne J. ED - Sieburg, Hans B. ED - Morgan, Karen S. T1 - A Virtual Reality Interface to an Intelligent Dental Care System T2 - Medicine Meets Virtual Reality 4 Y1 - 1996 SP - 17 EP - 20 PB - IOS Press CY - Amsterdam ER - TY - CHAP A1 - Ishikawa, Kimitaka A1 - Hirose, Minefumi A1 - Herder, Jens T1 - A Sound Spatialization Server for a Speaker Array as an Integrated Part of a Virtual Environment T2 - IEEE YUFORIC Germany 98 N2 - Spatial sound plays an important role in virtual reality environments, allowing orientation in space, giving a feeling of space, focusing the user on events in the scene, and substituting missing feedback cues (e.g., force feedback). The sound spatialization framework of the University of Aizu, which supports number of spatialization backends, has been extended to include a sound spatialization server for a multichannel loudspeaker array (Pioneer Sound Field Control System). Our goal is that the spatialization server allows easy integration into virtual environments. Modeling of distance cues, which are essential for full immersion, is discussed. Furthermore, the integration of this prototype into different applications allowed us to reveal the advantages and problems of spatial sound for virtual reality environments. KW - distance cue KW - loudspeaker array KW - psychoacoustic KW - sound spatialization server Y1 - 1998 UR - http://vsvr.medien.hs-duesseldorf.de/publications/ve98-spatial-server/welcome.html PB - IEEE CY - Stuttgart ER -