TY - JOUR A1 - Herder, Jens T1 - Interactive Content Creation with Virtual Set Environments JF - Journal of the 3D-Forum Society N2 - Digital broadcasting enables interactive \sc tv studios with virtual set environments. This presentation reviews current technology and describes the requirements for such systems. Interoperability over the production, streaming, and viewer levels requires open interfaces. As the technology allow more interaction, it becomes inherent difficult to control the quality of the viewers experience. KW - Interactive Media KW - Sound Spatialization KW - Virtual Sets KW - virtual studio KW - VSVR Y1 - 2001 VL - 15 IS - 4 SP - 53 EP - 56 ER - TY - CHAP A1 - Schmitt, Lothar M. A1 - Herder, Jens A1 - Bhalla, Subhash ED - Gorayska, Barbara ED - Nehaniv, Chrystopher L. ED - Marsh, Jonathon P. T1 - Information Retrieval and Database Architecture for Conventional Japanese Character Dictionaries T2 - Proceedings, Second International Conference on Cognitive Technology N2 - The cycle of abstraction-reconstruction which occurs as a fundamental principle in the development of culture and in cognitive processes is described and analyzed. This approach leads to recognition of boundary conditions for and directions of probable development of cognitive tools. It is shown how the transition from a conventional Japanese-English character dictionary to a multi-dimensional language database is an instance of such an abstraction-reconstruction cycle. The different phases of the design of a multi-dimensional language database based upon different computer software technologies are properly placed in this cycle. The methods used include the use of UNIX software tools, classical database methods as-well-as the use of search engines based upon full text search in this process. Several directions of application and extension for a multi-dimensional language database are discussed from the general point of view of an abstraction-reconstruction cycle. KW - abstraction-reconstruction cycle KW - database KW - dictionary KW - hypertext, search engine KW - retrieval methods KW - UNIX Y1 - 1997 SN - 0-8186-8084-9 SP - 200 EP - 217 PB - IEEE CY - Los Alamitos ER - TY - CHAP A1 - Ludwig, Philipp A1 - Büchel, Joachim A1 - Herder, Jens A1 - Vonolfen, Wolfgang T1 - InEarGuide - A Navigation and Interaction Feedback System using In Ear Headphones for Virtual TV Studio Productions T2 - 9. Workshop Virtuelle und Erweiterte Realität der GI-Fachgruppe VR/AR N2 - This paper presents an approach to integrate non-visual user feedback in today's virtual tv studio productions. Since recent studies showed that systems providing vibro-tactile feedback are not sufficient for replacing the common visual feedback, we developed an audio-based solution using an in ear headphone system, enabling a talent to move, avoid and point to virtual objects in a blue or green box. The system consists of an optical head tracking system, a wireless in ear monitor system and a workstation, which performs all application and audio processing. Using head related transfer functions, the talent gets directional and distance cues. Past research showed, that generating reflections of the sounds and simulating the acoustics of the virtual room helps the listener to conceive the acoustical feedback, we included this technique as well. In a user study with 15 participants the performance of the system was evaluated. KW - Navigation KW - virtual TV KW - erweiterte Realität KW - VSVR KW - Virtual (TV) Studio Y1 - 2012 CY - Düsseldorf ER - TY - CHAP A1 - Vierjahn, Tom A1 - Wöldecke, Björn A1 - Geiger, Christian A1 - Herder, Jens T1 - Improved Direction Signalization Technique Employing Vibrotactile Feedback T2 - 11th Virtual Reality International Conference, VRIC'2009 N2 - Vibrotactile feedback via body-worn vibrating belts is a common means of direction signalization - e.g. for navigational tasks. Consequently such feedback devices are used to guide blind or visually impaired people but can also be used to support other wayfinding tasks - for instance, guiding actors in virtual studio productions. Recent effort has been made to simplify this task by integrating vibrotactile feedback into virtual studio applications. In this work we evaluate the accuracy of an improved direction signalization technique, utilizing a body-worn vibrotactile belt with a limited number of tactors, and compare it to other work. The results from our user study indicate that it is possible to signalize different directions accurately, even with a small number of tactors spaced by 90°. KW - tactile feedback KW - direction signalization KW - wayfinding KW - human factors KW - FHD KW - VSVR Y1 - 2009 SN - 2-9515730-8-1 SP - 1 EP - 8 ER - TY - CHAP A1 - Suzuki, Kenji A1 - Nishoji, Yuji A1 - Herder, Jens T1 - Implementation of Aural Attributes for Simulation of Room Effects in Virtual Environments T2 - ACM Multimedia 2000 N2 - The audio design for virtual environments includes simulation of acoustical room properties besides specifing sound sources and sinks and their behavior. Virtual environments supporting room reverberation not only gain realism but also provide additional information to the user about surrounding space. Catching the different sound properties by the different spaces requires partitioning the space by the properties of aural spaces. We define soundscape and aural attributes as an application and multimedia content interface. Calculated data on an abstract level is sent to spatialization backends. Part of this research was the implementation of a device driver for the Roland Sound Space Processor. This device not only directionalizes sound sources, but also controls room effects like reverberation. KW - Acoustic displays KW - Aural attributes KW - Room effects KW - Virtual environments KW - VSVR Y1 - 2000 SP - 439 EP - 441 PB - ACM CY - Los Angeles ER - TY - CHAP A1 - Flasko, Matthias A1 - Pogscheba, Patrick A1 - Herder, Jens A1 - Vonolfen, Wolfgang T1 - Heterogeneous binocular camera-tracking in a Virtual Studio T2 - 8. Workshop Virtuelle und Erweiterte Realität der GI-Fachgruppe VR/AR N2 - This paper presents a tracking of parts of a human body in a virtual TV studio environment. The tracking is based on a depth camera and a HD studio camera and aims at a realistic interaction between the actor and the computer generated environment. Stereo calibration methods are used to match corresponding pixels of both cameras (HD color and depth image). Hence the images were rectified and column aligned. The disparity is used to correct the depth image pixel by pixel. This image registration results in row and column aligned images where ghost regions are in the depth image resulting from occlusion. Both images are used to generate foreground masks with chroma and depth keying. The color image is taken for skin color segmentation to determine and distinguish the actor’s hands and face. In the depth image the flesh colored regions were used to determine their spatial position. The extracted positions were augmented by virtual objects. The scene is rendered correctly with virtual camera parameters which were calculated from the camera calibration parameters. Generated computer graphics with alpha value are combined with the HD color images. This compositing shows interaction with augmented objects for verification. The additional depth information results in changing the size of objects next to the hands when the actor moves around. KW - virtual studio KW - camera-tracking KW - VSVR Y1 - 2011 CY - Wedel ER - TY - CHAP A1 - Herder, Jens A1 - Neider, Christian A1 - Kinuwaki, Shinichi T1 - HDR-based lighting estimation for virtual studio (TV) environments T2 - 10th International Conference on Human and Computer N2 - Two high dynamic range HDR environments maps based on video streams from fish-eye lens cameras are used for generating virtual lights in a virtual set renderer. The task of realistic virtual light setup of scenes using captured environment maps might be eased as well as visual quality improves. We discuss the light setting problem for virtual studio tv productions which have mixed scenes of real objects, actors, virtual objects and virtual backgrounds. Benefits of hdr interactive light control are that the real light in the studio does not have to be remodeled and the artistic impression by using the light in the studio is also captured. An analysis of system requirements identifies technical challenges. We discuss the properties of a prototype system including test production. KW - HDR environment maps KW - light interaction KW - tracking KW - virtual set environments KW - Virtual (TV) Studio KW - video processing KW - FHD KW - VSVR Y1 - 2007 SP - 111 EP - 117 CY - Düsseldorf, Aizu-Wakamatsu ER - TY - CHAP A1 - Herder, Jens A1 - Jaensch, Kai A1 - Garbe, Katharina ED - Gausemeier, Jürgen ED - Grafe, Michael T1 - Haptische Interaktionen in Testumgebungen für Produktpräsentation in Virtuellen Umgebungen T2 - Augmented and Virtual Reality in der Produktentstehung N2 - Durch den vermehrten Einsatz von multimedialen Technologien werden in der Marktforschung die Möglichkeiten der Durchführung flexibler und kostengünstiger Studien gegeben. In sehr frühen Phasen des Innovationsprozesses als Teil der Marktforschung können durch Einsatz von Virtuellen Umgebungen die Markteinführungskonzepte für neue Produkte getestet werden. Mittels Anwendungen der Virtuellen Realität können neue Produkte einschlieï‚lich des Marketingkonzeptes auch haptisch getestet werden, ohne dass dieses Produkt bereits physisch vorhanden sein muss. Informationen werden dem Benutzer in Virtuellen Umgebungen hauptsächlich visuell und ergänzend auditiv übermittelt. Verbreitete Benutzerschnittstellen sind Interaktionsgeräte wie Stylus und Wand. Durch die haptische Wahrnehmung werden Informationen menschengerechter, effektiver und intuitiver wahrgenommen. Objekte in einer virtuellen Umgebung können durch den Einsatz haptischer Interaktionsgeräte ertastet und erfühlt werden und machen dadurch eine differenziertere Beurteilung und Einschätzung durch den Benutzer eben dieser Objekte möglich. Der Fokus des vorliegenden Projektes liegt daher auf der interaktiven haptischen Produktpräsentation in einer virtuellen Einkaufsumgebung, die in Online-Befragungen mit zusätzlichen Werbefilmen eingebettet ist. Als Nebenprodukt wurde das Werkzeug Open Inventor um Knoten zur Modellierung von haptischen Szeneneigenschaften erweitert. KW - Haptik KW - Virtuelle Umgebungen KW - Interaktion KW - Mensch-Maschine-Kommunikation KW - Testumgebung KW - Produkttest KW - FHD KW - VSVR Y1 - 2006 SN - 3-939350-07-9 VL - 188 SP - 87 EP - 99 PB - Heinz Nixdorf Institut, Universität Paderborn CY - Paderborn ER - TY - JOUR A1 - Daemen, Jeff A1 - Herder, Jens A1 - Koch, Cornelius A1 - Ladwig, Philipp A1 - Wiche, Roman A1 - Wilgen, Kai T1 - Halbautomatische Steuerung von Kamera und Bildmischer bei Live-Übertragungen JF - Fachzeitschrift für Fernsehen, Film und Elektronische Medien N2 - Live-Video-Broadcasting mit mehreren Kameras erfordert eine Vielzahl von Fachkenntnissen. Robotersysteme ermöglichen zwar die Automatisierung von gängigen und wiederholten Tracking-Aufnahmen, diese erlauben jedoch keine kurzfristigen Anpassungen aufgrund von unvorhersehbaren Ereignissen. In diesem Beitrag wird ein modulares, automatisiertes Kamerasteuerungs- und Bildschnitt-System eingeführt, das auf grundlegenden kinematografischen Regeln basiert. Die Positionen der Akteure werden durch ein markerloses Tracking-System bereitgestellt. Darüber hinaus werden Tonpegel der Lavaliermikrofone der Akteure zur Analyse der aktuellen Szene verwendet. Ein Expertensystem ermittelt geeignete Kamerawinkel und entscheidet, wann von einer Kamera auf eine andere umgeschaltet werden soll. Eine Testproduktion wurde durchgeführt, um den entwickelten Prototyp in einem Live-Broadcast-Szenario zu beobachten und diente als Videodemonstration für eine Evaluierung. KW - Halbautomatische Roboterkamerasteuerung KW - Verfolgen von Darstellern KW - Bildmischer KW - Szenenanalyse KW - Filmregeln KW - Automatische Bildauswahl KW - Virtual (TV) Studio Y1 - 2017 N1 - Der Artikel ist eine Übersetzung von dem Konferenzbeitrag "Semi-Automatic Camera and Switcher Control for Live Broadcast", International Conference on Interactive Experiences for Television and Online Video, TVX'2016, Chicago, IL, USA, ACM, DOI=10.1145/2932206.2933559, June 22-24, 2016. IS - 11 SP - 501 EP - 505 PB - Schiele & Schön ER - TY - CHAP A1 - Burga, Jose A1 - Daemen, Jeff A1 - Djuderija, Sascha A1 - Gnehr, Maren A1 - Goossens, Lars A1 - Hartz, Sven A1 - Haufs-Brusberg, Peter A1 - Herder, Jens A1 - Ibrahim, Mohammed A1 - Koop, Nikolas A1 - Leske, Christophe A1 - Meyer, Laurid A1 - Müller, Antje A1 - Salgert, Björn A1 - Schroeder, Richard A1 - Thiele, Simon T1 - Four Metamorphosis States in a Distributed Virtual (TV) Studio: Human, Cyborg, Avatar, and Bot T2 - 10th International Conference on Visual Media Production (CVMP 2013), London N2 - The major challenge in virtual studio technology is the interaction between the actor and virtual objects. Within a distributed live production, two locally separated markerless tracking systems where used simultaneously alongside a virtual studio. The production was based on a fully tracked actor, cyborg (half actor, half graphics), avatar, and a bot. All participants could interact and throw a virtual disc. This setup is compared and mapped to Milgram’s continuum and technical challenges are described. KW - TV KW - Distributed Virtual KW - Studio KW - Human KW - Cyborg KW - Avatar KW - Bot KW - VSVR Y1 - 2013 CY - London ER -