TY - CHAP A1 - Davin, Till A1 - Herder, Jens ED - Weier, Martin ED - Bues, Matthias ED - Wechner, Reto T1 - Real-Time Relighting of Video Streams for Augmented Virtuality Scenes T2 - GI VR / AR Workshop. Gesellschaft für Informatik e.V. KW - Virtual (TV) Studio Y1 - 2021 U6 - https://doi.org/10.18420/vrar2021_6 PB - Gesellschaft für Informatik e.V. (GI) CY - Bonn ER - TY - CHAP A1 - Herder, Jens T1 - Matching Light for Virtual Studio TV Productions T2 - 9th International Conference on Human and Computer N2 - High dynamic range environments maps based on still images or video streams are used for computer animation or interactive systems. The task of realistic light setup of scenes using captured environment maps might be eased as well as the visual quality improves. In this article, we discuss the light setting problem for virtual studio (tv) layout and system become more complex to handle this new feature of studio light capturing. The analysis of system requirements identifies the technical challenges. KW - VSVR KW - Animation KW - Virtual (TV) Studio Y1 - 2006 SP - 158 EP - 162 CY - Aizu-Wakamatsu ER - TY - JOUR A1 - Griesert, Arnfried A1 - Walczak, Oliver A1 - Herder, Jens T1 - Interactive Realtime Terrain Visualization for Virtual Set Applications JF - Journal of the 3D-Forum Society N2 - Virtual set environments for broadcasting become more sophisticated as well as the visual quality improves. Realtime interaction and production-specific visualization implemented through plugin mechanism enhance the existing systems like the virtual studio software 3DK. This work presents an algorithm which can dynamically manage textures of high resolution by prefetching them depending on their requirement in memory and map them on a procedural mesh in realtime. The main goal application of this work is the virtual representation of a flight over a landscape as part of weather reports in virtual studios and the interaction by the moderator. KW - 3D KW - VSVR KW - Virtual (TV) Studio Y1 - 2003 VL - 17 IS - 4 SP - 20 EP - 26 ER - TY - CHAP A1 - Herder, Jens T1 - Challenges of Virtual Sets: From Broadcasting to Interactive Media T2 - Seventh International Workshop on Human N2 - Virtual sets have evolved from computer-generated, prerendered 2D backgrounds to realtime, responsive 3D computer graphics and are nowadays standard repertoire of broadcasting divisions. The graphics, which are combined with real video feed becoming moresophisticated, real looking and more responsive. We will look at the recent developments and suggest further developments like integration of spatial audio into the studio production and generating interactive media streams. Educational institutes recognize the demands of the rising media industry and established new courses on media technology like the Duesseldorf University of Applied Sciences. KW - Education KW - Interactive Media KW - Sound Spatialization KW - Virtual Sets KW - Virtual (TV) Studio KW - VSVR Y1 - 2000 SP - 13 EP - 17 PB - University of Aizu CY - Aizu-Wakamatsu ER - TY - CHAP A1 - Herder, Jens A1 - Vonolfen, Wolfgang A1 - Griesert, Arnfried A1 - Heuer, Stefan A1 - Hoffmann, Ansgar A1 - Höppner, Bernd T1 - Interactive Virtual Set Applications for Post Production T2 - University of Aizu 2004 – Seventh International Conference on Human N2 - Virtual set environments for broadcasting become more sophisticated as well as the visual quality improves. Realtime interaction and production-specific visualization implemented through plugin mechanism enhance the existing systems like the 3DK. This work presents the integration of the Intersense IS-900 SCT camera tracking and 3D interaction into the 3DK virtual studio environment. The main goal of this work is the design of a virtual studio environment for post productions, which includes video output as well as media streaming formats such as MPEG-4. The systems allows high quality offline rendering during post production and 3D interaction by the moderator during the recording. KW - interaction KW - tracking KW - virtual set environments KW - Virtual (TV) Studio KW - post production KW - MPEG-4 KW - FHD KW - VSVR Y1 - 2004 CY - Aizu-Wakamatsu ER - TY - CHAP A1 - Herder, Jens A1 - Neider, Christian A1 - Kinuwaki, Shinichi T1 - HDR-based lighting estimation for virtual studio (TV) environments T2 - 10th International Conference on Human and Computer N2 - Two high dynamic range HDR environments maps based on video streams from fish-eye lens cameras are used for generating virtual lights in a virtual set renderer. The task of realistic virtual light setup of scenes using captured environment maps might be eased as well as visual quality improves. We discuss the light setting problem for virtual studio tv productions which have mixed scenes of real objects, actors, virtual objects and virtual backgrounds. Benefits of hdr interactive light control are that the real light in the studio does not have to be remodeled and the artistic impression by using the light in the studio is also captured. An analysis of system requirements identifies technical challenges. We discuss the properties of a prototype system including test production. KW - HDR environment maps KW - light interaction KW - tracking KW - virtual set environments KW - Virtual (TV) Studio KW - video processing KW - FHD KW - VSVR Y1 - 2007 SP - 111 EP - 117 CY - Düsseldorf, Aizu-Wakamatsu ER - TY - JOUR A1 - Daemen, Jeff A1 - Herder, Jens A1 - Koch, Cornelius A1 - Ladwig, Philipp A1 - Wiche, Roman A1 - Wilgen, Kai T1 - Halbautomatische Steuerung von Kamera und Bildmischer bei Live-Übertragungen JF - Fachzeitschrift für Fernsehen, Film und Elektronische Medien N2 - Live-Video-Broadcasting mit mehreren Kameras erfordert eine Vielzahl von Fachkenntnissen. Robotersysteme ermöglichen zwar die Automatisierung von gängigen und wiederholten Tracking-Aufnahmen, diese erlauben jedoch keine kurzfristigen Anpassungen aufgrund von unvorhersehbaren Ereignissen. In diesem Beitrag wird ein modulares, automatisiertes Kamerasteuerungs- und Bildschnitt-System eingeführt, das auf grundlegenden kinematografischen Regeln basiert. Die Positionen der Akteure werden durch ein markerloses Tracking-System bereitgestellt. Darüber hinaus werden Tonpegel der Lavaliermikrofone der Akteure zur Analyse der aktuellen Szene verwendet. Ein Expertensystem ermittelt geeignete Kamerawinkel und entscheidet, wann von einer Kamera auf eine andere umgeschaltet werden soll. Eine Testproduktion wurde durchgeführt, um den entwickelten Prototyp in einem Live-Broadcast-Szenario zu beobachten und diente als Videodemonstration für eine Evaluierung. KW - Halbautomatische Roboterkamerasteuerung KW - Verfolgen von Darstellern KW - Bildmischer KW - Szenenanalyse KW - Filmregeln KW - Automatische Bildauswahl KW - Virtual (TV) Studio Y1 - 2017 N1 - Der Artikel ist eine Übersetzung von dem Konferenzbeitrag "Semi-Automatic Camera and Switcher Control for Live Broadcast", International Conference on Interactive Experiences for Television and Online Video, TVX'2016, Chicago, IL, USA, ACM, DOI=10.1145/2932206.2933559, June 22-24, 2016. IS - 11 SP - 501 EP - 505 PB - Schiele & Schön ER - TY - CHAP A1 - Wöldecke, Björn A1 - Vierjahn, Tom A1 - Flasko, Matthias A1 - Herder, Jens A1 - Geiger, Christian T1 - Steering actors through a virtual set employing vibro-tactile feedback T2 - TEI '09 Proceedings of the 3rd International Conference on Tangible and Embedded Interaction N2 - Actors in virtual studio productions are faced with the challenge that they have to interact with invisible virtual objects because these elements are rendered separately and combined with the real image later in the production process. Virtual sets typically use static virtual elements or animated objects with predefined behavior so that actors can practice their performance and errors can be corrected in the post production. With the demand for inexpensive live recording and interactive TV productions, virtual objects will be dynamically rendered at arbitrary positions that cannot be predicted by the actor. Perceptive aids have to be employed to support a natural interaction with these objects. In our work we study the effect of haptic feedback for a simple form of interaction. Actors are equipped with a custom built haptic belt and get vibrotactile feedback during a small navigational task (path following). We present a prototype of a wireless vibrotactile feedback device and a small framework for evaluating haptic feedback in a virtual set environment. Results from an initial pilot study indicate that vibrotactile feedback is a suitable non-visual aid for interaction that is at least comparable to audio-visual alternatives used in virtual set productions. KW - tactile feedback KW - interaction in virtual sets KW - navigation aids KW - FHD KW - VSVR KW - Virtual (TV) Studio Y1 - 2009 UR - https://dl.acm.org/citation.cfm?id=1517703 SN - 978-1-60558-493-5 U6 - https://doi.org/10.1145/1517664.1517703 SP - 169 EP - 174 PB - ACM CY - New York ER - TY - CHAP A1 - Klapdohr, Monika A1 - Wöldecke, Björn A1 - Marinos, Dionysios A1 - Herder, Jens A1 - Geiger, Christian A1 - Vonolfen, Wolfgang T1 - Vibrotactile Pitfalls: Arm Guidance for Moderators in Virtual TV Studios T2 - HC '10 Proceedings of the 13th International Conference on Humans and Computers N2 - For this study, an experimental vibrotactile feedback system was developed to help actors with the task of moving their arm to a certain place in a virtual tv studio under live conditions. Our intention is to improve interaction with virtual objects in a virtual set, which are usually not directly visible to the actor, but only on distant displays. Vibrotactile feedback might improve the appearance on tv because an actor is able to look in any desired direction (camera or virtual object) or to read text on a teleprompter while interacting with a virtual object. Visual feedback in a virtual studio lacks spatial relation to the actor, which impedes the adjustment of the desired interaction. The five tactors of the implemented system which are mounted on the tracked arm give additional information like collision, navigation and activation. The user study for the developed system shows that the duration for reaching a certain target is much longer in case no visual feedback is given, but the accuracy is similar. In this study, subjects reported that an activation signal indicating the arrival at the target of a drag & drop task was helpful. In this paper, we discuss the problems we encountered while developing such a vibrotactile display. Keeping these pitfalls in mind could lead to better feedback systems for actors in virtual studio environments. KW - vibrotactile feedback KW - Virtual (TV) Studio KW - augmented reality KW - FHD KW - VSVR Y1 - 2010 UR - https://dl.acm.org/citation.cfm?id=1994506 SP - 72 EP - 80 PB - University of Aizu Press CY - Aizu-Wakamatsu ER - TY - CHAP A1 - Ayten, Hüseyin A1 - Herder, Jens A1 - Vonolfen, Wolfgang T1 - Visual Acceptance Evaluation of Soft Shadow Algorithms for Virtual TV Studios T2 - HC '10 Proceedings of the 13th International Conference on Humans and Computers N2 - Shadows in computer graphics are an important rendering aspect for spatial objects. For realtime computer applications such as games, it is essential to represent shadows as accurate as possible. Also, various tv stations work with virtual studio systems instead of real studio sets. Especially for those systems, a realistic impression of the rendered and mixed scene is important. One challenge, hence, is the creation of a natural shadow impression. This paper presents the results of an empirical study to compare the performance and quality of different shadow mapping methods. For this test, a prototype studio renderer was developed. A percentage closer filter (pcf) with a number of specific resolutions is used to minimize the aliasing issue. More advanced algorithms which generate smooth shadows like the percentage closer soft shadow (pcss) method as well as the variance shadow maps (vsm) method are analysed. Different open source apis are used to develop the virtual studio renderer, giving the benefit of permanent enhancement. The Ogre 3D graphic engine is used to implement the rendering system, benefiting from various functions and plugins. The transmission of the tracking data is accomplished with the vrpn server/client and the Intersense api. The different shadow algorithms are compared in a virtual studio environment which also casts real shadows and thus gives a chance for a direct comparison throughout the empirical user study. The performance is measured in frames per secon KW - Virtual (TV) Studio KW - soft shadow KW - realtime rendering KW - augmented reality KW - algorithmus KW - FHD KW - experimentation KW - verification KW - VSVR Y1 - 2010 UR - https://dl.acm.org/citation.cfm?id=1994505 SP - 66 EP - 71 PB - University of Aizu Press CY - Aizu-Wakamatsu ER -