TY - JOUR A1 - Herder, Jens T1 - Interactive Content Creation with Virtual Set Environments JF - Journal of the 3D-Forum Society N2 - Digital broadcasting enables interactive \sc tv studios with virtual set environments. This presentation reviews current technology and describes the requirements for such systems. Interoperability over the production, streaming, and viewer levels requires open interfaces. As the technology allow more interaction, it becomes inherent difficult to control the quality of the viewers experience. KW - Interactive Media KW - Sound Spatialization KW - Virtual Sets KW - virtual studio KW - VSVR Y1 - 2001 VL - 15 IS - 4 SP - 53 EP - 56 ER - TY - CHAP A1 - Herder, Jens A1 - Wilke, Michael A1 - Heimbach, Julia A1 - Göbel, Sebastian A1 - Marinos, Dionysios T1 - Simple Actor Tracking for Virtual TV Studios Using a Photonic Mixing Device T2 - 12th International Conference on Human and Computer N2 - Virtual TV studios use actor tracking systems for resolving the occlusion of computer graphics and studio camera image. The actor tracking delivers the distance between actor and studio camera. We deploy a photonic mixing device, which captures a depth map and a luminance image at low resolution. The renderer engines gets one depth value per actor using the OSC protocol. We describe the actor recognition algorithm based on the luminance image and the depth value calculation. We discuss technical issues like noise and calibration. KW - actor tracking KW - photonic mixing device KW - virtual studio KW - video processing KW - FHD KW - VSVR Y1 - 2009 CY - Hamamatsu / Aizu-Wakamatsu / Düsseldorf ER - TY - CHAP A1 - Wöldecke, Björn A1 - Marinos, Dionysios A1 - Pogscheba, Patrick A1 - Geiger, Christian A1 - Herder, Jens A1 - Schwirten, Tobias T1 - radarTHEREMIN - Creating Musical Expressions in a Virtual Studio Environment T2 - 2011 IEEE International Symposium on VR Innovation N2 - In this paper we describe a prototypical system for live musical performance in a virtual studio environment. The performer stands in front of the studio camera and interacts with an infrared-laser-based multi-touch device. The final TV image shows the performer interacting with a virtual screen which is augmented in front of herself. To overcome the problem of the performer not seeing this virtual screen in reality, we use a special hexagonal grid to facilitate the performer's awareness of this novel Theremin-like virtual musical instrument. KW - multi-point interfaces KW - musical expression KW - virtual studio KW - VSVR KW - Virtual (TV) Studio Y1 - 2011 UR - https://ieeexplore.ieee.org/document/5759671 SN - 978-1-4577-0055-2 U6 - https://doi.org/10.1109/ISVRI.2011.5759671 SP - 345 EP - 346 PB - IEEE CY - Singapore ER - TY - CHAP A1 - Flasko, Matthias A1 - Pogscheba, Patrick A1 - Herder, Jens A1 - Vonolfen, Wolfgang T1 - Heterogeneous binocular camera-tracking in a Virtual Studio T2 - 8. Workshop Virtuelle und Erweiterte Realität der GI-Fachgruppe VR/AR N2 - This paper presents a tracking of parts of a human body in a virtual TV studio environment. The tracking is based on a depth camera and a HD studio camera and aims at a realistic interaction between the actor and the computer generated environment. Stereo calibration methods are used to match corresponding pixels of both cameras (HD color and depth image). Hence the images were rectified and column aligned. The disparity is used to correct the depth image pixel by pixel. This image registration results in row and column aligned images where ghost regions are in the depth image resulting from occlusion. Both images are used to generate foreground masks with chroma and depth keying. The color image is taken for skin color segmentation to determine and distinguish the actor’s hands and face. In the depth image the flesh colored regions were used to determine their spatial position. The extracted positions were augmented by virtual objects. The scene is rendered correctly with virtual camera parameters which were calculated from the camera calibration parameters. Generated computer graphics with alpha value are combined with the HD color images. This compositing shows interaction with augmented objects for verification. The additional depth information results in changing the size of objects next to the hands when the actor moves around. KW - virtual studio KW - camera-tracking KW - VSVR Y1 - 2011 CY - Wedel ER - TY - CHAP A1 - Brosda, Constantin A1 - Daemen, Jeff A1 - Djuderija, Sascha A1 - Joeres, Stephan A1 - Langer, Oleg A1 - Schweitzer, Andre A1 - Wilhelm, Andreas A1 - Herder, Jens T1 - TouchPlanVS Lite - A Tablet-based Tangible Multitouch Planning System for Virtual TV Studio Productions T2 - Proceedings of the 2012 Joint International Conference on Human-Centered Computer Environments N2 - This paper presents a mobile approach of integrating tangible user feedback in today’s virtual TV studio productions. We describe a tangible multitouch planning system, enabling a single user to prepare and customize scene flow and settings. Users can view and interact with virtual objects by using a tangible user interface on a capacitive multitouch surface. In a 2D setting created TV scenes are simultaneously rendered as separate view using a production/target renderer in 3D. Thereby the user experiences a closer reproduction of a final production and set assets can be reused. Subsequently, a user can arrange scenes on a timeline while maintaining different versions/sequences. The system consists of a tablet and a workstation, which does all application processing and rendering. The tablet is just an interface connected via wireless LAN. KW - virtual studio KW - planning tools KW - tangibles KW - capacitive touch screens KW - application streaming KW - VSVR KW - Virtual (TV) Studio Y1 - 2012 UR - https://dl.acm.org/citation.cfm?doid=2160749.2160764 SN - 978-1-4503-1191-5 SP - 64 EP - 67 PB - ACM CY - New York ER - TY - CHAP A1 - Herder, Jens A1 - Daemen, Jeff A1 - Haufs-Brusberg, Peter A1 - Abdel Aziz, Isis ED - Brunnett, Guido ED - Coquillart, Sabine ED - van Liere, Robert ED - Welch, Gregory ED - Váša, Libor T1 - Four Metamorphosis States in a Distributed Virtual (TV) Studio: Human, Cyborg, Avatar, and Bot - Markerless Tracking and Feedback for Realtime Animation Control T2 - Virtual Realities: International Dagstuhl Seminar, Dagstuhl Castle, Germany, June 9-14, 2013, Revised Selected Papers KW - Markeless tracking KW - virtual studio KW - Avatars KW - virtual characters KW - Interaction feedback KW - VSVR KW - Virtual (TV) Studio Y1 - 2015 UR - https://link.springer.com/chapter/10.1007/978-3-319-17043-5_2 SN - 978-3-319-17042-8 U6 - https://doi.org/10.1007/978-3-319-17043-5_2 VL - LNCS, 8844 SP - 16 EP - 32 PB - Springer CY - Cham ER -