Refine
Year of publication
Document Type
- Conference Proceeding (59)
- Article (19)
- Part of a Book (6)
- Workingpaper / Report (2)
- Doctoral Thesis (1)
Language
- English (87) (remove)
Keywords
- VSVR (39)
- Virtual (TV) Studio (23)
- FHD (17)
- Lehre (6)
- Sound Spatialization (6)
- virtual studio (6)
- Virtual Reality (5)
- human perception (5)
- Mixed Reality (4)
- Resource Management (4)
- audio rendering (4)
- augmented reality (4)
- spatial media (4)
- virtual environments (4)
- Augmented Virtuality (3)
- Avatars (3)
- groupware (3)
- spatialization (3)
- user interface design (3)
- Augmented Reality (2)
- Camera Tracking (2)
- Co-located Collaborations (2)
- Groupware (2)
- Head-mounted Display (2)
- Interaction (2)
- Interactive Media (2)
- M (2)
- Mixed reality (2)
- TV (2)
- Tracking (2)
- Virtual Sets (2)
- Visualization (2)
- actor tracking (2)
- audio rendering, clustering (2)
- experimentation (2)
- first-order reflection (2)
- human factors (2)
- human-machine interfaces (2)
- occluder (2)
- resource management (2)
- sound spatialization (2)
- spatial audio (2)
- spatial sound authoring (2)
- tactile feedback (2)
- tracking (2)
- video processing (2)
- virtual set environments (2)
- 3-D Interaction (1)
- 3D (1)
- 3D audio (1)
- 3D interaction (1)
- 3D user interfaces (1)
- 3D-Rendering (1)
- Acoustic displays (1)
- Acoustic reflection (1)
- Animation (1)
- Auditory displays (1)
- Aural attributes (1)
- Avatar (1)
- Blockchain (1)
- Bot (1)
- CAI (1)
- CAT (1)
- CSCW (1)
- Cameras (1)
- Control systems (1)
- Cyborg (1)
- Delay effects (1)
- Delays (1)
- Distributed Virtual (1)
- Education (1)
- Electronic mail (1)
- Engines (1)
- English as a foreign language (1)
- Gesture recognition (1)
- HDR environment maps (1)
- HMD (1)
- HoloLens (1)
- Human (1)
- Human-centered computing (1)
- Immersive Environments (1)
- Information systems (1)
- Innovationsmanagement (1)
- Interaction Techniques (1)
- Interaction design process and methods (1)
- Interaction feedback (1)
- Interaction techniques (1)
- Kinect (1)
- Large screen displays (1)
- Live Video Streaming (1)
- Loudspeakers (1)
- MPEG-4 (1)
- Markeless tracking (1)
- Markteinführungskonzept (1)
- Mensch-Maschine-Kommunikation (1)
- Mobile Computing (1)
- Mobile computing (1)
- Mulitmodal (1)
- Multimedia systems (1)
- Myo (1)
- Navigation (1)
- Networked Immersive Virtual Environments (1)
- Nondestructive Testing (1)
- OSC mapping (1)
- Photospherical Imagery (1)
- Preisabsatzfunktion (1)
- Production (1)
- Produkttest (1)
- Rapid Prototyping (1)
- Remote Collaboration (1)
- Remote collaboration (1)
- Reverberation (1)
- Room effects (1)
- Size control (1)
- Skeleton (1)
- Social Presence (1)
- Spatial media (1)
- SteamVR (1)
- Stereo camera (1)
- Studio (1)
- Telepresence (1)
- Testmarkt (1)
- UNIX (1)
- Ubiquitous Computing (1)
- Ultrasonic (1)
- Video Conferencing (1)
- Virtual environments (1)
- Virtual reality (1)
- Virtuelle Umgebungen (1)
- abstraction-reconstruction cycle (1)
- algorithmus (1)
- application streaming (1)
- architectural design (1)
- audio filtering (1)
- audio interpolation (1)
- audio signal processing, audio telecommunications (1)
- augmented (1)
- auralization (1)
- automated robotic camera system (1)
- automated shot control (1)
- autonomous actors (1)
- body tracking (1)
- calm technology (1)
- camera-tracking (1)
- capacitive touch screens (1)
- chatspaces (1)
- clustering, and human perception (1)
- collaborative work (1)
- computer education (1)
- computer music (1)
- database (1)
- databases (1)
- design (1)
- design review (1)
- dictionary (1)
- digital broadcasting (1)
- direction signalization (1)
- directional mixing console (1)
- distance cue (1)
- erweiterte Realität (1)
- fiducial tangible recognition (1)
- film rules (1)
- graphics processing unit (1)
- human computer interaction (1)
- hypertext, search engine (1)
- interaction (1)
- interaction in virtual sets (1)
- interactive sport simulation (1)
- interactive walkthrough (1)
- level of detail (1)
- light interaction (1)
- live streaming (1)
- loudspeaker array (1)
- low cost multi-touch infrared overlay frame (1)
- man-machine interfaces (1)
- marketing studies (1)
- measurement (1)
- mixed reality (1)
- mobile computing (1)
- multi-point interfaces (1)
- multichannel sound reproduction (1)
- multimedia (1)
- multimedia information systems (1)
- musical expression (1)
- narrowcasting functions (1)
- navigation aids (1)
- networked audio (1)
- obtrusion (1)
- perspicuity (1)
- photonic mixing device (1)
- photospherical imagery (1)
- planning tools (1)
- post production (1)
- presentation assistance (1)
- psychoacoustic (1)
- realtime animations (1)
- realtime rendering (1)
- reliability (1)
- retrieval methods (1)
- room-related transfer functions (1)
- roomware (1)
- rotational tracking (1)
- scene analysis (1)
- shader programming (1)
- social media (1)
- soft shadow (1)
- sound interaction (1)
- sound localization (1)
- sound radiation pattern (1)
- sound spatialization resource management (1)
- sound spatialization server (1)
- spacecraft configuration (1)
- spatial sound (1)
- stage flight system (1)
- switcher control (1)
- talent tracking (1)
- tangibles (1)
- teaching (1)
- telepresence (1)
- user experience (1)
- user interface design man-machine interfaces (1)
- user-centered design (1)
- verification (1)
- vibrotactile feedback (1)
- video textures (1)
- virtual TV (1)
- virtual characters (1)
- virtual conferencing environment (1)
- virtual environment (1)
- virtual prototyping (1)
- virtual realities (1)
- virtual reality (1)
- virtual reality environments (1)
- virtual studio interaction (1)
- virtual studios (1)
- visual feedback (1)
- visual music (1)
- vizualization (1)
- vr archery (1)
- wayfinding (1)
- web and video supported learning (1)
Department/institution
A module for soundscape monitoring and visualizing resource management processes was extended for presenting clusters, generated by a novel sound source clustering algorithm. This algorithm groups multiple sound sources together into a single representative source, considering localization errors depending on listener orientation. Localization errors are visualized for each cluster using resolution cones. Visualization is done in runtime and allows understanding and evaluation of the clustering algorithm.
A module for soundscape monitoring and visualizing resource management processes was extended for presenting clusters, generated by a novel sound source clustering algorithm. This algorithm groups multiple sound sources together into a single representative source, considering localization errors depending on listener orientation. Localization errors are visualized for each cluster using resolution cones. Visualization is done in runtime and allows understanding and evaluation of the clustering algorithm.
Dynamic characteristics of occlusion during lower jaw motion are useful in the diagnosis of jaw articulation problems and in computer-aided design/manufacture of teeth restorations. The Functionally Generated Path (FGP), produced as a surface which envelops the actual occlusal surface of the moving opponent jaw, can be used for compact representation of dynamic occlusal relations. In traditional dentistry FGP is recorded as a bite impression in a patient’s mouth. We propose an efficient computerized technique for FGP reconstruction and validate it through implementation and testing. The distance maps between occlusal surfaces of jaws, calculated for multiple projection directions and accumulated for mandibular motion, provide information for FGP computation. Rasterizing graphics hardware is used for fast calculation of the distance maps. Real-world data are used: the scanned shape of teeth and the measured motion of the lower jaw. We show applications of FGP to analysis of the occlusion relations and occlusal surface design for restorations.
CAD/CAM techniques are increasingly used in dentistry for the design and fabrication of teeth estorations. Important concerns are the correction of articulation problems that existed before treatment and the prevention of treatment-generated problems. These require interactive evaluation of the occlusal surfaces of teeth during mastication. Traditional techniques based on the use of casts with mechanical articulators require manual adjustment of occlusal surfaces, which becomes impractical when hard restoration materials like porcelain are used; they are also time and labor consuming and provide little visual information. We present new visual tools and a related user interface for global articulation simulation, developed for the Intelligent Dental Care System project. The aim of the simulation is visual representation of characteristics relevant to the chewing process. The simulation is based on the construction of distance maps, which are visual representations of the distributions of the distances of points in a tooth to the opposite jaw. We use rasterizing graphics hardware for fast calculation of the distance maps. Distance maps are used for collision detection and for the derivation of various characteristics showing the distribution of load on the teeth and the chewing capability of the teeth. Such characteristics can be calculated for particular positions of the jaws; cumulative characteristics are used to describe the properties of jaw movement. This information may be used for interactive design of the occlusal surfaces of restorations and for jaw articulation diagnosis. We also demonstrate elements of a user interface that exploit metaphors familiar to dentists from everyday practice.
CAD/CAM techniques are increasingly used in dentistry for the design and fabrication of teeth restorations. Important concerns are the correction of articulation problems that existed beforetreatment and the prevention of treatment-generated problems. These require interactive evaluation of the occlusal surfaces of teeth during mastication. Traditional techniques based on the use of casts with mechanical articulators require manual adjustment of occlusal surfaces, which becomes impractical when hard restoration materials like porcelain are used; they are also time and labor consuming and provide little visual information. We present new visual tools and a related user interface for global articulation simulation, developed for the Intelligent Dental Care System project. The aim of the simulation is visual representation of characteristics relevant to the chewing process. The simulation is based on the construction of distance maps, which are visual representations of the distributions of the distances of points in a tooth to the opposite jaw. We use rasterizing graphics hardware for fast calculation of the distance maps. Distance maps are used for collision detection and for the derivation of various characteristics showing the distribution of load on the teeth and the chewing capability of the teeth. Such characteristics can be calculated for particular positions of the jaws; cumulative characteristics are used to describe the properties of jaw movement. This information may be used for interactive design of the occlusal surfaces of restorations and for jaw articulation diagnosis. We also demonstrate elements of a user interface that exploit metaphors familiar to dentists from everyday practice.
Shadows in computer graphics are an important rendering aspect for spatial objects. For realtime computer applications such as games, it is essential to represent shadows as accurate as possible. Also, various tv stations work with virtual studio systems instead of real studio sets. Especially for those systems, a realistic impression of the rendered and mixed scene is important. One challenge, hence, is the creation of a natural shadow impression. This paper presents the results of an empirical study to compare the performance and quality of different shadow mapping methods. For this test, a prototype studio renderer was developed. A percentage closer filter (pcf) with a number of specific resolutions is used to minimize the aliasing issue. More advanced algorithms which generate smooth shadows like the percentage closer soft shadow (pcss) method as well as the variance shadow maps (vsm) method are analysed. Different open source apis are used to develop the virtual studio renderer, giving the benefit of permanent enhancement. The Ogre 3D graphic engine is used to implement the rendering system, benefiting from various functions and plugins. The transmission of the tracking data is accomplished with the vrpn server/client and the Intersense api. The different shadow algorithms are compared in a virtual studio environment which also casts real shadows and thus gives a chance for a direct comparison throughout the empirical user study. The performance is measured in frames per secon
For this study, an experimental vibrotactile feedback system was developed to help actors with the task of moving their arm to a certain place in a virtual tv studio under live conditions. Our intention is to improve interaction with virtual objects in a virtual set, which are usually not directly visible to the actor, but only on distant displays. Vibrotactile feedback might improve the appearance on tv because an actor is able to look in any desired direction (camera or virtual object) or to read text on a teleprompter while interacting with a virtual object. Visual feedback in a virtual studio lacks spatial relation to the actor, which impedes the adjustment of the desired interaction. The five tactors of the implemented system which are mounted on the tracked arm give additional information like collision, navigation and activation. The user study for the developed system shows that the duration for reaching a certain target is much longer in case no visual feedback is given, but the accuracy is similar. In this study, subjects reported that an activation signal indicating the arrival at the target of a drag & drop task was helpful. In this paper, we discuss the problems we encountered while developing such a vibrotactile display. Keeping these pitfalls in mind could lead to better feedback systems for actors in virtual studio environments.
Virtual environments can create a realistic impression of an architectural space during the architectural design process, providing a powerful tool for evaluation and promotion during a project’s early stages. In comparison to pre-rendered animations,
such as walkthroughs based on CAD models, virtual environments can offer intuitive interaction and a more life like experience. Advanced virtual environments allow users to change realtime rendering features with a few manipulations, switching between different versions while still maintaining sensory immersion. This paper reports on an experimental project in which architectural models are being integrated into interactive virtual environments, and includes demonstrations of both the possibilities and limitations of such applications in evaluating, presenting and promoting architectural designs.
More than three decades of ongoing research in immersive modelling has revealed many advantages of creating objects in virtual environments. Even though there are many benefits, the potential of immersive modelling has only been partly exploited due to unresolved problems such as ergonomic problems, numerous challenges with user interaction and the inability to perform exact, fast and progressive refinements. This paper explores past research, shows alternative approaches and proposes novel interaction tools for pending problems. An immersive modelling application for polygon meshes is created from scratch and tested by professional users of desktop modelling tools, such as Autodesk Maya, in order to assess the efficiency, comfort and speed of the proposed application with direct comparison to professional desktop modelling tools.
This paper presents a mobile approach of integrating tangible user feedback in today’s virtual TV studio productions. We describe a tangible multitouch planning system, enabling a single user to prepare and customize scene flow and settings. Users can view and interact with virtual objects by using a tangible user interface on a capacitive multitouch surface. In a 2D setting created TV scenes are simultaneously rendered as separate view using a production/target renderer in 3D. Thereby the user experiences a closer reproduction of a final production and set assets can be reused. Subsequently, a user can arrange scenes on a timeline while maintaining different versions/sequences. The system consists of a tablet and a workstation, which does all application processing and rendering. The tablet is just an interface connected via wireless LAN.
This article presents a new approach of integrating tangible user feedback in todays virtual TV studio productions. We describe a tangible multitouch planning system, enabling multiple users to prepare and customize scene flow and settings. Users can collaboratively view and interact with virtual objects by using a tangible user interface on a shared multitouch surface. The in a 2D setting created TV scenes are simultaneously rendered on an external monitor, using a production/target renderer in 3D. Thereby the user experiences a closer reproduction of a final production. Subsequently, users are able to join together the scenes into one complex plot. Within the developing process, a video prototype of the system shows the user interaction and enables early reviews and evaluations. The requirement analysis is based on expert interviews.
Broader use of virtual reality environments and sophisticated animations spawn a need for spatial sound. Until now, spatial sound design has been based very much on experience and trial and error. Most effects are hand-crafted, because good design tools for spatial sound do not exist. This paper discusses spatial sound authoring and its applications, including shared virtual reality environments based on VRML. New utilities introduced by this research are an inspector for sound sources, an interactive resource manager, and a visual soundscape manipulator. The tools are part of a sound spatialization framework and allow a designer/author of multimedia content to monitor and debug sound events. Resource constraints like limited sound spatialization channels can also be simulated.
The PSFC, or Pioneer sound field control system, is a DSP-driven hemispherical 14-loudspeaker array, installed at the University of Aizu Multimedia Center. Collocated with a large screen rear-projection stereographic display the PSFC features realtime control of virtual room characteristics and direction of two separate sound channels, smoothly steering them around a configurable soundscape. The PSFC controls an entire sound field, including sound direction, virtual distance, and simulated environment (reverb level, room size and liveness) for each source. It can also configure a dry (DSP-less) switching matrix for direct directionalization. The PSFC speaker dome is about 14 m in diameter, allowing about twenty users at once to comfortably stand or sit near its sweet spot.
Auditory displays with the ability to dynamically spatialize virtual sound sources under real-time conditions enable advanced applications for art and music. A listener can be deeply immersed while interacting and participating in the experience. We review some of those applications while focusing on the Helical Keyboard project and discussing the required technology. Inspired by the cyclical nature of octaves and helical structure of a scale, a model of a piano-style keyboard was prepared, which was then geometrically warped into a helicoidal configuration, one octave/revolution, pitch mapped to height and chroma. It can be driven by MIDI events, real-time or sequenced, which stream is both synthesized and spatialized by a spatial sound display. The sound of the respective notes is spatialized with respect to sinks, avatars of the human user, by default in the tube of the helix. Alternative coloring schemes can be applied, including a color map compatible with chromastereoptic eyewear. The graphical display animates polygons, interpolating between the notes of a chord across the tube of the helix. Recognition of simple chords allows directionalization of all the notes of a major triad from the position of its musical root. The system is designed to allow, for instance, separate audition of harmony and melody, commonly played by the left and right hands, respectively, on a normal keyboard. Perhaps the most exotic feature of the interface is the ability to fork oneÃs presence, replicating subject instead of object by installing multiple sinks at arbitrary places around a virtual scene so that, for example, harmony and melody can be separately spatialized, using two heads to normalize the octave; such a technique effectively doubles the helix from the perspective of a single listener. Rather than a symmetric arrangement of the individual helices, they are perceptually superimposed in-phase, co-extensively, so that corresponding notes in different registers are at the same azimuth.
Multimediale Technologien werden in der Marktforschung immer stärker eingesetzt, um flexible und kostengünstige Studien durchzuführen. Im Innovationsprozess kann dabei auf die langjährigen Erfahrungen zurückgegriffen werden, die durch den Einsatz der Computersimulation in der technischen Produktentwicklung zustande gekommen sind. In sehr frühen Phasen des Innovationsprozesses können durch Einsatz der neuen Technologien die Markteinführungskonzepte für neue Produkte getestet werden. Die Applikationen der virtuellen Realität bieten ein einzigartiges Potential, neue Produkte einschlieï‚lich des Marketingkonzeptes zu testen, ohne dass dieses Produkt bereits physisch vorhanden sein muss. Am Beispiel eines Elementes des Marketingkonzeptes, der Preispolitik, zeigt die vorliegende Studie auf, welches Potential die virtuelle Kaufsituation von Produkten bietet. Der Fokus des Projektes liegt auf der interaktiven Produktpräsentation in einer virtuellen Umgebung, die in eine Online-Befragung mit zusätzlichen Werbefilmen eingebettet ist. Visuell hochwertige 3D-Produktpräsentationen versetzen den Probanden in eine virtuelle Einkaufsumgebung, die einem realen Szenario entspricht. Die virtuellen Produkte werden in mehreren Kaufentscheidungsrunden zu unterschiedlichen Preisen angeboten. Der Preisuntersuchung geht eine Präsentation ausgewählter Werbespots sowie eine produktbezogene Befragung voraus. Im Anschluss an die virtuellen Preisentscheidungen werden die Eindrücke sowie einige Kontrollgröen abgefragt. In weitergehenden Studien dieser Art können die Wirkungen mehrerer Marketing-Instrumente zu einem Zeitpunkt untersucht werden, in dem sich die Produkte noch im Entwicklungsprozess befinden. Auf diesem Weg lassen sich auch Wettbewerbsvorteile bestehender Produkte effizienter erkennen und nutzen. Mit den hoch entwickelten Computer- und Visualisierungstechnologien ist ein mächtiges Werkzeug entstanden, das bereits für kommerzielle Präsentationen und Produktstudien eingesetzt wird. Zukünftig kann es auch in Kombination mit Internetanwendungen und klassischen Methoden der Marktforschung zu einem sehr frühen Zeitpunkt umfassende Erkenntnisse über ein Produkt liefern.
Markerless talent tracking is widely used for interactions and animations within virtual environments. In a virtual (tv) studio talents could be overburden by interaction tasks because camera and text require extensive attention. We take a look into animations and inter- actions within a studio, which do not require any special attention or learning. We show the generation of an artificial shadow from a talent, which ease the keying process, where separation of real shadows from the background is a difficult task. We also demonstrate animations of footsteps and dust. Furthermore, capturing talents’ height can also be used to adjust the parameters of elements in the virtual environment, like the position and scaling of a virtual display. In addition to the talents, a rigid body was tracked as placeholder for graphics, easing the interaction tasks for a talent. Two test productions show the possibilities, which subtle animations offer. In the second production, the rendering was improved (shadows, filtering, normal maps, ...) and instead of using the rigid body to move an object (a flag), the animation was only controlled by the hand’s position.
We present a system that exploits mobile rotational tracking and photospherical imagery to allow users to share their environment with remotely connected peers “on the go.” We surveyed related interfaces and developed a unique groupware application that shares a mixed reality space with spatially-oriented live video feeds. Users can collaborate through realtime audio, video, and drawings in a virtual space. The developed system was tested in a preliminary user study, which confirmed an increase in spatial and situational awareness among viewers as well as reduction in cognitive workload. Believing that our system provides a novel style of collaboration in mixed reality environments, we discuss future applications and extensions of our prototype.
Actors in virtual studio productions are faced with the challenge that they have to interact with invisible virtual objects because these elements are rendered separately and combined with the real image later in the production process. Virtual sets typically use static virtual elements or animated objects with predefined behavior so that actors can practice their performance and errors can be corrected in the post production. With the demand for inexpensive live recording and interactive TV productions, virtual objects will be dynamically rendered at arbitrary positions that cannot be predicted by the actor. Perceptive aids have to be employed to support a natural interaction with these objects. In our work we study the effect of haptic feedback for a simple form of interaction. Actors are equipped with a custom built haptic belt and get vibrotactile feedback during a small navigational task (path following). We present a prototype of a wireless vibrotactile feedback device and a small framework for evaluating haptic feedback in a virtual set environment. Results from an initial pilot study indicate that vibrotactile feedback is a suitable non-visual aid for interaction that is at least comparable to audio-visual alternatives used in virtual set productions.