Refine
Year of publication
Document Type
- Conference Proceeding (25)
- Article (peer reviewed) (10)
- Book (8)
- Report (2)
- Part of a Book (1)
Is part of the Bibliography
- no (46)
Keywords
- Augmented Reality (AR) (4)
- Mobile Robot (4)
- Robotic Research (4)
- Cognitive Mapping (3)
- Grundlagen Informatik (3)
- Machine Learning (3)
- Sonar Sensor (3)
- Computer vision (2)
- Forschung (2)
- Informatik (2)
Institute
The main focus of this work is the development of new methods for the self-calibration of a rigid stereo camera system. However, many of the algorithms introduced here have a wider impact, particularly in robot hand-eye calibration with all its different areas of application. Stereo self-calibration refers to the computation of the intrinsic and extrinsic parameters of a stereo rig using neither a priori knowledge on the movement of the rig nor on the geometry of the observed scene.
The stereo parameters obtained by self-calibration, namely rotation and translation from left to right camera, are used for computing depth maps for both images, which are applied for rendering correctly occluded virtual objects into a real scene (Augmented Reality).
The proposed methods were evaluated on real and synthetic data and compared to algorithms from the literature. In addition to a stereo rig, an optical tracking system with a camera mounted on an endoscope was calibrated without a calibration pattern using the proposed extended hand-eye calibration algorithm.
The self-calibration methods developed in this work have a number of features, which make them easily applicable in practice: They rely on temporal feature tracking only, as this monocular tracking in a continuous image sequence is much easier than left-to-right tracking when the camera parameters are still unknown.
Intrinsic and extrinsic camera parameters are computed during the self-calibration process, i.e., no calibration pattern is required. The proposed stereo self-calibration approach can also be used for extended hand-eye calibration, where the eye poses are obtained by structure-from-motion rather than from a calibration pattern.
An inherent problem to hand-eye calibration is that it requires at least two general movements of the cameras in order to compute the rigid transformation.
If the motion is not general enough, only a part of the parameters can be obtained, which would not be sufficient for computing depth maps. Therefore, a main part of this work discusses methods for data selection that increase the robustness of hand-eye calibration. Different new approaches are shown, the most successful ones being based on vector quantization.
The data selection algorithms developed in this work can not only be used for stereo self-calibration, but also for classic robot hand-eye calibration, and they are independent of the actually used hand-eye calibration algorithm.
Das Buch richtet sich an Studierende der Informatik oder verwandter Studiengänge und enthält Übungsaufgaben mit Lösungen aus Gebieten, die typischerweise in den ersten Semestern als Grundlagen behandelt werden. Ausgenommen ist der Bereich des Programmierens. Das Buch ergänzt den Grundkurs Informatik mit Übungen zu ausgewählten Kapiteln, ist aber auch in Kombination mit anderen Lehrbüchern verwendbar.
In this paper we address the problem of using quaternions in unconstrained nonlinear optimization of 3-D rotations. Quaternions representing rotations have four elements but only three degrees of freedom, since they must be of norm one.
This constraint has to be taken into account when applying e.g. the Levenberg-Marquardt algorithm, a method for unconstrained nonlinear optimization widely used in computer vision. We propose an easy to use method for achieving this.
Experiments using our parametrization in photo grammetric bündle -adjustment are presented at the end of the paper.
This paper presents new vector quantization based methods for selecting well-suited data for hand-eye calibration from a given sequence of hand and eye movements.
Data selection can improve the accuracy of classic hand-eye calibration, and make it possible in the first place in situations where the standard approach of manually selecting positions is inconvenient or even impossible, especially when using continuously recorded data.
A variety of methods is proposed, which differ from each other in the dimensionality of the vector quantization compared to the degrees of freedom of the rotation representation, and how the rotation angle is incorporated.
The performance of the proposed vector quantization based data selection methods is evaluated using data obtained from a manually moved optical tracking system (hand) and an endoscopic camera (eye).
This work presents a technique for computing dense disparity maps from a binocular stereo camera system. The methods are applied in an Augmented Reality setting for combining real and virtual worlds with proper occlusions. The proposed stereo correspondence technique is based oil area matching and facilitates an efficient strategy by using the concept of a three-dimensional similarity accumulator whereby occlusions are detected and object boundaries are extracted correctly. The main contribution of this paper is the way we fill the accumulator using absolute differences of images and computing a mean filter on these difference images. This. is. where the main advantages of the accumulator approach can be exploited, since all entries can be computed in parallel and thus extremely efficient. Additionally, we-perform an asymmetric correction step and a post-processing of the disparity maps that maintains object edges.
We describe an Augmented Reality system using the corners of a color cube for camera calibration. In the augmented image the cube is replaced by a computer generated virtual object.
The cube is localized in an image by the CSC color segmentation algorithm. The camera projection matrix is estimated with a linear method that is followed by a nonlinear refinement step.
Because of possible missclassifications of the segmented color regions and the minimum number of point correspondences used for calibration, the estimated pose of the cube may be very erroneous for some frames; therefore we perform outlier detection and treatment for rendering the virtual object in an acceptable manner.
We present an Approach for non linea roptimization of the parameters of an endoscopic camera mounted on a surgery robot. The goal is to generate a depth map for each image in order to enhance the quality of medical light fields.
The pose information provided by the robot is used as an initialization, where especially the orientation isi naccurate. Refinement of intrinsic and extrinsic camera parameters is performed by minimizing the back-projectionerror of 3-D points that are reconstructed by triangulation from image Feature stracked over an image sequence.
Optimization of the camera parameters results in an enhancement of Rendering Quality in two ways: More accurate parameters lead to better interpolation as well as to better depth maps for approximating the scenegeometry.
The paper presents an extended hand-eye calibration approach that, in contrast to the standard method, does not require a calibration pattern for determining camera position and orientation. Instead, a structure-from-motion algorithm is applied for obtaining the eye-data that is necessary for computing the unknown hand-eye transformation.
Different ways of extending the standard algorithm are presented, which mainly involves the estimation of a scale factor in addition to rotation and translation. The proposed methods are experimentally compared using data obtained from an optical tracking system that determines the pose of an endoscopic camera.
The approach is of special interest in our clinical setup, as the usage of an unsterile calibration pattern is difficult in a sterile environment.