TY - CHAP A1 - Brooks, Alex A1 - Makarenko, Alexei A1 - Kaupp, Tobias A1 - Durrant-Whyte, Hugh A1 - Dellaert, Frank T1 - Decentralised Data Fusion with Dynamic Topologies-A Graphical Model Approach T2 - IFAC Proceedings Volumes Y1 - 2009 VL - 42 IS - 20 SP - 222 EP - 227 ER - TY - CHAP A1 - Kaupp, Tobias A1 - Makarenko, Alexei T1 - Decision-theoretic human-robot communication T2 - Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction N2 - Humans and robots need to exchange information if the objective is to achieve a task cooperatively. Two questions are considered in this paper: what type of information to communicate, and how to cope with the limited resources of human operators. Decision-theoretic human-robot communication can provide answers to both questions: the type of information is determined by the underlying probabilistic representation, and value-of-information theory helps decide when it is appropriate to query operators for information. A robot navigation task is used to evaluate the system by comparing it to conventional teleoperation. The results of a user study show that the developed system is superior with respect to performance, operator workload, and usability. Y1 - 2008 U6 - https://doi.org/https://doi.org/10.1145/1349822.1349835 SP - 89 EP - 96 ER - TY - CHAP A1 - Douillard, Bertrand A1 - Upcroft, Ben A1 - Kaupp, Tobias A1 - Ramos, Fabio A1 - Durrant-Whyte, Hugh T1 - Bayesian filtering over compressed appearance states T2 - Proceedings of the Australasian Conference on Robotics and Automation (ACRA) N2 - This paper presents a framework for performing real-time recursive estimation of landmarks’ visual appearance. Imaging data in its original high dimensional space is probabilistically mapped to a compressed low dimensional space through the definition of likelihood functions. The likelihoods are subsequently fused with prior information using a Bayesian update. This process produces a probabilistic estimate of the low dimensional representation of the landmark visual appearance. The overall filtering provides information complementary to the conventional position estimates which is used to enhance data association. In addition to robotics observations, the filter integrates human observations in the appearance estimates. The appearance tracks as computed by the filter allow landmark classification. The set of labels involved in the classification task is thought of as an observation space where human observations are made by selecting a label. The low dimensional appearance estimates returned by the filter allow for low cost communication in low bandwidth sensor networks. Deployment of the filter in such a network is demonstrated in an outdoor mapping application involving a human operator, a ground and an air vehicle. Y1 - 2007 UR - https://www.researchgate.net/publication/43527752_Bayesian_filtering_over_compressed_appearance_states ER - TY - CHAP A1 - Makarenko, Alexei A1 - Kaupp, Tobias A1 - Grocholsky, Ben A1 - Durrant-Whyte, Hugh T1 - Human-robot interactions in active sensor networks T2 - Proceedings 2003 IEEE International Symposium on Computational Intelligence in Robotics and Automation. Computational Intelligence in Robotics and Automation for the New Millennium (Cat. No. 03EX694) N2 - This paper considers the modes of interaction between one or several human operators and an active sensor network-a fully decentralized network of sensors some or all of which have actuators and are in that sense active. The primary goal of this study is to investigate the conditions under which the human involvement will not jeopardize scalability of the overall system. Two aspects of human-robot interaction are considered: the ways in which the global view of the system may be conveyed to the operators, and how the operators may influence the behavior of the system during the course of its operation. The results of analysis favor peer-to-peer environment-centric interactions between the operators and the network whereby the humans act as extended sensors and communication nodes of the network itself. Experiments on an indoor active sensor network are described. Y1 - 2003 U6 - https://doi.org/10.1109/CIRA.2003.1222097 VL - 1 SP - 247 EP - 252 ER - TY - CHAP A1 - Kaupp, Tobias A1 - Brooks, Alex A1 - Upcroft, Ben A1 - Makarenko, Alexei T1 - Building a software architecture for a human-robot team using the orca framework T2 - Proceedings 2007 IEEE International Conference on Robotics and Automation N2 - This paper considers the problem of building a software architecture for a human-robot team. The objective of the team is to build a multi-attribute map of the world by performing information fusion. A decentralized approach to information fusion is adopted to achieve the system properties of scalability and survivability. Decentralization imposes constraints on the design of the architecture and its implementation. We show how a component-based software engineering approach can address these constraints. The architecture is implemented using Orca - a component-based software framework for robotic systems. Experimental results from a deployed system comprised of an unmanned air vehicle, a ground vehicle, and two human operators are presented. A section on the lessons learned is included which may be applicable to other distributed systems with complex algorithms. We also compare Orca to the player software framework in the context of distributed systems. Y1 - 2007 U6 - https://doi.org/10.1109/ROBOT.2007.364051 SP - 3736 EP - 3741 PB - IEEE ER - TY - CHAP A1 - Brooks, Alex A1 - Makarenko, Alexei A1 - Kaupp, Tobias A1 - Williams, Stefan A1 - Durrant-Whyte, Hugh F. T1 - Implementation of an indoor active sensor network T2 - 9th International Symposium on Experimental Robotics 2004, Singapore Y1 - 2004 ER - TY - CHAP A1 - Upcroft, Ben A1 - Ridley, Matthew A1 - Ong, Lee Ling A1 - Douillard, Bertrand A1 - Kaupp, Tobias A1 - Kumar, Suresh A1 - Bailey, Tim A1 - Ramos, Fabio A1 - Makarenko, Alexei A1 - Brooks, Alex A1 - Sukkarieh, Salah A1 - Durrant-Whyte, Hugh F. T1 - Multilevel state estimation in an outdoor decentralised sensor network T2 - 10th International Symposium on Experimental Robotics 2006 (ISER'06), Rio de Janeiro, Brazil Y1 - 2006 ER - TY - CHAP A1 - Wang, X. Rosalind A1 - Kumar, Suresh A1 - Ramos, Fabio A1 - Kaupp, Tobias A1 - Upcroft, Ben A1 - Durrant-Whyte, Hugh T1 - Probabilistic classification of hyperspectral images by learning nonlinear dimensionality reduction mapping T2 - 2006 9th International Conference on Information Fusion Y1 - 2006 SP - 1 EP - 8 ER - TY - CHAP A1 - Makarenko, Alexei A1 - Brooks, Alex A1 - Kaupp, Tobias A1 - Durrant-Whyte, Hugh A1 - Dellaert, Frank T1 - Decentralised data fusion: A graphical model approach T2 - 2009 12th International Conference on Information Fusion Y1 - 2009 SP - 545 EP - 554 ER - TY - CHAP A1 - Makarenko, Alexei A1 - Brooks, Alex A1 - Kaupp, Tobias T1 - Orca: Components for robotics T2 - International Conference on Intelligent Robots and Systems (IROS) - Workshop for Robotic Standardization at IROS'06 N2 - This paper describes Orca: an open-source software project which applies Component-Based Software Engineering principles to robotics. The paper focuses on the technical aspects of the framework which set it apart from other similar efforts. Among them are the adaption of a commercial middleware package, minimalist approach to framework design, and a commitment to multi-language multi-platform support. The paper explains our decision to use Ice -- a relatively recent entry in the field of general-purpose middleware packages. Y1 - 2006 SP - 163 EP - 168 ER - TY - CHAP A1 - Makarenko, Alexei A1 - Brooks, Alex A1 - Kaupp, Tobias T1 - On the benefits of making robotic software frameworks thin T2 - International Conference on Intelligent Robots and Systems - Workshop for Measures and Procedures for the Evaluation of Robot Architectures and Middleware at IROS'07 N2 - Today's reusable robotics software is provided by several self-contained open-source projects with virtually no software reuse between them. Such partitioning leads to problems with software quantity, quality, ease of evaluation and, ultimately, to poor end user experience. By reviewing several of the projects we observe that all of them contain a mix of three types of software: 1) driver and algorithm implementations, 2) communication middleware, and 3) robotic software framework. We show that more than half of the combined code base contains software which could be highly reusable but only a small fraction of it actually is. We argue that formal separation of the three groups in the existing and future software projects would offer several potential advantages. Availability of framework-independent code would enable community-wide library-based software reuse in addition to the existing framework-wide component- based reuse. Another important benefit is related to evaluation procedures. The three software types are very different and should be evaluated separately, using different criteria. The first two types allow quantitative comparisons which are well documented in the literature. The last one is largely qualitative and, therefore, more subjective. Practically, we recommend today's projects to refactor and eject the driver and algorithm implementation code and focus on the task of software integration. Thin frameworks can be numerous, increasing the diversity of options available to robotics practitioners. Finally, we discuss distribution options for the refactored framework-independent code including the option of creating a Common Robotic Project. Y1 - 2007 VL - 2 ER - TY - CHAP A1 - Spieß, Florian A1 - Friesslich, Jonas A1 - Bluemm, Daniel A1 - Mast, Fabio A1 - Vinokour, Dmitrij A1 - Kounev, Samuel A1 - Kaupp, Tobias A1 - Strobel, Norbert T1 - Towards a Mobile Robot Localization Benchmark with Challenging Sensordata in an Industrial Environment T2 - 2021 20th International Conference on Advanced Robotics (ICAR) N2 - To arrive at a realistic assessment of localization methods in terms of their performance in an industrial environment under various challenging conditions, we provide a benchmark to evaluate algorithms both for individual components as well as multi-sensor systems. For several sensor types, including wheel odometry, RGB cameras, RGB-D cameras, and LIDAR, potential issues were identified. The accuracy of wheel odometry, for example, when there are bumps on the track. For each sensor type, we explicitly chose a track for the benchmark dataset containing situations where the sensor fails to provide adequate measurements. Based on the acquired sensor data, localization can be achieved either using a single sensor information or sensor fusion. To help evaluate the output of associated localization algorithms, we provide a software to evaluate a set of metrics as part of the paper. An example application of the benchmark with state-of-the-art algorithms for each sensor is also provided. Y1 - 2021 U6 - https://doi.org/10.1109/ICAR53236.2021.9659355 SP - 857 EP - 864 ER - TY - CHAP A1 - Kaupp, Tobias A1 - Makarenko, Alexei T1 - Measuring human-robot team effectiveness to determine an appropriate autonomy level T2 - 2008 IEEE International Conference on Robotics and Automation N2 - This paper proposes a methodology to measure the effectiveness of a human-robot team as part of an adjustable autonomy system. The effectiveness measure is aimed at determining an appropriate autonomy level prior to the system's deployment. Two competing goals need to be traded off: maximising robot performance while minimising the amount of human input. The relative importance of the two goals depend on the mission priorities and constraints which are taken into account. The proposed methodology is applied to a human-robot communication system developed for task- oriented information exchange. The robot uses a decision- theoretic framework to act autonomously and to decide when to request input from human operators. The latter is achieved by computing the value-of-information an operator is able to provide which is compared to the cost of obtaining the information. For our system, the cost parameter represents the autonomy level to be determined. We demonstrate how an appropriate autonomy level can be found experimentally using a navigation task. In our experiment, the robot navigates through a set of simulated worlds with human input being generated by a software component. The results are used to find appropriate autonomy levels for three example missions and a subsequent user study. Y1 - 2008 U6 - https://doi.org/10.1109/ROBOT.2008.4543524 SP - 2146 EP - 2151 PB - IEEE ER - TY - CHAP A1 - Wang, X. Rosalind A1 - Kumar, Suresh A1 - Kaupp, Tobias A1 - Upcroft, Ben A1 - Durrant-Whyte, Hugh ED - Sammut, C. T1 - Applying ISOMAP to the learning of hyperspectral image T2 - Australian Conference on Robotics and Automation (ACRA’05) N2 - In this paper, we present the application of a non-linear dimensionality reduction technique for the learning and probabilistic classification of hyperspectral image. Hyperspectral image spectroscopy is an emerging technique for geological investigations from airborne or orbital sensors. It gives much greater information content per pixel on the image than a normal colour image. This should greatly help with the autonomous identification of natural and manmade objects in unfamiliar terrains for robotic vehicles. However, the large information content of such data makes interpretation of hyperspectral images time-consuming and userintensive. We propose the use of Isomap, a non-linear manifold learning technique combined with Expectation Maximisation in graphical probabilistic models for learning and classification. Isomap is used to find the underlying manifold of the training data. This low dimensional representation of the hyperspectral data facilitates the learning of a Gaussian Mixture Model representation, whose joint probability distributions can be calculated offline. The learnt model is then applied to the hyperspectral image at runtime and data classification can be performed. Y1 - 2005 UR - https://eprints.qut.edu.au/40436/ SP - 1 EP - 8 ER - TY - CHAP A1 - Kaupp, Tobias A1 - Makarenko, Alexei A1 - Ramos, Fabio A1 - Upcroft, Ben A1 - Williams, Stefan A1 - Durrant-Whyte, Hugh T1 - Adaptive human sensor model in sensor networks T2 - 2005 7th International Conference on Information Fusion N2 - This paper presents the design of a probabilistic model of human perception as an integral part of a decentralized data fusion system. The system consists of a team of human operators and robotic platforms, together forming a heterogeneous sensor network. Human operators are regarded as information sources submitting raw observations. The observations are converted into a probabilistic representation suitable for fusion with the system's belief. The conversion is performed by a human sensor model (HSM). The initial HSM is built offline based on an average of multiple human subjects conducting a calibration experiment. Since individual human operators may vary in their performance, an online adaptation of the HSM is required. The network estimate is used for adaptation because the true feature state is unknown at runtime. Results of an outdoor calibration experiment using range and bearing observations are presented. Simulations show the feasibility of efficient online adaptation. Y1 - 2005 U6 - https://doi.org/10.1109/ICIF.2005.1591929 VL - 1 PB - IEEE ER - TY - CHAP A1 - Kaupp, Tobias A1 - Douillard, Bertrand A1 - Upcroft, Ben A1 - Makarenko, Alexei T1 - Hierarchical environment model for fusing information from human operators and robots T2 - 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems N2 - This paper considers the problem of building environment models by fusing information gathered by robotic platforms with human perceptual information. Rich environment models are required in real applications for both autonomous operation of robots and to support human decision making. Hierarchical models are well suited to represent complex environments because they: offer multiple abstractions of the available information to support analysis and decision-making, and permit the incorporation of higher-level human observations. The contributions of this paper are two-fold: (1) development of a probabilistic three-level environment model for distributed information gathering, and (2) experimental demonstration of fully decentralized, cooperative human-robot information gathering using an outdoor sensor network comprised of an unmanned air vehicle, a ground vehicle, and two human operators. Several information exchange patterns are presented which qualitatively demonstrate human-robot information fusion Y1 - 2006 U6 - https://doi.org/10.1109/IROS.2006.282398 SP - 5837 EP - 5842 PB - IEEE ER - TY - CHAP A1 - Brooks, Alex A1 - Kaupp, Tobias A1 - Makarenko, Alexei T1 - Randomised MPC-based motion-planning for mobile robot obstacle avoidance T2 - 2009 IEEE International Conference on Robotics and Automation N2 - This paper presents an algorithm for real-time sensor-based motion planning under kinodynamic constraints, in unknown environments. The objective of the trajectory-generation algorithm is to optimise a cost function out to a limited time horizon. The space of control trajectories is searched by expanding a tree using randomised sampling, in a manner similar to an RRT. The algorithm is improved by seeding the tree using the best control trajectory from the previous iteration, and by pruning branches based on a bound to the cost function and the best trajectory found so far. Performance of the algorithm is analysed in simulation. In addition, the algorithm has been implemented on two kinds of vehicles: the Segway RMP and a four-wheel-drive. The algorithm has been used to drive autonomously for a combined total on the order of hundreds of hours. Y1 - 2009 U6 - https://doi.org/10.1109/ROBOT.2009.5152240 SP - 3962 EP - 3967 ER - TY - CHAP A1 - Kaupp, Tobias A1 - Makarenko, Alexei A1 - Kumar, Suresh A1 - Upcroft, Ben A1 - Williams, Stefan T1 - Operators as information sources in sensor networks T2 - 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems N2 - This paper presents an approach of integrating human operators into a sensor network formed by a heterogeneous team of unmanned air and ground vehicles. Several objectives of human-network interaction are identified. The main focus of this work is on human-to-network information flow, i.e. human operators are regarded as information sources. It is argued that operators should make raw observations which are converted into the sensor network's common representation by a probabilistic model. The concepts are discussed in the context of an outdoor sensor network under development. Human operators contribute geometric feature information in the form of range and bearing observations. Visual feature properties are specified via meaningful class labels. A sensor model, represented as a Bayesian network, translates label observations into the system's representation. The model is also used to classify features as observed by robotic sensors. Y1 - 2005 U6 - https://doi.org/10.1109/IROS.2005.1545015 SP - 936 EP - 941 PB - IEEE ER - TY - CHAP A1 - Brooks, Alex A1 - Kaupp, Tobias A1 - Makarenko, Alexei A1 - Williams, Stefan A1 - Oreback, Anders T1 - Towards component-based robotics T2 - 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems N2 - This paper gives an overview of component-based software engineering (CBSE), motivates its application to the field of mobile robotics, and proposes a particular component model. CBSE is an approach to system-building that aims to shift the emphasis from programming to composing systems from a mixture of off-the-shelf and custom-built software components. This paper argues that robotics is particularly well-suited for and in need of component-based ideas. Furthermore, now is the right time for their introduction. The paper introduces Orca - an open-source component-based software engineering framework proposed for mobile robotics with an associated repository of free, reusable components for building mobile robotic systems. Y1 - 2005 UR - https://www.researchgate.net/publication/224623500_Towards_component-based_robotics SP - 163 EP - 168 ER - TY - JOUR A1 - Kaupp, Tobias A1 - Douillard, Bertrand A1 - Ramos, Fabio A1 - Makarenko, Alexei A1 - Upcroft, Ben T1 - Shared environment representation for a human-robot team performing information fusion JF - Journal of Field Robotics: Special Issue on Teamwork N2 - This paper addresses the problem of building a shared environment representation by a human-robot team. Rich environment models are required in real applications for both autonomous operation of robots and to support human decision-making. Two probabilistic models are used to describe outdoor environment features such as trees: geometric (position in the world) and visual. The visual representation is used to improve data association and to classify features. Both models are able to incorporate observations from robotic platforms and human operators. Physically, humans and robots form a heterogeneous sensor network. In our experiments, the human-robot team consists of an unmanned air vehicle, a ground vehicle, and two human operators. They are deployed for an information gathering task and perform information fusion cooperatively. All aspects of the system including the fusion algorithms are fully decentralized. Experimental results are presented in form of the acquired multi-attribute feature map, information exchange patterns demonstrating human-robot information fusion, and quantitative model evaluation. Learned lessons from deploying the system in the field are also presented. © 2007 Wiley Periodicals, Inc. Y1 - 2007 U6 - https://doi.org/10.1002/rob.20201 VL - 24 IS - 11-12 SP - 911 EP - 942 ER - TY - CHAP A1 - Durrant-Whyte, Hugh A1 - Sukkarieh, Salah A1 - Ramos, Fabio A1 - Bailey, Tim A1 - Kumar, Suresh A1 - Ong, Lee-Ling A1 - Ridley, Matthew A1 - Kaupp, Tobias A1 - Douillard, Bertrand A1 - Upcroft, Ben T1 - Non-gaussian state estimation in an outdoor decentralised sensor network T2 - Proceedings of the 45th IEEE Conference on Decision and Control N2 - This paper presents the development and demonstration of non-Gaussian, decentralised state estimation using an outdoor sensor network consisting of an autonomous air vehicle, a manual ground vehicle, and two human operators. The location and appearance of landmarks were estimated using bearing only observations from monocular cameras. We show that inclusion of visual and identity information aids validation gating for data association when geometric information alone cannot discriminate individual landmarks. The combination of geometric, appearance, and identity information provided a common description (or map) of natural features for each of the nodes in the network. We also show the final map from the live demonstration which includes position estimates and classification labels of the observed features. Y1 - 2006 U6 - https://doi.org/10.1109/CDC.2006.377533 SP - 366 EP - 372 PB - IEEE CY - Piscataway ER - TY - JOUR A1 - Makarenko, Alexei A. A1 - Kaupp, Tobias A1 - Durrant-Whyte, Hugh F. T1 - Scalable human-robot interactions in active sensor networks JF - IEEE Pervasive Computing N2 - Decentralized sensor networks promise virtually unlimited scalability and can tolerate individual component failures. Interaction with human operators plays an important role in the overall system design. The authors describe an experimental active sensor network and identify modes of human-robot interaction that keep up with the network's arbitrary growth. Y1 - 2003 U6 - https://doi.org/10.1109/MPRV.2003.1251170 VL - 2 IS - 4 SP - 63 EP - 71 ER - TY - JOUR A1 - Spiess, Florian A1 - Friesslich, Jonas A1 - Kaupp, Tobias A1 - Kounev, Samuel A1 - Strobel, Norbert T1 - Survey and Experimental Comparison of RGB-D Indoor Robot Navigation Methods Supported by ROS and Their Expansion via Fusion with Wheel Odometry and IMU Data JF - International Journal of Mechanical Engineering and Robotics Research Y1 - 2020 U6 - https://doi.org/10.18178/ijmerr.9.12.1532-1540 VL - 9 IS - 12 SP - 1532 EP - 1540 ER - TY - JOUR A1 - Kaupp, Tobias A1 - Makarenko, Alexei A1 - Durrant-Whyte, Hugh T1 - Human–robot communication for collaborative decision making - A probabilistic approach JF - Robotics and Autonomous Systems N2 - Humans and robots need to exchange information if the objective is to achieve a task collaboratively. Two questions are considered in this paper: what and when to communicate. To answer these questions, we developed a human–robot communication framework which makes use of common probabilistic robotics representations. The data stored in the representation determines what to communicate, and probabilistic inference mechanisms determine when to communicate. One application domain of the framework is collaborative human–robot decision making: robots use decision theory to select actions based on perceptual information gathered from their sensors and human operators. In this paper, operators are regarded as remotely located, valuable information sources which need to be managed carefully. Robots decide when to query operators using Value-Of-Information theory, i.e. humans are only queried if the expected benefit of their observation exceeds the cost of obtaining it. This can be seen as a mechanism for adjustable autonomy whereby adjustments are triggered at run-time based on the uncertainty in the robots’ beliefs related to their task. This semi-autonomous system is demonstrated using a navigation task and evaluated by a user study. Participants navigated a robot in simulation using the proposed system and via classical teleoperation. Results show that our system has a number of advantages over teleoperation with respect to performance, operator workload, usability, and the users’ perception of the robot. We also show that despite these advantages, teleoperation may still be a preferable driving mode depending on the mission priorities. Y1 - 2010 U6 - https://doi.org/10.1016/j.robot.2010.02.003 VL - 5 IS - 58 SP - 444 EP - 456 ER - TY - CHAP A1 - Grocholsky, Ben A1 - Makarenko, Alexei A1 - Kaupp, Tobias A1 - Durrant-Whyte, Hugh F. ED - Zhao, Feng ED - Guibas, Leonidas T1 - Scalable control of decentralised sensor platforms T2 - Information Processing in Sensor Networks ; Lecture Notes in Computer Science (LNCS, Volume 2634) N2 - This paper describes an information-theoretic approach to decentralised and coordinated control of multi-robot sensor systems. It builds on techniques long established for the related problem of Decentralised Data Fusion (DDF). The DDF architecture uses information measures to communicate state estimates in a network of sensors. For coordinated control of robot sensors, the control objective becomes maximisation of these information measures. A decentralised coordinated control architecture is presented. The approach taken seeks to achieve scalable solutions that maintain consistent probabalistic sensor fusion and payoff formulations. It inherits the many benefits of the DDF method including scalability, seamless handling of sub-system activation and deactivation, and interoperability among heterogeneous units. These features are demonstrated through application to practical multi-feature localisation problems on a team of indoor robots equipped with laser range finders. Y1 - 2003 SN - 978-3-540-02111-7 SN - 978-3-540-36978-3 U6 - https://doi.org/10.1007/3-540-36978-3_7 SP - 96 EP - 112 PB - Springer CY - Berlin, Heidelberg ER - TY - JOUR A1 - Spiess, Florian A1 - Reinhart, Lukas A1 - Strobel, Norbert A1 - Kaupp, Tobias A1 - Kaiser, Dennis A1 - Kounev, Samuel T1 - People detection with depth silhouettes and convolutional neural networks on a mobile robot JF - Journal of Image and Graphics N2 - This paper presents a novel people detection approach for mobile robot applications based on a combination of classical computer vision techniques and a state-of-the-art neural network. Our approach involves an RGB-D camera as an environmental sensor. The depth data is used to extract silhouettes around people. The RGB images are subsequently augmented with this border information before passing it to the neural network. Under challenging lighting conditions, our system was able to outperform the neural network trained on regular RGB data alone by a factor of two. Y1 - 2021 UR - http://www.joig.net/index.php?m=content&c=index&a=show&catid=72&id=277 VL - 9 IS - 4 SP - 135 EP - 139 ER - TY - THES A1 - Kaupp, Tobias T1 - Probabilistic human-robot information fusion N2 - This thesis is concerned with combining the perceptual abilities of mobile robots and human operators to execute tasks cooperatively. It is generally agreed that a synergy of human and robotic skills offers an opportunity to enhance the capabilities of today’s robotic systems, while also increasing their robustness and reliability. Systems which incorporate both human and robotic information sources have the potential to build complex world models, essential for both automated and human decision making. In this work, humans and robots are regarded as equal team members who interact and communicate on a peer-to-peer basis. Human-robot communication is addressed using probabilistic representations common in robotics. While communication can in general be bidirectional, this work focuses primarily on human-to-robot information flow. More specifically, the approach advocated in this thesis is to let robots fuse their sensor observations with observations obtained from human operators. While robotic perception is well-suited for lower level world descriptions such as geometric properties, humans are able to contribute perceptual information on higher abstraction levels. Human input is translated into the machine representation via Human Sensor Models. A common mathematical framework for humans and robots reinforces the notion of true peer-to-peer interaction. Human-robot information fusion is demonstrated in two application domains: (1) scalable information gathering, and (2) cooperative decision making. Scalable information gathering is experimentally demonstrated on a system comprised of a ground vehicle, an unmanned air vehicle, and two human operators in a natural environment. Information from humans and robots was fused in a fully decentralised manner to build a shared environment representation on multiple abstraction levels. Results are presented in the form of information exchange patterns, qualitatively demonstrating the benefits of human-robot information fusion. The second application domain adds decision making to the human-robot task. Rational decisions are made based on the robots’ current beliefs which are generated by fusing human and robotic observations. Since humans are considered a valuable resource in this context, operators are only queried for input when the expected benefit of an observation exceeds the cost of obtaining it. The system can be seen as adjusting its autonomy at run-time based on the uncertainty in the robots’ beliefs. A navigation task is used to demonstrate the adjustable autonomy system experimentally. Results from two experiments are reported: a quantitative evaluation of human-robot team effectiveness, and a user study to compare the system to classical teleoperation. Results show the superiority of the system with respect to performance, operator workload, and usability. Y1 - 2008 UR - http://hdl.handle.net/2123/2554 ER - TY - CHAP A1 - Upcroft, Ben A1 - Ridley, Matthew A1 - Ong, Lee Ling A1 - Douillard, Bertrand A1 - Kaupp, Tobias A1 - Kumar, Suresh A1 - Bailey, Tim A1 - Ramos, Fabio A1 - Makarenko, Alexei A1 - Brooks, Alex A1 - Sukkarieh, Salah A1 - Durrant-Whyte, Hugh F. ED - Khatib, Oussama ED - Kumar, Vijay ED - Rus, Daniela T1 - Multi-level state estimation in an outdoor decentralised sensor network T2 - Experimental Robotics: The 10th International Symposium on Experimental Robotics ; Springer Tracts in Advanced Robotics (STAR, volume 39) N2 - Decentralised estimation of heterogeneous sensors is performed on an outdoor network. Attributes such as position, appearance, and identity represented by non-Gaussian distributions are used in in the fusion process. It is shown here that real-time decentralised data fusion of non-Gaussian estimates can be used to build rich environmental maps. Human operators are also used as additional sensors in the network to complement robotic information. Y1 - 2008 SN - 978-3-540-77456-3 U6 - https://doi.org/10.1007/978-3-540-77457-0_33 SP - 355 EP - 365 PB - Springer CY - Berlin, Heidelberg ER - TY - CHAP A1 - Brooks, Alex A1 - Makarenko, Alexei A1 - Kaupp, Tobias A1 - Williams, Stefan A1 - Durrant-Whyte, Hugh T1 - Implementation of an indoor active sensor network T2 - Experimental Robotics IX: The 9th International Symposium on Experimental Robotics ; Springer Tracts in Advanced Robotics (STAR,volume 21) N2 - This paper describes an indoor Active Sensor Network, focussing on the implementation aspects of the system, including communication and the application framework. To make the system description more tangible we describe the latest in a series of indoor experiments implemented using ASN. The task is to detect and map motion of people (and robots) in an office space using a network of 12 stationary sensors. The network was operational for several days, with individual platform coming on and off line. On several occasions the network consisted of 39 components. The paper includes a section on the lessons learned during the project’s design and development which may be applicable to other heterogeneous distributed systems with data-intensive algorithms. Y1 - 2006 SN - 978-3-540-28816-9 U6 - https://doi.org/10.1007/11552246_38 SP - 397 EP - 406 PB - Springer CY - Berlin, Heidelberg ER - TY - CHAP A1 - Kaupp, Tobias A1 - Makarenko, Alexei A1 - Ramos, Fabio A1 - Durrant-Whyte, Hugh T1 - Human sensor model for range observations T2 - IJCAI Workshop Reasoning with Uncertainty in Robotics (RUR) at IJCAI'05 Y1 - 2005 ER - TY - CHAP A1 - Biggs, Geoffrey A1 - Makarenko, Alexei A1 - Brooks, Alex A1 - Kaupp, Tobias A1 - Moser, Michael T1 - Gearbox: Truly reusable robot software (Poster) T2 - IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2008 Y1 - 2008 ER - TY - BOOK A1 - Kaupp, Tobias T1 - Human-robot collaboration: a probabilistic approach Y1 - 2009 SN - 978-3-6391-2318-0 PB - VDM Verlag CY - Saarbrücken ER - TY - CHAP A1 - Brooks, Alex A1 - Kaupp, Tobias A1 - Makarenko, Alexei A1 - Williams, Stefan A1 - Orebäck, Anders ED - Brugali, Davide T1 - Orca: A component model and repository T2 - Software engineering for experimental robotics ; Springer Tracts in Advanced Robotics (STAR,volume 30) N2 - This Chapter describes Orca: an open-source project which applies Component-Based Software Engineering principles to robotics. It provides the means for defining and implementing interfaces such that components developed independently are likely to be inter-operable. In addition it provides a repository of free re-useable components. Orca attempts to be widely applicable by imposing minimal design constraints. This Chapter describes lessons learned while using Orca and steps taken to improve the framework based on those lessons. Improvements revolve around middleware issues and the problems encountered while scaling to larger distributed systems. Results are presented from systems that were implemented. Y1 - 2007 SN - 978-3-540-68949-2 U6 - https://doi.org/10.1007/978-3-540-68951-5_13 SP - 231 EP - 251 PB - Springer CY - Berlin, Heidelberg ER - TY - CHAP A1 - Spiess, Florian A1 - Strobel, Norbert A1 - Kaupp, Tobias A1 - Kounev, Samuel T1 - A data-driven Sensor Model for LIDAR Range Measurements used for Mobile Robot Navigation T2 - 2022 Sixth IEEE International Conference on Robotic Computing (IRC) N2 - In this paper, an analysis of the precision of LIDAR range measurements is presented. LIDAR data from two different sensors (HLS-LFCD-LDS and SICK TIM561) were analyzed regarding the influence of range, incident angle to the surface, and material. Based on the results, a data-driven model for LIDAR precision behavior was developed, and a comparison with standard deviation models based on the vendor-provided specifications was presented. Our model can be used to create realistic sensor simulations and to develop robot navigation algorithms weighing sensor range readings based on the precision. Y1 - 2022 U6 - https://doi.org/10.1109/IRC55401.2022.00020 SP - 76 EP - 80 ER - TY - CHAP A1 - Endres, Felix A1 - Reinhart, Lukas A1 - Kaupp, Tobias A1 - Willert, Volker T1 - Perspektiveninvariante Inferenz von Eckpunkten in Packmustern von Kartonagen T2 - FORUM BILDVERARBEITUNG 2022 IMAGE PROCESSING FORUM 2022 Y1 - 2022 SP - 201 EP - 201 ER - TY - JOUR A1 - Brooks, Alex A1 - Kaupp, Tobias A1 - Makarenko, A. A1 - Williams, S. A1 - Oreback, A. T1 - Software Engineering for Experimental Robotics JF - Springer Tracts Series in Advanced Robotics Y1 - 2007 VL - 30 SP - 231 EP - 251 PB - Springer CY - Berlin ER - TY - CHAP A1 - Endres, Felix A1 - Reinhart, Lukas A1 - Kaupp, Tobias A1 - Willert, Volker T1 - Perspective Invariant Inference of Corner Points in Packing Patterns of Cardboard Boxes T2 - Proceedings of Image Processing Forum 2022, 24. - 25. Nov. 2022 Y1 - 2022 SP - 201 EP - 213 ER - TY - CHAP A1 - Kaupp, Tobias T1 - NEWHRI: Unifying characteristics of research in human-robot interaction T2 - NEWHRI workshop at ICRA'08 Y1 - 2008 UR - https://www.researchgate.net/profile/Xavier-Giralt/publication/232746634_Robot_Behaviour_Models_in_Human_Robot_Interaction/links/09e4150938e9d48d7b000000/Robot-Behaviour-Models-in-Human-Robot-Interaction.pdf ER - TY - CHAP A1 - Wang, X. Rosalind A1 - Kumar, Suresh A1 - Ramos, Fabio A1 - Kaupp, Tobias A1 - Upcroft, Ben A1 - Durrant-Whyte, Hugh F. T1 - Learning in hyperspectral images using a nonlinear dimensionality reduction technique T2 - 9th International Conference on Information Fusion (Fusion 2006), Florence, Italy Y1 - 2006 ER - TY - CHAP A1 - Reinhart, Lukas A1 - Endres, Felix A1 - Kaupp, Tobias A1 - Willert, Volker T1 - Augmented Virtuality zur Erkennung semi-künstlicher Bilddaten T2 - Poster Session des Forums Bildverarbeitung, 24. - 25. Nov. 2022, Karlsruhe Y1 - 2022 ER - TY - JOUR A1 - Spiess, Florian A1 - Strobel, Norbert A1 - Kaupp, Tobias A1 - Kounev, Samuel T1 - A data-driven Model for Range Sensors JF - Encyclopedia with Semantic Computing and Robotic Intelligence Y1 - 2023 UR - https://www.worldscientific.com/doi/abs/10.1142/S2529737623500065?journalCode=escri ER - TY - GEN A1 - Brooks, Alex A1 - Kaupp, Tobias A1 - Makarenko, Alexei T1 - A method of providing a live fire training environment and a moveable target for use therein (Patent) Y1 - 2018 ER - TY - GEN A1 - Brooks, Alex A1 - Kaupp, Tobias A1 - Makarenko, Alexei T1 - Target device for use in a live fire training exercise and method of operating the target device (Patent) Y1 - 2020 ER - TY - GEN A1 - Brooks, Alex A1 - Kaupp, Tobias A1 - Makarenko, Alexei T1 - Systems and methods for arranging firearms training scenarios (Patent) Y1 - 2014 ER - TY - CHAP A1 - Schirmer, Fabian A1 - Kranz, Philipp A1 - Schmitt, Jan A1 - Kaupp, Tobias T1 - Anomaly Detection for Dynamic Human-Robot Assembly: Application of an LSTM-based autoencoder to interpret uncertain human behavior in HRC T2 - Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction Y1 - 2023 U6 - https://doi.org/10.1145/3568294.3580100 SP - 881 EP - 883 ER - TY - JOUR A1 - Kaupp, Tobias A1 - Schmitt, Jan A1 - Hillenbrand, Andreas A1 - Kranz, Philipp T1 - Das hybride Team: ein Leitfaden zur systematischen Planung von assistierten, kollaborativen Mensch-Roboter-Arbeitsplätzen in der Montage JF - FHWS Science Journal N2 - Im Zuge der fortschreitenden Globalisierung und zunehmenden Digitalisierung der Arbeitswelt, ergeben sich gerade für kleine und mittelständische Unternehmen Herausforderungen im Bereich der Produktion und insbesondere in der Montage. Steigende Komplexität der Produkte, kürzer werdende Produktlebenszyklen bei kleinen Losgrößen mit hoher Variantenvielfalt und großem Wettbewerbsdruck zwingen Unternehmen bereits vorhandene Montagestrategien zu überarbeiten. Gerade bei komplexeren Baugruppen ist eine Hochautomatisierung der Montage in der Serienfertigung aufgrund der Produktstruktur nur schwer realisierbar und oftmals nicht wirtschaftlich. In der industriellen Produktion ist ein klarer Trend von der Massenproduktion hin zur »Massenspezialanfertigung« zu erkennen. Die Leistungsfähigkeit eines Industriebetriebes hängt entscheidend von den angewandten Produktionsverfahren, den eingesetzten Produktionsmitteln und der eingeführten Produktionsorganisation ab. Aber auch das Zusammenspiel von Mensch, Organisation und Technik trägt dazu bei Potenziale für den Erfolg eines Unternehmens auszuschöpfen. Aufgrund sich ständig ändernder Marktbedingungen und der kostengünstigen Herstellung von Produkten in Niedriglohnländern bei gleichzeitig steigendem Qualitätsniveau müssen Produktionsstrukturen ständig neu überdacht und weiterentwickelt werden. Die Montage ist im Vergleich zur klassischen Fertigung (wie z.B. Drehen, Fräsen oder Schleifen) ein eher niedrig automatisierter Bereich der industriellen Produktion, indem allerdings eine hohe Wertschöpfung am Produkt stattfindet. Die manuelle Montage ist daher auch zukünftig ein wichtiger Bestandteil der industriellen Produktion. Um am Markt bestehen zu können, müssen Unternehmen nach Möglichkeiten suchen, um manuelle Arbeit produktiver und damit kosteneffizienter zu gestalten ohne dabei Abstriche bei der Qualität hinzunehmen. Zur Unterstützung manueller Tätigkeiten sind in den vergangenen Jahren verschiedene Innovationen in den Fokus der Unternehmen gerückt. Das Ziel muss es sein, den (Montage-)Standort Deutschland durch innovative Konzepte wie kollaborative Mensch-Roboter-Arbeitsplätze zu sichern. KW - mensch-roboter KW - montage KW - arbeitsplatz Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:863-opus-19972 UR - https://nbn-resolving.org/urn:nbn:de:bvb:863-opus-19389 SN - 2196-6095 VL - 5 IS - 2 SP - 12 EP - 72 ER - TY - JOUR A1 - Kaupp, Tobias T1 - Lehre, Forschung und Transfer am Beispiel der Robotik BT - vom RoboCup@Work zur autonomen Warenkommissionierung JF - FHWS Science Journal N2 - Das IDEE ist mit vier Forschungsprofessoren besetzt, die durch eine Lehrentlastung Freiräume für den Auf- und Ausbau von interdisziplinären Forschungsaktivitäten nutzen können. Das Center Robotik (CERI) ist eines der Aufgabengebiete des IDEEs mit den beiden Schwerpunkten »Robotergestützte Arbeitsplätze der Zukunft« sowie »Intralogistik in der Smart Factory«. Dieser Artikel beschäftigt sich mit dem zweiten Schwerpunkt. Anhand der CERI Aktivitäten im Bereich der fahrerlosen Transportsysteme wird aufgezeigt, wie der »Dreiklang« Forschung, Lehre und Transfer in der Praxis umgesetzt wird und die drei Bestandteile sich gegenseitig befruchten können. KW - robotik Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:863-opus-20065 UR - https://nbn-resolving.org/urn:nbn:de:bvb:863-opus-19389 SN - 2196-6095 VL - 5 IS - 2 SP - 109 EP - 116 ER - TY - CHAP A1 - Schmitt, Jan A1 - Hillenbrand, Andreas A1 - Kranz, Philipp A1 - Kaupp, Tobias T1 - Assisted human-robot-interaction for industrial assembly: Application of spatial augmented reality (sar) for collaborative assembly tasks T2 - Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction Y1 - 2021 SP - 52 EP - 56 ER - TY - CHAP A1 - Schmitt, Jan A1 - Kranz, Philipp A1 - Hillenbrand, Andreas A1 - Kaupp, Tobias T1 - Assisted human-robot-interaction for industrial assembly: Video to assisted human-robot-interaction for industrial assembly T2 - Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction Y1 - 2021 SP - 665 EP - 667 ER - TY - CHAP A1 - Miller, Eddi A1 - Kaupp, Tobias A1 - Schmitt, Jan ED - Kohl, Holger ED - Seliger, Günther ED - Dietrich, Franz T1 - Cascaded Scheduling for Highly Autonomous Production Cells with AGVs T2 - Manufacturing Driving Circular Economy: Proceedings of the 18th Global Conference on Sustainable Manufacturing, October 5-7, 2022, Berlin ; Lecture Notes in Mechanical Engineering N2 - Highly autonomous production cells are a crucial part of manufacturing systems in industry 4.0 and can contribute to a sustainable value-adding process. To realize a high degree of autonomy in production cells with an industrial robot and a machine tool, an experimental approach was carried out to deal with numerous challenges on various automation levels. One crucial aspect is the scheduling problem of tasks for each resource (machine tool, tools, robot, AGV) depending on various data needed for a job-shop scheduling algorithm. The findings show that the necessary data has to be derived from different automation levels in a company: horizontally from ERP to shop-floor, vertically from the order handling department to the maintenance department. Utilizing that data, the contribution provides a cascaded scheduling approach for machine tool jobs as well as CNC and robot tasks for highly autonomous production cells supplied by AGVs. Y1 - 2023 SN - 978-3-031-28838-8 SN - 978-3-031-28839-5 U6 - https://doi.org/https://doi.org/10.1007/978-3-031-28839-5_43 SP - 383 EP - 390 PB - Springer CY - Cham ER - TY - CHAP A1 - Vogler, N. A1 - Kaupp, Tobias A1 - Schmitt, Jan A1 - Antelmann, H. T1 - Maturity level models for the evaluation of the digitalization progress of assembly-intensive production processes T2 - German Assembly Engineering 2019 Y1 - 2019 ER - TY - JOUR A1 - Miller, Eddi A1 - Engelmann, Bastian A1 - Kaupp, Tobias A1 - Schmitt, Jan T1 - Advanced Cascaded Scheduling for Highly Autonomous Production Cells with Material Flow and Tool Lifetime Consideration using AGVs JF - Journal of Machine Engineering Y1 - 2023 UR - https://doi.org/10.36897/jme/171749 SN - 2391-8071 ER -