|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Research We are active in theoretical, social and practical aspects of robotics research. We contribute to domains such as probabilistic state estimaton, planning, model selection, and robot learning. We are also interested in the societal impact and the cultural embedding of robotics as well as applications and system integration. In particular, our group does research in the following areas:
People Detection and Tracking The ability to perceive humans is the first step for robots to become more social. The topic receives a lot of our attention as we observe that existing detection and tracking systems often tend to be robust only in a narrow band of conditions. Striving for higher degrees of robustness, we pursue approaches for probabilistic multi-hypothesis tracking and model selection, supervised and unsupervised learning of people/object detectors and classifiers. 
Multi-Hypothesis People Tracking with Adaptive Occlusion Probabilities and Boosted Detection Features The Multi-Hypothesis Tracker is a statistical approach to integrate data association decisions over time. It generates and rates different explanations of the state of the world, called hypotheses. Each hypothesis is formed by a set of interpretations of measurements as new tracks or false alarms and of tracks as matched with a measurement or obsolete. We extend this approach to include an explicit track occlusion label leading to an adaptable probability of this event. Using a multi-hypothesis leg tracker, it is experimentally shown that this allows the system to better deal with situations of heavy occlusion. For people detection we propose an approach that utilizes a supervised learning technique to create a classifier. Previous approaches have mostly used predefined features and hand-tuned thresholds for this task. In particular, we apply AdaBoost to train a strong classifier from simple features of groups of neighboring beams corresponding to legs in range data. Experimental results illustrate the robustness of this approach even in highly cluttered office environments. Related Publications Arras K.O., Grzonka S., Luber M., Burgard W., "Efficient People Tracking in Laser Range Data using a Multi-Hypothesis Leg-Tracker with Adaptive Occlusion Probabilities", IEEE International Conference on Robotics and Automation (ICRA'08), Pasadena, USA, 2008. pdf | bib Arras K.O., Mozos O.M., Burgard W., "Using Boosted Features for the Detection of People in 2D Range Data", IEEE International Conference on Robotics and Automation (ICRA'07), Rome, Italy, 2007. pdf | bib Videos Leg tracker sequence with hypothesis tree [.mp4, 9.8MB] 
Multi-Model Hypothesis Tracking of Groups of People People in densely populated environments typically form groups that split and merge. In this work we track groups of people so as to reflect this formation process and gain efficiency in situations where maintaining the state of individual people would be intractable. We pose the group tracking problem as a recursive multi-hypothesis model selection problem in which we hypothesize over both, the partitioning of tracks into groups (models) and the association of observations to tracks (assignments). Model hypotheses that include split, merge and continuation events are first generated in a data-driven manner and then validated by means of the assignment probabilities conditioned on the respective model. Experiments with a stationary and a moving platform show that, in populated environments, tracking groups is clearly more efficient than tracking people separately. The system runs in real time on a typical desktop computer. Related Publications Lau B., Arras K.O., Burgard W., "Tracking Groups of People with a Multi-Model Hypothesis Tracker", IEEE International Conference on Robotics and Automation (ICRA'09), Kobe, Japan, 2009. pdf | bib Videos TBD [format, size MB] 
Unsupervised Learning and Classification of Dynamic Objects Robots in the real world share their environment with many dynamic objects such as humans, animals, vehicles, or other robots. The ability to recognize, track and classify such objects is of fundamental importance. As the variability of dynamic objects is large in general, it is hard to predefine suitable models for their appearance and dynamics. In this work, we present an unsupervised learning approach to this model-building problem. We describe an exemplar-based model for representing the time-varying appearance of objects in planar laser scans as well as a clustering procedure that builds a set of object classes from given training sequences. Extensive experiments with real data demonstrate that our system is able to autonomously learn useful models for, e.g., pedestrians, skaters, cyclists without being provided with external class information. Related Publications Luber M., Arras K.O., Plagemann C., Burgard W., "Classifying Dynamic Objects: An Unsupervised Learning Approach", Robotics: Science and Systems (RSS'08), Zurich, Switzerland, 2008. pdf | bib Videos
Tracks of different dynamic objects [.avi, 6.7MB]
Socially Compatible Navigation 
While the problem of SLAM is concerned with the acquisition of a geometrical and topological model of an environment, there is more to this modeling problem, especially when an environment is populated by humans: a social aspect. Robots that share their space with people need a concept of where people do what and at which rate so as to represent and reason about patterns of human activity. To this end, we introduce the spatial affordance map, a multi-layered statistical representation that holds spatio-temporal distributions of activity events. The map is a single representation, usable for a wide range of tasks in populated environments such as people tracking, goal finding, path planning, or interaction. The information stored in the map allows a robot to plan paths that are socially more compatible with the way people use space in an environment. We propose an algorithm for interaction-driven planning to determine paths along which the probability to encounter a person is maximized under time constraints. Using a cost mixture from different activity distributions, the map can further be used to plan cost-optimal paths that account for complex space usage scenarios. Related Publications Mueller J., Stachniss C., Arras K.O., Burgard W., "Socially Inspired Motion Planning for Mobile Robots in Populated Environments", International Conference on Cognitive Systems (CogSys), Karlsruhe, Germany, 2008. pdf | bib
Simultaneous Localization and Mapping The SLAM problem, that is, building a map while simultaneously using that map to self-localize, is considered one of the key challenges for autonomous robots. Our contributions are a novel introspective approach to SLAM and a probabilistically consistent representation of physically extended features. 
Introspective SLAM While SLAM research focuses on the analysis of a class of algorithms and their properties (such as complexity, convergence or consistency), we propose a novel approach to the SLAM problem, namely by introspecting the process itself. We perform an introspective analysis of the filtering approach to SLAM and apply it to a Rao-Blackwellized particle filter. This analysis enables us to derive an approximate filter which is one order of magnitude faster and requires several orders of magnitude less memory. By extending the introspective analysis from a filter perspective to a general one, we further find that the SLAM problem can be decomposed into three main subproblems: the process of building an incremental map, the process of finding global constraints among different parts of the map, and the process of combining local constraints (provided by the incremental mapper) and global constraints (provided by the loop-closure algorithm) to obtain an overall consistent map. We study the three subproblems in detail and provide a solution for all of them. Related Publications Tipaldi G. D., "Looking Inside for Mapping the Outside: Introspective Simultaneous Localization and Mapping", PhD Thesis, University of Rome La Sapienza, Italy, 2009. pdf | bib Censi A. and Tipaldi G.D., "Lazy Localization using the Frozen Time Smoother", IEEE International Conference on Robotics and Automation (ICRA'08), Pasadena, USA, 2008. pdf | bib Tipaldi G.D., Grisetti G., Burgard W., "Approximated Covariance Estimation in Graphical Approaches to SLAM", IEEE/RSJ Int. Conference on Intelligent Robots and Systems (IROS'07), San Diego, USA, 2000. pdf | bib Grisetti G., Tipaldi G.D., Stachniss C., Burgard W., Nardi D., "Fast and Accurate SLAM with Rao-Blackwellized Particle Filters", Robotics and Autonomous Systems, Special Issue on Simultaneous Localization and Map Building, vol. 55, nr. 1, pp. 30-38, 2007. pdf | bib Videos Robot mapping a large-scale environment [.mp4, 21MB] 
Line-Based SLAM SLAM with non-point features, that is, features with a physical extension has received litte attention in the past, despite its relevance for, e.g. indoor environments. One of reasons is the necessity to cope with the representation problem for uncertain geometric entities. This is the question of how to represent such features so that their parameter estimates remain consistent during the SLAM process. Another challenge with non-point features, is the question of how to maintain and update the extension information over the estimation cycle. To address these issues, we first define multi-segment lines as a new feature type for indoor environments that represent an arbitrary number of finite-length segments on the same supporting line. We derive expressions for location-dependent and location-independent geometric constraints of multi-segment lines, and we extend the multi-segment lines concept to general features of physical extension using the SPmodel, a representation approach for uncertain geometric entities. As a result, maps with multi-segment lines are much more compact and consistent in their feature representation than maps with regular segments. As lines give excellent pose orientation estimates, we found that large maps can be built even with simple data association strategies. Related Publications Wulf O., Arras K.O., Christensen H.I., Wagner B., "2D Mapping of Cluttered Indoor Environments by Means of 3D Perception", IEEE International Conference on Robotics and Automation (ICRA'04), New Orleans, USA, 2004. pdf | bib Arras K.O., "Chapter 7: SLAM with Relative Features", in Feature-Based Mobile Robot Navigation in Known and Unknown Environments,, Thèse doctorale Nr. 2765, Swiss Federal Institute of Technology Lausanne (EPFL), June 2003. pdf | bib Martinelli A., Tapus A., Arras K.O., Siegwart R., "Representations and Maps for Real World Navigation", 11th International Symposium of Robotics Research (ISRR'03), Siena, Italy, 2003. bib Wullschleger F.H., Arras K.O., Vestli S.J., "A Flexible Exploration Framework for Map Building", 3rd European Workshop on Advanced Mobile Robots (Eurobot'99), Zurich, Switzerland, Sept. 6-9, 1999. pdf | bib Videos
Bakery data set 1 (raw data) [ani gif, 0.5MB] | Line-based map 1 [ani gif, 200kB]
Robot Localization If efficiency, robustness and accuracy is needed, the feature-based approach to robot localization is still a superb choice. It allows for elegant solutions to both localization problems, pose tracking and global localization. The results of our research in this area has been successfully employed in a large-scale mass exhibition project with over 3,300 km travel distance. The software from this project has been licensed by several companies. 
Global EKF Localization The first one to globally localize a robot, that is, to estimate its pose in a known map without prior knowledge, was Drumheller in 1987. Our research is along the same line of work that relies on a constraint-based search in the interpretation tree. Concretely, we introduce a visibility constraint and a new multi-segment line feature for which we derive expressions for its geometric constraints. Multi-segment lines have particularly strong constraints that help to keep the number of location hypotheses small. For estimation, we pursue a maximum-likelihood multi-hypothesis approach using a mixture of Kalman filters, that, opposed to particle filter approaches, produces exactly as many hypotheses as needed to represent the current level of ambiguity. If, for instance, the robot is uniquely localized, only a single hypothesis needs to be maintained. Once the robot is localized, we further propose a novel multi-hypothesis tracking algorithm that generates location hypotheses locally, bounding the complexity of the constraint-based search to a locality around the hypothesis. As an example result, we were able to globally localize a robot in a highly dynamic mass exhibition environment, within several tens to hundreds of milliseconds on an embedded CPU with a typical positioning accuracy of 1 cm. Related Publications Arras K.O., Castellanos J.A., Schilt M., Siegwart R., "Feature-Based Multi-Hypothesis Localization and Tracking Using Geometric Constraints," Robotics and Autonomous Systems Journal, vol. 44, no. 1, 2003. pdf | bib Arras K.O., "Chapter 5: Global EKF Localization", in Feature-Based Mobile Robot Navigation in Known and Unknown Environments, Chapter 5, Thèse doctorale Nr. 2765, Swiss Federal Institute of Technology Lausanne (EPFL), June 2003. pdf | bib Arras K.O., Philippsen R., Tomatis N., de Battista M., Schilt M., Siegwart R., "A Navigation Framework for Multiple Mobile Robots and its Application at the Expo.02 Exhibition," IEEE International Conference on Robotics and Automation (ICRA'03), Taipei, Taiwan, 2003. pdf | bib Arras K.O., Castellanos J.A., Siegwart R., "Feature-Based Multi-Hypothesis Localization and Tracking for Mobile Robots Using Geometric Constraints," IEEE International Conference on Robotics and Automation (ICRA'02), Washington DC, USA, 2002. pdf | bib Videos Real-time multi-hypothesis localization and tracking, Run 1 [ani gif, 200kB] | Run 2 [ani gif, 0.5MB] 
High-Precision EKF Pose Tracking In our research on Kalman-filter based pose tracking, we worked with different features (lines, segments, beacons, vertical edges) and sensors (laser, vision, laser+vision). For laser data, we presented a novel linear-time line extraction method and derived closed-form expressions for the non-linear regression problem of fitting a line to points in polar coordinates minimizing perpendicular errors from the points onto the line. While the basic principle of Kalman filter-based pose tracking with geometric features was demonstrated in the late eighties, we addressed a number of theoretical and practical issues to make it a mature approach that withstands application-like conditions. This includes physically well-grounded error models for all involved sensors (odometry, laser, vision) and probabilistic extraction algorithms that propagate errors on the raw data level onto the feature parameter level. For the purpose of smooth, continuous multi-sensor localization during motion in real time (called on-the-fly localization), we further addressed the problems of proper sensor data registration using high-resolution timestamps, and, for the laser sensor, compensating the deformation that the vehicle motion imposes on laser scans. The sound approach to error modeling and propagation in combination with our techniques for on-the-fly localization, led to smooth and very precise pose estimates. In extensive experiments over several kilometers in uncontrolled, application-like conditions with different robots and environments, we have achieved a localization cycle time far below 100 ms on embedded PowerPC hardware, and a subcentimeter positioning accuracy Related Publications Arras K.O., Tomatis N., Jensen B., Siegwart R., "Multisensor On-the-Fly Localization: Precision and Reliability for Applications," Robotics and Autonomous Systems, vol. 34, issue 2-3, pp. 131143, February 2001. pdf | bib Arras K.O., Tomatis N., Siegwart R., "Multisensor On-the-Fly Localization Using Laser and Vision", IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'00), Takamatsu, Japan, 2000. pdf | bib Arras K.O., Vestli S.J., "Hybrid, high-precision localisation for the mail distributing mobile robot system MOPS", IEEE International Conference on Robotics and Automation (ICRA'98), Leuven, Belgium, 1998. pdf | bib Arras K.O., Siegwart R., "Feature Extraction and Scene Interpretation for Map-Based Navigation and Map Building", Proceedings of SPIE, vol. 3210, Mobile Robotics XII, pp. 42-53, Pittsburgh, USA, 1997. pdf | bib Videos On-the-fly localization of Pygmalion with the notorious Acuity laser range finder [.mov, 18.7MB]
Do We Want To Share Our Life With Robots? A 2000 People Survey 
There is great optimism that a new generation of robots will soon enter our daily life as personal aids, robot companions, or care-takers for the elderly. They will share our physical and emotional space and will be equipped with social skills, personality and high degrees of autonomy. In light of this development, it is high time to explore and analyze the public opinion on robotics in general and personal robots in particular. We have carried out a large-scale survey with over 2000 participants on the question if people want to share their life with a robot. There is good news for the robotics community: the general attitude towards potential robotic coworkers and flatmates is positive while in some points surprising. We investigate the answering behavior of different age, gender and language groups, find correlations in the data, discuss interpretations, speculate about the answers and finally conclude: Whom are we building robots for and what should they be like? Related Publications Arras K.O., Cerqui D., "Do we want to share our lives and bodies with robots? A 2000 people survey", Technical Report Nr. 0605-001, Autonomous Systems Lab, Swiss Federal Institute of Technology Lausanne (EPFL), June 2005. pdf | bib Cerqui D., Arras K.O., "Human Beings and Robots: Towards a Symbiosis? A 2000 People Survey", International Conference on Socio Political Informatics and Cybernetics (PISTA'03), Orlando, Florida, USA, 2003. pdf | bib
Robots in Exhibitions and Public Spaces The number of robots that are deployed in museums, exhibitions and public places is steadily growing. They mark the emergence of a new application domain of robots that pose for both, the researcher and the exhibition maker, a number of new and fascinating challenges. 
Expo.02 Robotics Exhibition The Robotics pavilion at the Swiss National Exhibition Expo.02 is to this day the biggest deployment of robots in a public space. Eleven fully autonomous robots were interacting with almost 700,000 visitors during a five months period, seven days a week, twelve hours per day. Their tasks included tour guiding, picture taking and entertainment. The research challenges ranged from robust multi-hypothesis localization in highly populated environments, smooth yet fast obstacle avoidance and path planning, multi-robot coordination, multi-modal human-robot interaction, visitor flow management to robot design and system integration. With this large-scale project, we have demonstrated that the deployment of autonomous, freely navigating robots in a mass exhibition is feasible. Related Publications Siegwart R., Arras K.O., Bouabdallah S., Burnier D., Froidevaux G., Greppin X., Jensen B., Lorotte A., Mayor L., Meisser M., Philippsen R., Piguet R., Ramel G., Terrien G., Tomatis N., "Robox at Expo.02: A Large-Scale Installation of Personal Robots ", Robotics and Autonomous Systems, vol. 42, issue 3-4, pp. 203-222, March 2003. pdf | bib Arras K.O., Philippsen R., Tomatis N., de Battista M., Schilt M., Siegwart R., "A Navigation Framework for Multiple Mobile Robots and its Application at the Expo.02 Exhibition," IEEE International Conference on Robotics and Automation (ICRA'03), Taipei, Taiwan, 2003. pdf | bib Tomatis N., Terrien G., Piguet R., Burnier D., Bouabdallah S., Arras K.O., Siegwart R., "Designing a Secure and Robust Mobile Interacting Robot for the Long Term," IEEE International Conference on Robotics and Automation (ICRA'03), Taipei, Taiwan, 2003. pdf | bib Arras K.O., Tomatis N., Siegwart R., "Robox, a Remarkable Mobile Robot for the Real World," Experimental Robotics VIII, Siciliano B. and Dario P. (eds.), Advanced Robotics Series, Springer, 2003. pdf | bib Videos
Robotics @ Expo.02 (on YouTube) |
Scenes from Expo.02 [.mov, 5.7 MB] 
IROS 2002 Workshop on Robots in Exhibitions This full-day workshop focuses on autonomous, socially interactive robots deployed in a public, exhibition-like space. It brings together robotics researchers, practitioners and end-users from diverse backgrounds to discuss past and ongoing projects, recent developments and prospects for the future. The proceedings (see below) contain 14 papers that give a comprehensive overview of the state-of-the-art. More information: Workshop homepage Related Publications Arras K.O., Burgard W. (eds.), "Robots in Exhibitions", IROS 2002 Workshop Proceedings, Lausanne, Switzerland, 2002. pdf [11 MB] | bib
Obstacle Avoidance 
In our research on obstacle avoidance we focus on a combination of sensor-based, reactive methods with local path planning. The former ensures collision freeness under constraints from geometry, kinematics and dynamics while the latter avoids local minima. Our approaches account for polygonal robot shapes where we derive closed-form expressions for the distance to collision problem, avoiding the use of look-up tables. All our approaches have been tested in simulation and on real robots with different shapes, achieving a cycle time of 10 Hz under full load of the embedded CPU. During two long-term experiments, one over 5 km, one over 3,300 km travel distance, the methods demonstrated impressively their performance. Related Publications Arras K.O., Persson J., Tomatis N., Siegwart R., "Real-Time Obstacle Avoidance For Polygonal Robots With A Reduced Dynamic Window," IEEE International Conference on Robotics and Automation (ICRA'02), Washington DC, USA, 2002. pdf | bib Arras K.O., Philippsen R., Tomatis N., de Battista M., Schilt M., Siegwart R., "A Navigation Framework for Multiple Mobile Robots and its Application at the Expo.02 Exhibition," IEEE International Conference on Robotics and Automation (ICRA'03), Taipei, Taiwan, 2003. pdf | bib Videos
On-the-fly replanning around U-shaped obstacle [.mp4, 5.1MB]
Robot Design and Integration 
Robotics is the science that releases machines into the real world full of noise and unpredictable events. This is why extensive experimentation is an integral part of our research practice to validate if a theory withstands these conditions. However, when working with real robots, one faces limitations of the embedded CPU, real-time constraints and system integration aspects. Most commercially available robot platforms and operating systems simply do not meet real-world requirements in the above sense. For this reason, we design platforms by oursevles. We have built several robotic platforms that were used in research and in applications over thousands of kilometers. Our robots are designed as general-purpose multi-axes systems with standard hardware components (VME, cPCI, IP I/O peripherals etc.) made for fully autonomous operation (no uplinks at all) under harsh environmental conditions. All robots run the hard real-time operating system XO/2. This powerful (though exotic) choice allows us, for instance, to run odometry as a periodic real-time task at 1 kHz with timestamps in a resolution of 100 µs. Related Publications Brega R., Tomatis N., Arras K.O., "The Need for Autonomy and Real-Time in Mobile Robotics: A Case Study of XO/2 and Pygmalion", IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'00), Takamatsu, Japan, 2000. pdf | bib Tomatis N., Terrien G., Piguet R., Burnier D., Bouabdallah S., Arras K.O., Siegwart R., "Designing a Secure and Robust Mobile Interacting Robot for the Long Term," IEEE International Conference on Robotics and Automation (ICRA'03), Taipei, Taiwan, 2003. pdf | bib Siegwart R., Arras K.O., Jensen B., Philippsen R., Tomatis N., "Design, Implementation and Exploitation of a New Fully Autonomous Tour Guide Robot," 1st International Workshop on Advances in Service Robotics (ASER'03), Bardolino, Italy, 2003. pdf | bib Tomatis N., Brega R., Arras K.O., Jensen B., Moreau B., Persson J., Siegwart R., "A Complex Mechatronic System: from Design to Application," IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM'01), Como, Italy, 2001. bib
|
||||||||||||||||||||||||||
 |
