National Institute of Standards and Technology
About ISD
ISD home About ISD ISD Research Areas ISD's Products and Services What's New in ISD Search ISD Manufacturing Engineering Laboratory

Meetings and Events

No on-site registrations will be accepted for any conference held on NIST campuses and all attendees must be pre-registered. Photo identification must be presented at the main gate to be admitted to the conference. Attendees must wear their conference badge at all times while on the campus.

Quantitative Performance Evaluation of Navigation Solutions for Mobile Robots
Organizers: Raj Madhavan, Chris Scrapper, and Alex Kleiner
Robotics: Science and Systems Conference
Swiss Federal Institute of Technology Zurich
Zurich, Switzerland
June 28th 2008

The development of adaptive and technically capable mobile robots that are able to safely operate in unstructured, dynamic environments is essential to the acceptance of robotic technologies, permitting collaborative operations of man and machine. Currently, there is no way to quantitatively measure the performance of these systems against user­defined requirements; and furthermore, there is no consensus on what objective evaluation procedures need to be followed to deduce the performance of these systems. The lack of reproducible and repeatable test methods have precluded researchers working towards a common goal from exchanging and communicating results, inter­comparing robot performance, and leveraging previous work that could otherwise avoid duplication and expedite technology transfer from the "drawing board" to the field.

The primary focus of this workshop is to bring together what is currently an amorphous research community to define standardized methods for the quantitative evaluation of navigation solutions and robot­generated maps that will enable mobile robots to operate in dynamic unstructured environments. This workshop will seek to develop test methods to classify the performance characteristics of navigation solutions that facilitate the inter­comparison of experimental results. It will also attempt to define a de facto standard testbed for evaluation of navigation solutions that will provide a baseline for comparison and will provide the mechanisms targeting specific aspects of the system, allowing researchers to assess the performance of various systems in different scenarios and environmental conditions. The workshop program consists of a featured presentation, five regular presentations, and will conclude with a panel discussion involving all participants to summarize presented research and to decide future research directions and collaboration. More information on the workshop is available from http://kaspar.informatik.uni-freiburg.de/~rss/.


Performance Metrics for Intelligent Systems 2008 (PerMIS)
August 19-21, 2008

isd-webmaster@cme.nist.gov

Date created: 01/25/2001
Last updated: 04/08/2008

Manufacturing Engineering Laboratory Skip navigation