Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Evaluation of Maps using Fixed Shapes: The Fiducial Map Metric

Published

Author(s)

Soren Schwertfeger, Adam S. Jacoff, Christopher Scrapper, Johannes Pellenz, Alexander Kleiner

Abstract

Mapping is an important task for mobile robots. Assessing the quality of those maps is an open topic. A new approach on map evaluation is presented here. It makes use of artificial objects placed in the environment named "Fiducials". Using the known ground-truth positions and the positions of the fiducials identified in the map, a number of quality attributes can be assigned to that map. Depending on the application domain those attributes are weighed to compute a final score. During the 2010 NIST Response Robot Evaluation Exercise at Disaster City an area was populated with fiducials and different mapping runs were performed. The maps generated there are assessed in this paper demonstrating the Fiducial approach. Finally this map scoring algorithm is compared to other approaches found in literature.
Proceedings Title
Proceedings of the 2010 Performance Metrics for Intelligent Systems (PerMIS) Workshop
Conference Dates
September 28-30, 2010
Conference Location
Baltimore, MD

Keywords

Map evaluation, SLAM

Citation

Schwertfeger, S. , Jacoff, A. , Scrapper, C. , Pellenz, J. and Kleiner, A. (2011), Evaluation of Maps using Fixed Shapes: The Fiducial Map Metric, Proceedings of the 2010 Performance Metrics for Intelligent Systems (PerMIS) Workshop, Baltimore, MD, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=906653 (Accessed February 25, 2024)
Created January 31, 2011, Updated February 19, 2017