NOTICE: Due to a lapse in annual appropriations, most of this website is not being updated. Learn more.
Form submissions will still be accepted but will not receive responses at this time. Sections of this site for programs using non-appropriated funds (such as NVLAP) or those that are excepted from the shutdown (such as CHIPS and NVD) will continue to be updated.
An official website of the United States government
Here’s how you know
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.
Christopher J. Scrapper Jr, Rajmohan Madhavan, Adam S. Jacoff, R Lakaemper, A Censi, Afzal A. Godil, Asim Wagan
Abstract
Mobile robotic mapping is now considered to be a sufficiently mature field with demonstrated successes in various domains. While there has been much progress made in the development of computationally efficient and consistent mapping schemes, it is still murky at best on how these maps can be evaluated. We are motivated by the absence of an accepted standard for quantitatively measuring the performance of robotic mapping systems against user-defined requirements. It is our belief that the development of standardized methods for quantitatively evaluating existing robotic technologies will improve the utility of mobile robots in already established application areas, such as vacuum cleaning, robot surveillance, and bomb disposal, but will also enable the proliferation and acceptance of such technologies in other emerging markets. This Chapter summarizes our preliminary efforts by bringing together the research community towards addressing this important problem which has ramifications not only from a research perspective but also from consumers', robot manufacturers', and developers' viewpoints.
Citation
Performance Evaluation and Benchmarking of Intelligent Systems
Scrapper, C.
, Madhavan, R.
, Jacoff, A.
, Lakaemper, R.
, Censi, A.
, Godil, A.
and Wagan, A.
(2009),
Quantitative Assessment of Robot-generated Maps, Performance Evaluation and Benchmarking of Intelligent Systems, Springer, Norwell, MA
(Accessed October 9, 2025)