Review of Research on the Ground Truth Systems for Evaluating Part Identification Systems

Published

April 23, 2013

Author(s)

Afzal A. Godil, Roger D. Eastman, Tsai H. Hong

Abstract

In this report we discuss different types of potential ground-truth systems that could be used to test part identification systems for manufacturing assembly applications. We discuss four main ways of acquiring ground truth for evaluating part recognition/identification systems: 1) synthetic and physics based simulation, 3) manual annotation or labeling of ground-truth systems, 3) platform- based ground-truth systems, and 4) physically sensed ground-truth systems. We discuss previous efforts and discuss the different physical quantities used for ground-truth systems. In this report, we focus on static parts and the sizes of parts are in the range of 30 cm x 30 cm x 30 cm volume or smaller.

Citation

NIST Interagency/Internal Report (NISTIR) - 7926

Report Number

7926

NIST Pub Series

NIST Interagency/Internal Report (NISTIR)

Pub Type

NIST Pubs

Download Paper

DOI Link

Keywords

Part identification, ground truth, part recognition, manufacturing

Citation

Godil, A. , Eastman, R. and Hong, T. (2013), Review of Research on the Ground Truth Systems for Evaluating Part Identification Systems, NIST Interagency/Internal Report (NISTIR), National Institute of Standards and Technology, Gaithersburg, MD, [online], https://doi.org/10.6028/NIST.IR.7926 (Accessed October 9, 2025)