Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Detection and Segmentation of Manufacturing Defects with Convolutional Neural Networks and Transfer Learning

Published

Author(s)

Max K. Ferguson, Ronay Ak, Yung-Tsun Lee, Kincho H. Law

Abstract

Automatic detection of defects in metal castings is a challenging task, owing to the rare occurrence and variation in appearance of defects. However, automatic defect detection systems can lead to significant increases in final product quality. Convolutional neural networks (CNNs) have shown outstanding performance in both image classification and localization tasks. In this work, a system is proposed for the identification of casting defects in X-ray images, based on the mask region-based CNN architecture. The proposed defect detection system simultaneously performs defect detection and segmentation on input images, making it suitable for a range of defect detection tasks. It is shown that training the network to simultaneously perform defect detection and defect instance segmentation, results in a higher defect detection accuracy than training on defect detection alone. Transfer learning is leveraged to reduce the training data demands and increase the prediction accuracy of the trained model. More specifically, the model is first trained with two large openly-available image datasets before finetuning on a relatively small metal casting X-ray dataset. The accuracy of the trained model exceeds state-of-the art performance on the GDXray Castings dataset and is fast enough to be used in a production setting. The system also performs well on the GDXray Welds dataset. A number of in-depth studies are conducted to explore how transfer learning, multi-task learning, and multi-class learning influence the performance of the trained system.
Citation
The ASTM Journal of Smart and Sustainable Manufacturing
Volume
2
Issue
2018

Keywords

Smart Manufacturing, Transfer Learning, Defect Detection, Casting Defect Detection, Weld Defect Detection, Automated Surface Inspection, Convolutional Neural Networks

Citation

Ferguson, M. , Ak, R. , Lee, Y. and Law, K. (2018), Detection and Segmentation of Manufacturing Defects with Convolutional Neural Networks and Transfer Learning, The ASTM Journal of Smart and Sustainable Manufacturing, [online], https://doi.org/10.1520/SSMS20180033, https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=926369 (Accessed May 20, 2024)

Issues

If you have any questions about this publication or are having problems accessing it, please contact reflib@nist.gov.

Created October 24, 2018, Updated October 12, 2021