Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Approaches to Training Multi-Class Semantic Image Segmentation of Damage in Concrete



Peter Bajcsy, Steven B. Feldman, Michael P. Majurski, Kenneth A. Snyder, Mary C. Brady


This paper addresses the problem of creating a large quantity of high-quality training image segmentation masks from scanning electron microscopy (SEM) images of concrete samples that exhibit progressive amounts of degradation resulting from alkali-silica reaction (ASR), a leading cause of deterioration, cracking, and loss of capacity in much of the nation’s infrastructure. We approached the SEM segmentation problem by applying Convolutional Neural Network (CNN) based methods to predict the damage classes due to ASR for each image pixel. The target microstructural classes were defined as paste damage, aggregate damage, air voids, and no damage. The challenges in using the CNN-based methods lie in preparing large numbers of high-quality training labeled images while having limited human resources. To address these challenges, we designed damage-assisted and context-assisted approaches for lowering the requirements on human resources. In a damage-assisted approach, we automate a creation of a damage super-class which lowers the manual annotation labor to drawing bounding regions with a computer mouse to subset the damage class into target sub-classes. In a context-assisted approach, we automatically detect a damage super-class together with surrounding contextual classes and then sub-divide the damage super-class into target classes. This approach minimizes the manual annotation labor to image level labeling via a web interactive interface. The evaluations of these two training data sets consists of expert’s time per annotation, pixel-level accuracy and standard deviation of trained CNN models, and image-level accuracy based on visual inspections. We disseminate 4594 raw fields of views (FOVs) with their damage-assisted, context-assisted, and U-Net predicted target microstructural masks within an interactive web-based validation system at
Journal of Microscopy-Oxford


artificial neural network, training data, concrete, scanning electron microscopy


Bajcsy, P. , Feldman, S. , Majurski, M. , Snyder, K. and Brady, M. (2020), Approaches to Training Multi-Class Semantic Image Segmentation of Damage in Concrete, Journal of Microscopy-Oxford, [online], (Accessed April 18, 2024)
Created May 13, 2020, Updated August 24, 2020