Skip to main content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.


The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Accurate and Interpretable Classification of Microspectroscopy Pixels Using Artificial Neural Networks



Petru S. Manescu, Young J. Lee, Charles H. Camp, Marcus T. Cicerone, Mary C. Brady, Peter Bajcsy


This paper addresses the problem of classifying materials from microspectroscopical images at each pixel. The challenges lie in identifying discriminatory spectral features and obtaining accurate and interpretable models relating spectra and class labels. We approach the problem by designing a supervised classifier from a tandem of Artificial Neural Network (ANN) models that identify relevant features in raw spectra and achieve high classification accuracy. The tandem of ANNs models is meshed with classification rule extraction methods to lower the complexity and to achieve interpretability of the resulting model. The novelty of the work is in designing each ANN model based on the microspectroscopical imaging hypothesis about a target class being related to a linear combination of spectra, and in meshing ANN and decision rule models into a tandem configuration to achieve accurate and interpretable classification results. The proposed method was evaluated using a set of broadband coherent anti-Stokes Raman scattering (BCARS) microscopy cell images (600,000 pixel-level spectra) and a reference four-class rule-based model previously created by biochemical experts. The generated classification rule-based model was on average 85% accurate measured by the DICE index over all pixels, and on average 96% similar to the reference rules measured by the vector cosine metric.
Medical Image Analysis


Microspectroscopy, Artificial Neural Networks, BCARS, hyperspectral imaging, rule-based model
Created January 6, 2017, Updated March 17, 2017