Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Cell Image Segmentation using Generative Adversarial Networks, Transfer Learning, and Augmentations

Published

Author(s)

Michael P. Majurski, Petru S. Manescu, Sarala Padi, Nicholas J. Schaub, Nathan A. Hotaling, Carl Simon Jr., Peter Bajcsy

Abstract

We address the problem of segmenting cell contours from microscopy images of human induced pluripotent Retinal Pigment Epithelial stem cells (iRPE) using Convolutional Neural Networks (CNN). Our goal is to compare the accuracy gains of CNN-based segmentation by using (1) un-annotated images via Generative Adversarial Networks (GAN), (2) annotated out-of-bio-domain images via transfer learning, and (3) a priori knowledge about microscope imaging mapped into geometric augmentations of a small collection of annotated images. First, the GAN learns an abstract representation of cell objects. Next, this unsupervised learned representation is transferred to the CNN segmentation models which are further fine-tuned on a small number of manually segmented iRPE cell images. Second, transfer learning is applied by pre-training a part of the CNN segmentation model with the COCO dataset containing semantic segmentation labels. The CNN model is then adapted to the iRPE cell domain using a small set of annotated iRPE cell images. Third, augmentations based on geometrical transformations are applied to a small collection of annotated images. All these approaches to training CNN-based segmentation model are compared to a baseline CNN model trained on a small collection of annotated images. For very small annotation counts, the results show accuracy improvements up to 20 % by the best approach in comparison to the accuracy achieved using a baseline U-Net model. For larger annotation counts these approaches asymptotically approach the same accuracy.
Proceedings Title
IEEE International Workshop on Computer Vision for Microscopy Image Analysis
Conference Dates
June 17-21, 2019
Conference Location
Long Beach, CA, US
Conference Title
Computer Vision and Pattern Recognition

Keywords

Segmentation, CNN, GAN, Transfer learning, U-Net

Citation

Majurski, M. , Manescu, P. , Padi, S. , Schaub, N. , Hotaling, N. , Simon Jr., C. and Bajcsy, P. (2019), Cell Image Segmentation using Generative Adversarial Networks, Transfer Learning, and Augmentations, IEEE International Workshop on Computer Vision for Microscopy Image Analysis, Long Beach, CA, US (Accessed June 15, 2024)

Issues

If you have any questions about this publication or are having problems accessing it, please contact reflib@nist.gov.

Created June 16, 2019, Updated October 12, 2021