U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

PUBLICATIONS

Exact Tile-Based Segmentation Inference for Images Larger than GPU Memory

Published

Author(s)

Michael P. Majurski, Peter Bajcsy

Abstract

We address the problem of performing exact (tiling-error free) out-of-core semantic segmentation inference of arbitrarily large images using fully convolutional neural networks (FCN). FCN models have the property that once a model is trained, it can be applied on arbitrarily sized images, although it is still constrained by the available GPU memory. This work is motivated by overcoming the GPU memory size constraint without numerically impacting the fnal result. Our approach is to select a tile size that will ft into GPU memory with a halo border of half the network receptive feld. Next, stride across the image by that tile size without the halo. The input tile halos will overlap, while the output tiles join exactly at the seams. Such an approach enables inference to be performed on whole slide microscopy images, such as those generated by a slide scanner. The novelty of this work is in documenting the formulas for determining tile size and stride and then validating them on U-Net and FC-DenseNet architectures. In addition, we quantify the errors due to tiling confgurations which do not satisfy the constraints, and we explore the use of architecture effective receptive felds to estimate the tiling parameters.
Citation
Journal of Research (NIST JRES) -
Volume
126
NIST Pub Series
Journal of Research (NIST JRES)
Pub Type
NIST Pubs

Download Paper

https://doi.org/10.6028/jres.126.009
Local Download

Keywords

artificial intelligence, convolutional neural networks, effective receptive field, out-of-core processing, semantic segmentation
Artificial intelligence

Citation

Majurski, M. and Bajcsy, P. (2021), Exact Tile-Based Segmentation Inference for Images Larger than GPU Memory, Journal of Research (NIST JRES), National Institute of Standards and Technology, Gaithersburg, MD, [online], https://doi.org/10.6028/jres.126.009, https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=928719 (Accessed April 30, 2024)

Created June 3, 2021