Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Best Practices for Evaluating Single Nucleotide Variant Calling Methods for Microbial Genomics



Nathanael D. Olson, Steven P. Lund, Rebecca Colman, Jeffery T. Foster, Jason W. Sahl, James M. Schupp, Paul Keim, Jayne B. Morrow, Marc L. Salit, Justin M. Zook


Innovations in sequencing technologies have allowed biologists to make incredible advances in understanding biological systems. As experience grows, researchers increasingly recognize that analyzing the wealth of data provided by these new sequencing platforms requires careful attention to detail for robust results. Thus far, much of the scientific communities’ focus for use in bacterial genomics has been on evaluating genome assembly algorithms and rigorously validating assembly program performance. Missing, however, is a focus on critical evaluation of variant callers for these genomes. Variant calling is essential for comparative genomics as it yields insights into nucleotide level organismal differences. Variant calling is a multistep process with a host of potential error sources that may lead to incorrect variant calls. Identifying and resolving these incorrect calls is critical for bacterial genomics to advance. The goal of this review is to provide guidance on validating algorithms and pipelines used in variant calling for bacterial genomics. First we will provide an overview of the variant calling procedures and the potential sources of error associated with the methods. We will then identify appropriate datasets for use in evaluating algorithms and describe statistical methods for evaluating algorithm performance. As variant calling moves from basic research to the applied setting, standardized methods for performance evaluation and reporting are required; it is our hope that this review provides the groundwork for the development of these standards.
Frontiers in Genetics


Next-generation sequencing, variant calling, single nucleotide variants, indel, and performance metrics


Olson, N. , Lund, S. , Colman, R. , Foster, J. , Sahl, J. , Schupp, J. , Keim, P. , Morrow, J. , Salit, M. and Zook, J. (2015), Best Practices for Evaluating Single Nucleotide Variant Calling Methods for Microbial Genomics, Frontiers in Genetics, [online], (Accessed May 23, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created July 7, 2015, Updated January 27, 2020