Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Proceedings of Defining the State of the Art in Software Security Tools Workshop



Paul E. Black, Elizabeth N. Fong


This proceeding is the result of a workshop held on August 10 and 11, 2005 hosted by the Software Diagnostics and Conformance Testing Division, Information Technology Laboratory, at the National Institute of Standards and Technology. The workshop, Defining the State of the Art in Software Security Tools, is one of a series in the NIST Software Assurance Measurement and Tool Evaluation (SAMATE) project, which is partially funded by DHS to help identify and enhance software security assurance (SSA) tools. The goal of this workshop is to understand the state of the art of SSA tools that detect security flaws and vulnerabilities and develop a standard reference dataset of programs with known flaws. 45 people from outside NIST attended, including representatives from the federal government (NSF, FDA, NSA, DoD and DHS), seven universities, more than a dozen tool vendors and service providers, and many research companies.
Special Publication (NIST SP) - 500-264
Report Number


reference dataset, Software assessment tools, software assurance, software metrics, software security, vulnerability


Black, P. and Fong, E. (2005), Proceedings of Defining the State of the Art in Software Security Tools Workshop, Special Publication (NIST SP), National Institute of Standards and Technology, Gaithersburg, MD, [online],, (Accessed May 27, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created July 31, 2005, Updated October 12, 2021