NOTICE: Due to a lapse in annual appropriations, most of this website is not being updated. Learn more.

Form submissions will still be accepted but will not receive responses at this time. Sections of this site for programs using non-appropriated funds (such as NVLAP) or those that are excepted from the shutdown (such as CHIPS and NVD) will continue to be updated.

U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

PUBLICATIONS

An Overview of Issues in Testing Intrusion Detection Systems

Published

Author(s)

Peter M. Mell, R Lippmann, Chung Tong Hu, J Haines, M Zissman

Abstract

While intrusion detection systems are becoming ubiquitous defenses in today's networks, currently we have no comprehensive and scientifically rigorous methodology to test the effectiveness of these systems. This paper explores the types of performance measurements that are desired and that have been used in the past. We review many past evaluations that have been designed to assess these metrics. We also discuss the hurdles that have blocked successful measurements in this area and present suggestions for research directed toward improving our measurement capabilities.
Citation
NIST Interagency/Internal Report (NISTIR) - 7007
Report Number
7007
NIST Pub Series
NIST Interagency/Internal Report (NISTIR)
Pub Type
NIST Pubs

Download Paper

https://doi.org/10.6028/NIST.IR.7007

Keywords

IDS performance measurement methodology, intrusion detection system (IDS), quantitative testing of IDSs
Cybersecurity and privacy

Citation

Mell, P. , Lippmann, R. , , C. , Haines, J. and Zissman, M. (2003), An Overview of Issues in Testing Intrusion Detection Systems, NIST Interagency/Internal Report (NISTIR), National Institute of Standards and Technology, Gaithersburg, MD, [online], https://doi.org/10.6028/NIST.IR.7007 (Accessed October 12, 2025)

Issues

If you have any questions about this publication or are having problems accessing it, please contact [email protected].

Created July 11, 2003, Updated November 10, 2018
Was this page helpful?