Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Ellen M. Voorhees (Fed)

NIST Fellow

Ellen Voorhees is a Fellow at the US National Institute of Standards and Technology (NIST).  For most of her tenure at NIST she managed the Text REtrieval Conference (TREC) project, a project that develops the infrastructure required for large-scale evaluation of search engines and other information access technology.  Currently she is examining how best to bring the benefits of large-scale community evaluations to bear on the problems of trustworthy AI. Voorhees' general research focuses on developing and validating appropriate evaluation schemes to measure system effectiveness for diverse user tasks.

Voorhees received a B.Sc. in computer science from the Pennsylvania State University, and M.Sc. and Ph.D. degrees in computer science from Cornell University.  Prior to joining NIST she was a Senior Member of Technical Staff at Siemens Corporate Research in Princeton, NJ where her work on intelligent agents applied to information access resulted in three patents.

Voorhees is a fellow of the ACM, a member of the Association for the Advancement of Artificial Intelligence (AAAI) and the Association for Computational Linguistics (ACL), and has been elected as a fellow of the Washington Academy of Sciences. She has published numerous articles on information retrieval techniques and evaluation methodologies and serves on the review boards of several journals and conferences.



  • Fellow of the ACM
  • Inaugural member of the ACM SIGIR Academy
  • Fellow of the Washington Academy of Science
  • U.S. Department of Commerce Gold Medal Award, 2021
  • U.S. Department of Commerce Bronze Medal Award, 2006
  • Siemens Outstanding Achievement Award, 1990


Using Replicates in Information Retrieval Evaluation

Ellen M. Voorhees, Daniel V. Samarov, Ian M. Soboroff
This paper explores a method for more accurately estimating the main effect of the system in a typical test-collection-based evaluation of information retrieval

Promoting Repeatability Through Open Runs

Ellen M. Voorhees, Shahzad K. Rajput, Ian M. Soboroff
TREC 2015 introduced the concept of ‘Open Runs’ in response to the increasing focus on repeatability of information retrieval experiments. An Open Run is a TREC
Created October 9, 2019, Updated September 7, 2022