Information retrieval

News and Updates

Two first responders stand at the open back of an emergency vehicle, looking at a computer screen, with firetrucks in the background.

Spotlight: Gathering Intel From Social Media for Emergency Response

June 30, 2022

When someone needs help, fire departments and ambulance crews need to know what the problem is and where to go ASAP. One answer is to use artificial

Illustration shows magnifying glass over networked icons for digital materials like email, social media, and others.

NIST and OSTP Launch Effort to Improve Search Engines for COVID-19 Research

April 15, 2020

GAITHERSBURG, Md. — Today, the U.S. Department of Commerce’s National Institute of Standards and Technology (NIST) and the White House Office of Science and

NIST Tools for Searching the Coronavirus Dataset

New resources developed by a multidisciplinary team of experts in natural language processing and data curation and discovery allow researchers to get the most

Projects and Programs

A digital object is composed of Data, Metadata, Protocols & Operations, and Persistent Identifiers.

Facilitating the Adoption of the FAIR Digital Object Framework in Material Science

Ongoing

With increasing use of data-driven methodologies, concerns around data discovery, data access, and data interoperability have come to the forefront. Communities

Content-Based Access to Unstructured Information

Ongoing

This project uses community evaluations to build the infrastructure required to evaluate system effectiveness on information access tasks. In particular, the

TREC Video Retrieval Evaluation: TRECVID

Ongoing

Text Analysis Conference

Ongoing

There has been a growing recognition of the importance of community-wide evaluations for research in information technologies. The Text Analysis Conference is a

Publications

Human Preferences as dueling Bandits

July 11, 2022

Author(s)

Xinyi Yan, Chengxi Luo, Charles Clarke, Nick Craswell, Ellen M. Voorhees, Pablo Castells

The dramatic improvements in core information retrieval tasks engendered by neural rankers create a need for novel evaluation methods. If every ranker returns

Too many Relevants: Whither Cranfield Test Collections?

July 11, 2022

Author(s)

Ellen M. Voorhees, Nick Craswell, Jimmy Lin

This paper presents the lessons regarding the construction and use of large Cranfield-style test collections learned from the TREC 2021 Deep Learning track. The

Evaluating Multiple Video Understanding and Retrieval Tasks at TRECVID 2021

June 15, 2022

Author(s)

George Awad, Asad Butt, Keith Curtis, Jonathan G. Fiscus, Afzal A. Godil, Yooyoung Lee, Andrew Delgado, Eliot Godard, Baptiste Chocot, Lukas Diduch, Jeffrey Liu, Yvette Graham, Gareth Jones, Georges Quenot

Overview of TREC 2021

May 6, 2022

Author(s)

Ian Soboroff

TREC 2021 is the thirtieth edition of the Text REtrieval Conference (TREC). The main goal of TREC is to create the evaluation infrastructure required for large

Awards

Ellen Voorhees Wins Ron Brown Excellence in Innovation Award

Dr. Ellen M. Voorhees was announced as the recipient of the Ron Brown Excellence Award in Innovation as part of the 73rd Annual Department