Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

CLIR Evaluation at TREC



Donna K. Harman, M C. Braschler, M Hess, M Kluck, C Peters, P Schauble, P Sheridan


Starting in 1997, the National Institute of Standards and Technology conducted 3 years of evaluation of cross-language information retrieval systems in the Text REtrieval Conference (TREC). Twenty-two participating systems used topics (test questions) in one language to retrieve documents written in English, French, German, and Italian. A large-scale multilingual test collection has been built and a new technique for building such a collection in a distributed manner was devised.
Cross-Language Evaluation Forum


evaluation, information retrieval, machine translation


Harman, D. , Braschler, M. , Hess, M. , Kluck, M. , Peters, C. , Schauble, P. and Sheridan, P. (2001), CLIR Evaluation at TREC, Cross-Language Evaluation Forum (Accessed July 14, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created January 1, 2001, Updated February 17, 2017