This paper examines the challenges involved in conducting and informal usability case study based on the induction of a new information retrieval system to experienced users. We present a summary of activities performed during two iterations of usability testing and describe our analysis methodology. This methodology incorporates several grouping and prioritizing methods which provide one of the major contributions of the work. During the course of the case study, we learned some valuable TREC-specified lessons which led to recommendations for changes in the TREC topic development and assessment tasks. Results of the study include lessons learned about both the users and the testing techniques (Hoffman & Downey, 1997).
Information Processing and Management
information retrieval system, TREC, usability testing, users
and Tice, D.
A Usability Case Study Using TREC and ZPRISE, Information Processing and Management
(Accessed June 5, 2023)