NIST logo

Publication Citation: Overview of the TREC 2007 Blog Track

NIST Authors in Bold

Author(s): Ian M. Soboroff; Craig Macdonald; Iadh Ounis;
Title: Overview of the TREC 2007 Blog Track
Published: December 17, 2008
Abstract: The goal of the Blog track is to explore the information seeking behaviour in the blogosphere. It aims to create the required in- frastructure to facilitate research into the blogosphere and to study retrieval from blogs and other related applied tasks. The track was introduced in 2006 with a main opinion finding task and an open task, which allowed participants the opportunity to influence the determination of a suitable second task for 2007 on other aspects of blogs besides their opinionated nature. As a result, we have created the first blog test collection, namely the TREC Blog06 collection, for adhoc retrieval and opinion finding. TREC 2007 has continued using the Blog06 collection, and saw the addition of a new main task and a new subtask, namely a blog distillation (feed search) task and an opinion polarity subtask re- spectively, along with a second year of the opinion finding task. NIST developed the topics and relevance judgments for the opin- ion finding task, and its polarity subtask. For the blog distillation task, the participating groups created the topics and the associated relevance judgments. This second year of the track has seen an in- creased participation compared to 2006, with 20 groups submitting runs to the opinion finding task, 11 groups submitting runs to the polarity subtask, and 9 groups submitting runs to the blog distil- lation task. This paper provides an overview of each task, sum- marises the obtained results and draws conclusions for the future.
Citation: NIST SP - 500-274
Pages: pp. 17 - 29
Keywords: blog search; evaluation; information retrieval
Research Areas: Data and Informatics
PDF version: PDF Document Click here to retrieve PDF version of paper (191KB)