Abstract

The Text REtrieval Conferences (TRECs) are a series of workshops that encourage research in information retrieval from realistic applications by providing large test collections, uniform scoring procedures, and a forum for organizations interested in comparing results. This paper describes the overview of Text Retrieval conferences (TRECs) from 1992 (TREC-1) to 2014 (TREC-23). The goals the judging procedure of TREC are mentioned for understanding the importance & compounds involved in text retrieval in real time applications. A brief comparative report about the methods, number of tracks and the outcomes are presented in this paper so that researchers working or want to work under this domain get an up to date view regarding Text retrieval process and applications.

References

• Harman D., The Text REtrieval Conference (TREC) National Institute of Standards and Technology, Gaithersburg, Md. 20899 USA
• Harman D. (Ed.). (1993). The First Text REtrieval Conference (TREC-1). National Institute of Standards and Technology Special Publication 500-207, Gaithersburg, Md. 20899. Harman, D. (Ed.). (1994a).
• The Second Text Retrieval Conference (TREC-2). National Institute of Standards and Technology Special Publication 500-215, Gaithersburg, Md. 20899.Also a special issue of Information Processing and Management, 31(3) in press.
• Overview of the Third Text Retrieval Conference (TREC-3). National Institute of Standards and Technology Special Publication 500-215, Gaithersburg, Md. 20899.
• D. K. Harman, editor. Proceedings of the Fourth Text REtrieval Conference (TREC- 4), October 1996. NIST Special Publication 500-236.
• Ellen M. Voorhees and Donna Harman. Overview of the fifth Text REtrieval Conference (TREC-5). In E.M. Voorhees and D.K. Harman, editors, Proceedings of the Fifth Text REtrieval Conference (TREC-5), pages 1{28, November 1997. NIST Special Publication 500-238.
• Ellen M. Voorhees and Donna Harman. Overview of the sixth Text REtrieval Conference (TREC-6).In Voorhees and Harman , pages 1{24.NIST Special Publication 500-240.
• Ellen M. Voorhees and Donna Harman. Overview of the seventh Text Retrieval Conference (TREC-7).National Institute of Standards and Technology Gaithersburg, Md. 20899.
• Ellen M. Voorhees and Donna Harman. Overview of the eighth Text REtrieval Conference (TREC-8). In E.M. Voorhees and D.K. Harman, editors, Proceedings of the Eighth Text REtrieval Conference (TREC-8), pages 1–24, 2000. NIST Special Publication 500-246.Electronic version available at http://trec.nist.gov/pubs.html.
• Ellen M. Voorhees and Donna Harman. Overview of the Ninth Text REtrieval Conference (TREC-9).National Institute of Standards and Technology Gaithersburg, Md. 20899.
• Ellen M. Voorhees and Donna Harman.Overview of TREC-2001.National Institute of Standards and Technology Gaithersburg, Md. 20899.
• Ellen M. Voorhees and Donna Harman. Overview of TREC-2002National Institute of Standards and Technology, Gaithersburg, Md. 20899.
• Ellen M. Voorhees and Donna Harman. Overview of TREC-2003National Institute of Standards and Technology, Gaithersburg, Md. 20899.
• Ellen M. Voorhees and Donna Harman. Overview of TREC-2004National Institute of Standards and Technology, Gaithersburg, Md. 20899.
• Ellen M. Voorhees and Donna Harman. Overview of TREC-2005National Institute of Standards and Technology, Gaithersburg, Md. 20899.
• Ellen M. Voorhees and Donna Harman. Overview of TREC-2006National Institute of Standards and Technology, Gaithersburg, Md. 20899.
• Ellen M. Voorhees and Donna Harman. Overview of TREC-2007National Institute of Standards and Technology, Gaithersburg, Md. 20899.
• Craig Macdonald, Iadh Ounis {craigm, ounis}@dcs.gla.ac.uk,,, Ian Soboroff University of Glasgow, Glasgow, UK, Overview of the TREC-2009 Blog Track.
• Chris Buckley, Sabir Research, Stephen Robertson, Microsoft, Relevance Feedback Track Overview: TREC-2008
• Maura R. Grossman, Wachtell, Lipton, Rosen & Katz, New York, NY (USA) Gordon V. Cormack, University of Waterloo, Waterloo, ON (Canada),.Bruce Hedin, H5, San Francisco, CA (USA),Douglas W. Oared, University of Maryland, College Park, MD (USA), Overview of the TREC 2011 Legal Track.
• James Allan, Javed A. Aslam Ben Carterette, Virgil Pavlu, Evangelos Kanoulas, Department of Computer Science, University of Massachusetts Amherst, Amherst, Massachusetts, College of Computer and Information Science, Northeastern University, Boston, Massachusetts, Department of Computer and Information Sciences,University of Delaware, Newark, Delaware,Million Query Track 2008 Overview.
• Ben Carterette, Virgil Pavlu, Hui Fang, EvangelosKanoulas, Million Query Track 2009 Overview.
• Milahi Lupu, John Tait, Jimmy Huang, Jianhan Zhu, October 24, 2010, TREC-CHEM 2010: Notebook report.
• Mihai Lupu, Vienna University of Technology, Vienna, Austria., Zhao Jiashu, Jimmy Huang, Information Retrieval Lab, York University, Toronto, Canada., HarshaGurulingappa, JulianeFluck, Marc Zimmermann, Fraunhofer SCAI, St. Augustin, Germany., Igor Filippov National Institutes of Health, USA., John Tait, johntait.net Ltd, UK, Overview of TREC 2011 Chemical IR Track.
• Charles L.A. Clarke University of Waterloo, Nick Craswell Microsoft, Ion Soboroff NIST, Overview of the TREC 2009 Web Track.
• Nick Craswell, Dennis Fetterly, Marc Najorak Microsoft, Microsoft Research at TREC 2010 Web Track.
• Charles L. A. Clarke, University of Waterloo, Nick Craswell Microsoft, Ian Soboroff NIST Ellen M. Voorhees NIST Overview of the TREC 2011 Web Track
• Charles L. A. Clarke University of Waterloo, Nick Craswell Microsoft, Ellen M. Voorhees NIST, Overview of the TREC 2012 Web Track.
• Kevyn Collins-Thompson University of Michigan, Paul Bennett, Fernando Diaz Microsoft Research, Charles L. A. Clarke University of Waterloo, Ellen M. Voorhees NIST, TREC 2013 Web Track Overview.
• EvangelosKonoulas, Ben Cartette, Paul Clough, Mark Sanderson, Overview of TREC 2010 Session Track.
• Evangelos Kanoulas_ Ben Carterettey Mark Hallz Paul Cloughx Mark Sanderson, Overview of the TREC 2011 Session Track.
• Evangelos Kanoulas, Ben Carterettey Mark Hallz, Paul Clough, Mark Sanderson, Overview of the TREC 2012 Session Track
• Ben Carterette, Evangelos Kanoulas, Mark Hall, Ashraf Bah, and Paul Clough Overview of the TREC 2013 Session Track.
• Ben Carterette, Evangelos Kanoulas, Mark Hall, Ashraf Bah, and Paul Clough Overview of the TREC 2014 Session Track
• Adriel Dean-Hall University of Waterloo, Charles L. A. Clarke University of Waterloo, Jaap Kamps University of Amsterdam, Paul Thomas CSIRO, Ellen Voorhees NIST, Overview of the TREC 2012 Contextual Suggestion Track.
• Adriel Dean-Hall University of Waterloo, Charles L. A. Clarke University of Waterloo, Jaap Kamps University of Amsterdam, Paul Thomas CSIRO, Nicole Simone University of Waterloo, Ellen Voorhees NIST, Overview of the TREC 2013 Contextual Suggestion Track.
• Adriel Dean-Hall, Charles L. A. Clarke University of Waterloo, Paul Thomas CSIRO, Ellen Voorhes NIST Jaap Kamps, University of Amsterdam Overview of the TREC 2014 Contextual Suggestion Track.
• Mark D. Smucker, Department of Management Sciences, University of Waterloo, Gabriella Kazai, Microsoft Research, Cambridge, UK and Matthew Lease School of Information, University of Texas at Austin, Overview of the TREC 2012 Crowdsourcing Track.
• Mark D. Smucker Department of Management Sciences, University of Waterloo, Gabriella Kazai Microsoft Research, Cambridge, UK, and Matthew Lease School of Information,University of Texas at Austin, Overview of the TREC 2013 Crowdsourcing Track.
• Ellen M. Voorhees, National Institute of Standards and Technology, William Hersh Oregon Health & Science University, Overview of the TREC 2012 Medical Records Track.
• Javed Aslam, Fernando Diaz Matthew, Ekstrand-Abueg, Virgi Pavlu and Tetsuya Sakai TREC 2013 Temporal Summarization.
• Javed Aslam, Fernando Diaz Matthew, Ekstrand-Abueg, Virgi Pavlu and Tetsuya Sakai TREC 2014 Temporal Summarization.
• Matthew S. Simpson Lister Hill National Center for Biomedical Communications, U.S. National Library of Medicine, National Institutes of Health, Bethesda, MD, Ellen M. Voorhees, National Institute of Standards and Technology, Gaithersburg, MD, and William Hersh, Department of Medical Informatics and Clinical Epidemiology, Oregon Health & Science University, Portland, Overview of the TREC 2014 Clinical Decision Support Track
• http://trec.nist.gov.