CLEF 2012 Accepted Papers

Benchmarking and Evaluation Initiatives

  • Analysis and Refinement of Cross-lingual Entity Linking, Taylor Cassidy, Heng Ji, Hongbo Deng, Jing Zheng, Jiawei Ha
  • Seven years of INEX interactive retrieval experiments – lessons and challenges, Ragnar Nordlie, and Nils Pharo
  • Bringing the algorithms to the data: cloud-based benchmarking for medical image analysis, Allan Hanbury, Henning Müller, Georg Langs, Marc Andre Weber, Bjoern H. Menze, and Tomas Salas Fernandez (Short paper)
  • Going beyond CLEF-IP: The ’Reality’ for Patent Searchers?, Julia J. Juergens, Preben Hansen, Christa Womser-Hacker (Short paper)
  • MusiClef: Multimodal Music Tagging Task, Nicola Orio, Cynthia C. S. Liem, Geoffroy Peeters, Markus Schedl (Short paper)

Information Access

  • Generating Pseudo Test Collections for Learning to Rank Scientific Articles, Richard Berendsen, Manos Tsagias, Maarten de Rijke, and Edgar Meij
  • Effects of Language and Topic Size in Patent IR: An Empirical Study, Florina Piroi, Mihai Lupu, Allan Hanbury
  • Cross-language High Similarity Search using a Conceptual Thesaurus, Parth Gupta, Alberto Barrón-Cedeño, Paolo Rosso
  • The Appearance of the Giant Component in Descriptor Graphs and Its Application for Descriptor Selection, Anita Keszler, Levente Kovács, Tamas Sziranyi (Short paper)
  • Hidden Markov Model for Term Weighting in Verbose Queries, Xueliang Yan, Guanglai Gao, Xiangdong Su, Hongxi Wei, Xueliang Zhang, and Qianqian Lu (Short paper)

Evaluation Methodologies and Infrastructure

  • DIRECTions: Design and Specification of an IR Evaluation Infrastructure, Maristella Agosti, Emanuele Di Buccio, Nicola Ferro, Ivano Masiero, Simone Peruzzo, Gianmaria Silvello
  • Penalty Functions for Evaluation Measures of Unsegmented Speech Retrieval, Petra Galuscakova, Pavel Pecina, and Jan Hajic
  • Cumulated Relative Position: A Metric for Ranking Evaluation, Marco Angelini, Nicola Ferro, Kalervo Jarvelin, Heikki Keskustalo, Ari Pirkola, Giuseppe Santucci, Gianmaria Silvello
  • Better Than Their Reputation? On the Reliability of Relevance Assessments with Students, Philipp Schaer


  • Comparing IR System Components using Beanplots, Jens Kürsten and Maximilian Eibl
  • Language Independent Query Focused Snippet Generation, Pinaki Bhaskar, and Sivaji Bandyopadhyay
  • A Test Collection to Evaluate Plagiarism by Missing or Incorrect References, Solange de L. Pertile and Viviane P. Moreira