Evaluating Systems for Multilingual and Multimodal Information Access

9th Workshop of the Cross-Language Evaluation Forum, CLEF 2008, Aarhus, Denmark, September 17-19, 2008, Revised Selected Papers

  • Carol Peters
  • Thomas Deselaers
  • Nicola Ferro
  • Julio Gonzalo
  • Gareth J. F. Jones
  • Mikko Kurimo
  • Thomas Mandl
  • Anselmo Peñas
  • Vivien Petras
Conference proceedings CLEF 2008

Part of the Lecture Notes in Computer Science book series (LNCS, volume 5706)

Table of contents

  1. ImageCLEFWiki

    1. Adrian Popescu, Hervé Le Borgne, Pierre-Alain Moëllic
      Pages 771-778
    2. Christophe Moulin, Cécile Barat, Mathias Géry, Christophe Ducottet, Christine Largeron
      Pages 779-786
  2. Part VI: Multilingual Web Track (WebCLEF)

    1. Valentin Jijkoun, Maarten de Rijke
      Pages 787-793
    2. Arnold Overwijk, Dong Nguyen, Claudia Hauff, Dolf Trieschnigg, Djoerd Hiemstra, Franciska de Jong
      Pages 794-797
    3. Carlos G. Figuerola, José Luis Alonso Berrocal, Ángel F. Zazo Rodríguez, Montserrat Mateos
      Pages 802-807
  3. Part VII: Cross-Language Geographical Retrieval (GeoCLEF)

    1. Thomas Mandl, Paula Carvalho, Giorgio Maria Di Nunzio, Fredric Gey, Ray R. Larson, Diana Santos et al.
      Pages 808-821
    2. Simon Overell, Adam Rae, Stefan Rüger
      Pages 838-842
    3. Qiang Pu, Daqing He, Qi Li
      Pages 843-850
    4. Johannes Leveling, Sven Hartrumpf
      Pages 851-854
    5. José Manuel Perea-Ortega, L. Alfonso Ureña-López, Manuel García-Vega, Miguel Angel García-Cumbreras
      Pages 855-862
    6. Davide Buscaldi, Paolo Rosso
      Pages 863-866
    7. Davide Buscaldi, José Manuel Perea Ortega, Paolo Rosso, L. Alfonso Ureña López, Daniel Ferrés, Horacio Rodríguez
      Pages 867-874
    8. Esaú Villatoro-Tello, Manuel Montes-y-Gómez, Luis Villaseñor-Pineda
      Pages 875-879
    9. Rui Wang, Günter Neumann
      Pages 880-884
    10. Nuno Cardoso, Patrícia Sousa, Mário J. Silva
      Pages 885-893
    11. Diana Santos, Nuno Cardoso, Paula Carvalho, Iustin Dornescu, Sven Hartrumpf, Johannes Leveling et al.
      Pages 894-905
  4. Part VIII: Cross-Language Video Retrieval (VideoCLEF)

    1. Eamonn Newman, Gareth J. F. Jones
      Pages 923-926
    2. José Manuel Perea-Ortega, Arturo Montejo-Ráez, Manuel Carlos Díaz-Galiano, María Teresa Martín-Valdivia, L. Alfonso Ureña-López
      Pages 927-930
    3. Jens Küsrsten, Daniel Richter, Maximilian Eibl
      Pages 931-934
    4. Jiyin He, Xu Zhang, Wouter Weerkamp, Martha Larson
      Pages 935-938
  5. Part IX: Multilingual Information Filtering (INFILE@CLEF)

    1. Romaric Besançon, Stéphane Chaudiron, Djamel Mostefa, Olivier Hamon, Ismaïl Timimi, Khalid Choukri
      Pages 939-946
    2. Vincent Bodinier, Ali Mustafa Qamar, Eric Gaussier
      Pages 947-950
  6. Part X: Morpho Challenge at CLEF 2008

    1. Mikko Kurimo, Ville Turunen, Matti Varjokallio
      Pages 951-966
    2. Christian Monson, Jaime Carbonell, Alon Lavie, Lori Levin
      Pages 967-974
    3. Oskar Kohonen, Sami Virpioja, Mikaela Klami
      Pages 975-982
    4. Mikko Kurimo, Mathias Creutz, Ville Turunen
      Pages 991-998
  7. Back Matter

About these proceedings


The ninth campaign of the Cross-Language Evaluation Forum (CLEF) for European languages was held from January to September 2008. There were seven main eval- tion tracks in CLEF 2008 plus two pilot tasks. The aim, as usual, was to test the p- formance of a wide range of multilingual information access (MLIA) systems or s- tem components. This year, 100 groups, mainly but not only from academia, parti- pated in the campaign. Most of the groups were from Europe but there was also a good contingent from North America and Asia plus a few participants from South America and Africa. Full details regarding the design of the tracks, the methodologies used for evaluation, and the results obtained by the participants can be found in the different sections of these proceedings. The results of the CLEF 2008 campaign were presented at a two-and-a-half day workshop held in Aarhus, Denmark, September 17–19, and attended by 150 resear- ers and system developers. The annual workshop, held in conjunction with the European Conference on Digital Libraries, plays an important role by providing the opportunity for all the groups that have participated in the evaluation campaign to get together comparing approaches and exchanging ideas. The schedule of the workshop was divided between plenary track overviews, and parallel, poster and breakout sessions presenting this year’s experiments and discu- ing ideas for the future. There were several invited talks.


Cross-Language Evaluation Forum Wiki answer validation cross-language cross-language queries cross-lingual data mining image retrieval information retrieval machine learning medical images natural language processing semantic analysis video retrieval

Editors and affiliations

  • Carol Peters
    • 1
  • Thomas Deselaers
    • 2
  • Nicola Ferro
    • 3
  • Julio Gonzalo
    • 4
  • Gareth J. F. Jones
    • 5
  • Mikko Kurimo
    • 6
  • Thomas Mandl
    • 7
  • Anselmo Peñas
    • 4
  • Vivien Petras
    • 8
  1. 1.Istituto di Scienza e Tecnologie dell’InformazioneCNRPisaItaly
  2. 2.RWTH Aachen UniversityAachenGermany
  3. 3.University of PaduaPaduaItaly
  4. 4.LSI-UNEDMadridSpain
  5. 5.Dublin City UniversityDublin 9Ireland
  6. 6.Helsinki University of TechnologyEspooFinland
  7. 7.University of HildesheimHildesheimGermany
  8. 8.Humboldt University BerlinGermany

Bibliographic information

  • DOI
  • Copyright Information Springer-Verlag Berlin Heidelberg 2009
  • Publisher Name Springer, Berlin, Heidelberg
  • eBook Packages Computer Science
  • Print ISBN 978-3-642-04446-5
  • Online ISBN 978-3-642-04447-2
  • Series Print ISSN 0302-9743
  • Series Online ISSN 1611-3349
  • Buy this book on publisher's site
Industry Sectors
IT & Software