Evaluating Systems for Multilingual and Multimodal Information Access

9th Workshop of the Cross-Language Evaluation Forum, CLEF 2008, Aarhus, Denmark, September 17-19, 2008, Revised Selected Papers

  • Carol Peters
  • Thomas Deselaers
  • Nicola Ferro
  • Julio Gonzalo
  • Gareth J. F. Jones
  • Mikko Kurimo
  • Thomas Mandl
  • Anselmo Peñas
  • Vivien Petras
Conference proceedings CLEF 2008

Part of the Lecture Notes in Computer Science book series (LNCS, volume 5706)

Table of contents

  1. Mono and Bilingual QA

    1. Bogdan Sacaleanu, Günter Neumann, Christian Spurk
      Pages 429-437
    2. Rafael Muñoz-Terol, Marcel Puchol-Blasco, María Pardiño, José Manuel Gómez, Sandra Roger, Katia Vila et al.
      Pages 438-441
  2. Answer Validation Exercise (AVE)

    1. Adrian Iftene, Alexandra Balahur
      Pages 448-451
    2. Christine Jacquin, Laura Monceaux, Emmanuel Desmontils
      Pages 452-459
    3. Óscar Ferrández, Rafael Muñoz, Manuel Palomar
      Pages 460-467
    4. Ingo Glöckner
      Pages 468-471
    5. Rui Wang, Günter Neumann
      Pages 472-475
    6. Alberto Téllez-Valero, Antonio Juárez-González, Manuel Montes-y-Gómez, Luis Villaseñor-Pineda
      Pages 476-479
  3. Question Answering on Script Transcription (QAST)

    1. Sophie Rosset, Olivier Galibert, Guillaume Bernard, Eric Bilinski, Gilles Adda
      Pages 480-487
    2. María Pardiño, José M. Gómez, Héctor Llorens, Rafael Muñoz-Terol, Borja Navarro-Colorado, Estela Saquete et al.
      Pages 488-491
  4. Part V: Cross-Language Retrieval in Image Collections (ImageCLEF)

    1. Thomas Arni, Paul Clough, Mark Sanderson, Michael Grubinger
      Pages 500-511
    2. Henning Müller, Jayashree Kalpathy-Cramer, Charles E. Kahn Jr., William Hatt, Steven Bedrick, William Hersh
      Pages 512-522
    3. Thomas Deselaers, Thomas M. Deserno
      Pages 523-530
    4. Thomas Deselaers, Allan Hanbury
      Pages 531-538
    5. Theodora Tsikrika, Jana Kludas
      Pages 539-550
  5. ImageCLEFphoto

    1. Kosuke Yamauchi, Takuya Nomura, Keiko Usui, Yusuke Kamoi, Tomohiro Takagi
      Pages 551-559
    2. Jiayu Tang, Thomas Arni, Mark Sanderson, Paul Clough
      Pages 560-567
    3. Ana García-Serrano, Xaro Benavent, Ruben Granados, José Miguel Goñi-Menoyo
      Pages 568-571
    4. Julio Villena-Román, Sara Lana-Serrano, José Carlos González-Cristóbal
      Pages 572-576
    5. Sabrina Tollari, Marcin Detyniecki, Ali Fakeri-Tabrizi, Christophe Marsala, Massih-Reza Amini, Patrick Gallinari
      Pages 577-584
    6. Sabrina Tollari, Philippe Mulhem, Marin Ferecatu, Hervé Glotin, Marcin Detyniecki, Patrick Gallinari et al.
      Pages 585-592
    7. Miguel Angel García-Cumbreras, Manuel Carlos Díaz-Galiano, María Teresa Martín-Valdivia, L. Alfonso Ureña-López
      Pages 593-596
    8. Sergio Navarro, Miguel Angel García-Cumbreras, Fernando Llopis, Manuel Carlos Díaz-Galiano, Rafael Muñoz, María Teresa Martín-Valdivia et al.
      Pages 597-604
    9. Osama El Demerdash, Leila Kosseim, Sabine Bergler
      Pages 605-611
    10. Neil O’Hare, Peter Wilkins, Cathal Gurrin, Eamonn Newman, Gareth J. F. Jones, Alan F. Smeaton
      Pages 620-627
    11. Ainhoa Llorente, Simon Overell, Haiming Liu, Rui Hu, Adam Rae, Jianhan Zhu et al.
      Pages 632-639
    12. Bálint Daróczy, Zsolt Fekete, Mátyás Brendel, Simon Rácz, András Benczúr, Dávid Siklósi et al.
      Pages 644-651
    13. Masashi Inoue, Piyush Grover
      Pages 661-668
    14. Hugo Jair Escalante, Jesús A. Gonzalez, Carlos A. Hernández, Aurelio López, Manuel Montes, Eduardo Morales et al.
      Pages 669-676
    15. Julien Ah-Pine, Gabriela Csurka, Jean-Michel Renders
      Pages 677-684
    16. Diana Inkpen, Marc Stogaitis, François DeGuire, Muath Alzghool
      Pages 685-690
  6. ImageCLEFmed

    1. Mouna Torjmen, Karen Pinel-Sauvagnat, Mohand Boughanem
      Pages 691-695
    2. Tatiana Tommasi, Francesco Orabona, Barbara Caputo
      Pages 696-703
    3. Loic Maisonnasse, Philippe Mulhem, Eric Gaussier, Jean Pierre Chevallet
      Pages 704-711
    4. Xin Zhou, Julien Gobeill, Henning Müller
      Pages 712-718
    5. Sara Lana-Serrano, Julio Villena-Román, José Carlos González-Cristóbal
      Pages 719-723
    6. Jose L. Delgado, Covadonga Rodrigo, Gonzalo León
      Pages 724-727
    7. Sara Lana-Serrano, Julio Villena-Román, José Carlos González-Cristóbal, José Miguel Goñi-Menoyo
      Pages 728-731
    8. Manuel Carlos Díaz-Galiano, Miguel Angel García-Cumbreras, María Teresa Martín-Valdivia, L. Alfonso Ureña-López, Arturo Montejo-Ráez
      Pages 732-735
    9. Jayashree Kalpathy-Cramer, Steven Bedrick, William Hatt, William Hersh
      Pages 744-751
  7. ImageCLEFWiki

    1. Mouna Torjmen, Karen Pinel-Sauvagnat, Mohand Boughanem
      Pages 756-762
    2. Zhi Zhou, Yonghong Tian, Yuanning Li, Tiejun Huang, Wen Gao
      Pages 763-770

About these proceedings


The ninth campaign of the Cross-Language Evaluation Forum (CLEF) for European languages was held from January to September 2008. There were seven main eval- tion tracks in CLEF 2008 plus two pilot tasks. The aim, as usual, was to test the p- formance of a wide range of multilingual information access (MLIA) systems or s- tem components. This year, 100 groups, mainly but not only from academia, parti- pated in the campaign. Most of the groups were from Europe but there was also a good contingent from North America and Asia plus a few participants from South America and Africa. Full details regarding the design of the tracks, the methodologies used for evaluation, and the results obtained by the participants can be found in the different sections of these proceedings. The results of the CLEF 2008 campaign were presented at a two-and-a-half day workshop held in Aarhus, Denmark, September 17–19, and attended by 150 resear- ers and system developers. The annual workshop, held in conjunction with the European Conference on Digital Libraries, plays an important role by providing the opportunity for all the groups that have participated in the evaluation campaign to get together comparing approaches and exchanging ideas. The schedule of the workshop was divided between plenary track overviews, and parallel, poster and breakout sessions presenting this year’s experiments and discu- ing ideas for the future. There were several invited talks.


Cross-Language Evaluation Forum Wiki answer validation cross-language cross-language queries cross-lingual data mining image retrieval information retrieval machine learning medical images natural language processing semantic analysis video retrieval

Editors and affiliations

  • Carol Peters
    • 1
  • Thomas Deselaers
    • 2
  • Nicola Ferro
    • 3
  • Julio Gonzalo
    • 4
  • Gareth J. F. Jones
    • 5
  • Mikko Kurimo
    • 6
  • Thomas Mandl
    • 7
  • Anselmo Peñas
    • 4
  • Vivien Petras
    • 8
  1. 1.Istituto di Scienza e Tecnologie dell’InformazioneCNRPisaItaly
  2. 2.RWTH Aachen UniversityAachenGermany
  3. 3.University of PaduaPaduaItaly
  4. 4.LSI-UNEDMadridSpain
  5. 5.Dublin City UniversityDublin 9Ireland
  6. 6.Helsinki University of TechnologyEspooFinland
  7. 7.University of HildesheimHildesheimGermany
  8. 8.Humboldt University BerlinGermany

Bibliographic information

  • DOI
  • Copyright Information Springer-Verlag Berlin Heidelberg 2009
  • Publisher Name Springer, Berlin, Heidelberg
  • eBook Packages Computer Science
  • Print ISBN 978-3-642-04446-5
  • Online ISBN 978-3-642-04447-2
  • Series Print ISSN 0302-9743
  • Series Online ISSN 1611-3349
  • Buy this book on publisher's site
Industry Sectors
IT & Software