Comparative Evaluation of Multilingual Information Access Systems

4th Workshop of the Cross-Language Evaluation Forum, CLEF 2003, Trondheim, Norway, August 21-22, 2003, Revised Selected Papers

  • Carol Peters
  • Julio Gonzalo
  • Martin Braschler
  • Michael Kluck

Part of the Lecture Notes in Computer Science book series (LNCS, volume 3237)

Table of contents

  1. Part IV. Cross-Language Question Answering

    1. Valentin Jijkoun, Gilad Mishne, Maarten de Rijke
      Pages 523-534
    2. Lucian Vlad Lita, Monica Rogati, Jaime Carbonell
      Pages 535-540
    3. José L. Vicedo, Ruben Izquierdo, Fernando Llopis, Rafael Muñoz
      Pages 541-548
    4. Luc Plamondon, George Foster
      Pages 549-558
    5. Günter Neumann, Bogdan Sacaleanu
      Pages 559-571
    6. Richard F. E. Sutcliffe, Igal Gabbay, Aoife O’Gorman
      Pages 572-580
  2. Part V. Cross-Language Image Retrieval

    1. Paul Clough, Mark Sanderson
      Pages 581-593
    2. Paul Clough, Mark Sanderson
      Pages 594-610
    3. Wen-Cheng Lin, Changhua Yang, Hsin-Hsi Chen
      Pages 611-620
    4. Julio Villena, José L. Martínez, Jorge Fombella, Ana G. Serrano, Alberto Ruiz, Paloma Martínez et al.
      Pages 621-630
    5. Bogdan Vrusias, Mariam Tariq, Lee Gillam
      Pages 631-645
  3. Part VI. Cross-Language Spoken Document Retrieval

    1. Marcello Federico, Gareth J. F. Jones
      Pages 646-652
    2. Gareth J. F. Jones, Adenike Lam-Adesina
      Pages 653-657
    3. Paul McNamee, James Mayfield
      Pages 658-663
    4. Fernando Llopis, Patricio Martínez-Barco
      Pages 664-671
    5. Nicola Bertoldi, Marcello Federico
      Pages 672-675
  4. Back Matter

About these proceedings


The fourth campaign of the Cross-language Evaluation Forum (CLEF) for European languages was held from January to August 2003. Participation in this campaign showed a slight rise in the number of participants from the previous year, with 42 groups submitting results for one or more of the different tracks (compared with 37 in 2002), but a steep rise in the number of experiments attempted. A distinctive feature of CLEF 2003 was the number of new tracks and tasks that were offered as pilot experiments. The aim was to try out new ideas and to encourage the development of new evaluation methodologies, suited to the emerging requirements of both system developers and users with respect to today’s digital collections and to encourage work on many European languages rather than just those most widely used. CLEF is thus gradually pushing its participants towards the ultimate goal: the development of truly multilingual systems capable of processing collections in diverse media. The campaign culminated in a two-day workshop held in Trondheim, Norway, 21–22 August, immediately following the 7th European Conference on Digital Libraries (ECDL 2003), and attended by more than 70 researchers and system developers. The objective of the workshop was to bring together the groups that had participated in the CLEF 2003 campaign so that they could report on the results of their experiments.


DOM algorithms bilingual information retrieval cross-language queries cross-lingual text retrieval image retrieval information system interactive text retrieval systems machine translation multilingual information retrieval natural language processing ontology proving spoken document retrieval

Editors and affiliations

  • Carol Peters
    • 1
  • Julio Gonzalo
    • 2
  • Martin Braschler
    • 2
  • Michael Kluck
    • 3
  1. 1.ISTI-CNR, Area di RicercaPisaItaly
  2. 2.No Affiliations 
  3. 3.German Institute for International and Security AffairsStiftung Wissenschaft und Politik (SWP)BerlinGermany

Bibliographic information

  • DOI
  • Copyright Information Springer-Verlag Berlin Heidelberg 2004
  • Publisher Name Springer, Berlin, Heidelberg
  • eBook Packages Springer Book Archive
  • Print ISBN 978-3-540-24017-4
  • Online ISBN 978-3-540-30222-3
  • Series Print ISSN 0302-9743
  • Series Online ISSN 1611-3349
  • Buy this book on publisher's site
Industry Sectors
Chemical Manufacturing
Consumer Packaged Goods
Energy, Utilities & Environment
Oil, Gas & Geosciences