Skip to main content
SpringerLink
Log in

Fusion Techniques for Combining Textual and Visual Information Retrieval

  • Chapter
ImageCLEF

Part of the book series: The Information Retrieval Series ((INRE,volume 32))

Abstract

This chapter describes several approaches for information fusion that have been used in ImageCLEF over the past seven years. In this context, the fusion of information is mainly meant to combine textual and visual retrieval. Data fusion techniques from 116 papers (62% of ImageCLEF working notes) are categorized, described and discussed. It was observed that three general approaches were used for retrieval that can be categorized based on the system level chosen for combining modalities: 1) at the input of the system with inter–media query expansion, 2) internally to the system with early fusion and 3) at the output of the system with late fusion which is by far the most widely used fusion strategy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Adriani M, Framadhan A (2005) The University of Indonesia’s participation in ImageCLEF 2005. In: Working Notes of CLEF 2005, Vienna, Austria

    Google Scholar 

  • Ah-Pine J, Cifarelli C, Clinchant S, Renders JM (2008) XRCE’s participation to ImageCLEF 2008. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Ah-Pine J, Clinchant S, Csurka G, Liu Y (2009) XRCE’s participation in ImageCLEF 2009. In: Working Notes of CLEF 20098, Corfu, Greece

    Google Scholar 

  • Alvarez C, Id Oumohmed A, Mignotte M, Nie JY (2004) Toward cross–language and cross–media image retrieval. In: Working Notes of CLEF 2004, Bath, England

    Google Scholar 

  • Arni T, Clough PD, Sanderson M, Grubinger M (2008) Overview of the ImageCLEFphoto 2008 photographic retrieval task. In: Working Notes of CLEF 2008, pp 500–511

    Google Scholar 

  • Belkin NJ, Cool C, Croft WB, Callan JP (1993) The effect of multiple query representations on information retrieval system performance. In: Korfhage R, Rasmussen EM, Willett P (eds) Proceedings of the 16st annual international ACM SIGIR conference on research and development in information retrieval. ACM press, Pittsburgh, PA, USA, pp 339–346

    Google Scholar 

  • Belkin NJ, Kantor P, Cool C, Quatrain R (1994) Combining evidence for information retrieval. In: TREC–2: The Second Text REtrieval Conference, pp 35–44

    Google Scholar 

  • Bell AJ (2003) The co–information lattice. In: Proceedings of the 4th international symposium on independent component analysis and blind signal separation (ICA2003). Springer, Nara, Japan, pp 921–926

    Google Scholar 

  • Benczúr A, Bíró I, Brendel M, Csalogány K, Daróczy B, Siklósi D (2007) Cross–modal retrieval by text and image feature biclustering. In: Working Notes of CLEF 2007, Budapest, Hungary

    Google Scholar 

  • Berber T, Alpkoçak A (2009) DEU at ImageCLEFmed 2009: Evaluating re–ranking and integrated retrieval model. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • Besançon R, Millet C (2005) Merging results from different media: Lic2m experiments at ImageCLEF 2005. In: Working Notes of CLEF 2005, Vienna, Austria

    Google Scholar 

  • Besançon R, Hède P, Moëllic PA, Fluhr C (2004) LIC2M experiments at ImageCLEF 2004. In: Working Notes of CLEF 2004, Bath, England

    Google Scholar 

  • Boutsis I, Kalamboukis T (2009) Combined content–based and semantic image retrieval. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • Broda B, Paradowski M, Kwanicka H (2009) Multimodal photo retrieval through finding similar documents enhanced with visual clues — a baseline method. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • Chang YC, Chen HH (2006) Approaches of using a word–image ontology and an annotated image corpus as intermedia for cross–language image retrieval. In: Working Notes of CLEF 2006, Alicante, Spain

    Google Scholar 

  • Chang YC, Chen HH (2007) Experiment for using web information to do query and document expansion. In: Working Notes of the CLEF 2007, Budapest, Hungary

    Google Scholar 

  • Chang YC, Chen HH (2008) Increasing relevance and diversity in photo retrieval by result fusion. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Chang YC, Lin WC, Chen HH (2005) Combing text and image queries at ImageCLEF2005. In: Working Notes of CLEF 2005, Vienna, Austria

    Google Scholar 

  • Cheng PC, Chien BC, Ke HR, Yang WP (2004) KIDS’s evaluation in the medical image retrieval task at ImageCLEF 2004. In: Working Notes of CLEF 2004, Bath, England

    Google Scholar 

  • Cheng PC, Yeh JY, Ke HR, Chien BC, Yang WP (2004) NCTU–ISU’s evaluation for the user–centered search task at ImageCLEF 2004. In: Working Notes of CLEF 2004, Bath, England

    Google Scholar 

  • Cheng PC, Chien BC, Ke HR, Yang WP (2005) NCTU_DBLAB@ImageCLEFmed 2005: Medical image retrieval task. In: Working Notes of CLEF 2005, Vienna, Austria

    Google Scholar 

  • Chevallet JP, Lim JH, Radhouani S (2005) Using ontology dimensions and negative expansion to solve precise queries in the CLEF medical task. In: Working Notes of the CLEF 2005, Vienna, Austria

    Google Scholar 

  • Clinchant S, Renders JM, Csurka G (2007) XRCE’s participation to ImageCLEFphoto 2007. In: Working Notes of CLEF 2007, Budapest, Hungary

    Google Scholar 

  • Daróczy B, Petrás I, Benczúr AA, Zsolt Fekete Z, Nemeskey D, Siklósi D, Weiner Z (2009) SZTAKI @ ImageCLEF 2009. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • Daumke P, Paetzold J, Markó K (2006) Morphosaurus in ImageCLEF 2006: The effect of subwords on biomedical IR. In: Working Notes of CLEF 2006, Alicante, Spain

    Google Scholar 

  • Depeursinge A, Racoceanu D, Iavindrasana J, Cohen G, Platon A, Poletti PA, Müller H (2010–to appear) Fusing visual and clinical information for lung tissue classification in HRCT data. Journal of Artificial Intelligence in Medicine

    Google Scholar 

  • Deselaers T, Weyand T, Keysers D, Macherey W, Ney H (2005) FIRE in ImageCLEF 2005: Combining content–based image retrieval with textual information retrieval. In: Working Notes of the CLEF Workshop, Vienna, Austria

    Google Scholar 

  • Deselaers T, Weyand T, Ney H (2006) Image retrieval and annotation using maximum entropy. In: Working Notes of CLEF 2006, Alicante, Spain

    Google Scholar 

  • Deselaers T, Gass T, Weyand T, Ney H (2007) FIRE in ImageCLEF 2007. In: Working Notes of CLEF 2007, Budapest, Hungary

    Google Scholar 

  • Díaz-Galiano MC, García-Cumbreras MA, Martín-Valdivia MT, Montejo-Raez A, Ureña-López LA (2006) SINAI at ImageCLEF 2006. In: Working Notes of CLEF 2006, Alicante, Spain

    Google Scholar 

  • Díaz-Galiano MC, García-Cumbreras MA, Martín-Valdivia MT, Montejo-Raez A, Ureña-López LA (2007) SINAI at ImageCLEF 2007. In: Working Notes of CLEF2007, Budapest, Hungary

    Google Scholar 

  • Díaz-Galiano MC, García-Cumbreras MA, Martín-Valdivia MT, Ureña-López LA, Montejo-Raez A (2008) SINAI at ImageCLEFmed 2008. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Douze M, Guillaumin M, Mensink T, Schmid C, Verbeek J (2009) INRIA–LEARs participation to ImageCLEF 2009. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • El Demerdash O, Kosseim L, Bergler S (2007) Experiments with clustering the collection at ImageCLEF 2007. In: Working Notes of CLEF 2007, Budapest, Hungary

    Google Scholar 

  • El Demerdash O, Kosseim L, Bergler S (2008) CLaC at ImageCLEFPhoto 2008. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • El Demerdash O, Bergler S, Kosseim L (2009a) CLaC at ImageCLEF 2009. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • El Demerdash O, Kosseim L, Bergler S (2009b) Image retrieval by inter–media fusion and pseudo–relevance feedback. In: Evaluating systems for multilingual and multimodal information access, pp 605–611

    Google Scholar 

  • van Erp M, Schomaker L (2000) Variants of the borda count method for combining ranked classifier hypotheses. In: Seventh International Workshop on Frontiers in Handwriting Recognition, pp 443–452

    Google Scholar 

  • Fakeri-Tabrizi A, Amini MR, Tollari S, Gallinari P (2008) UPMC/LIP6 at ImageCLEF’s WikipediaMM: An image–annotation model for an image search–engine. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Ferecatu M, Sahbi H (2008) TELECOM ParisTech at ImageClefphoto 2008: Bi–modal text and image retrieval with diversity enhancement. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Florea F, Rogozan A, Cornea V, Bensrhair A, Darmoni S (2006) MedIC/CISMeF at ImageCLEF 2006: Image annotation and retrieval tasks. In: Working Notes of CLEF 2006, Alicante, Spain

    Google Scholar 

  • Frank Hsu D, Taksa I (2005) Comparing rank and score combination methods for data fusion in information retrieval. Information Retrieval 8(3):449–480

    Article  Google Scholar 

  • Gao S, Lim JH (2009) I2R at ImageCLEF photo retrieval 2009. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • Gao S, Chevallet JP, Le THD, Pham TT, Lim JH (2007) IPAL at ImageClef 2007 mixing features, models and knowledge. In: Working Notes of CLEF 2007, Budapest, Hungary

    Google Scholar 

  • Gao S, Chevallet JP, Lim JH (2008) IPAL at CLEF 2008: Mixed–modality based image search, novelty based re–ranking and extended matching. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Glotin H, Zhao Z (2008) Affnity propagation promoting diversity in visuo–entropic and text features for CLEF Photo retrieval 2008 campaign. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Gobeill J, Müller H, Ruch P (2006) Query and document translation by automatic text categorization: A simple approach to establish a strong textual baseline for ImageCLEFmed 2006. In: Working Notes of CLEF 2006, Alicante, Spain

    Google Scholar 

  • Granados R, Benavent X, García-Serrano A, Goñi JM (2008) MIRACLE–FI at ImageCLEFphoto 2008: Experiences in merging text–based and content–based retrievals. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Granados R, Benavent X, Agerri R, García-Serrano A, Goñi JM, Gomar J, de Ves E, Domingo J, Ayala G (2009) MIRACLE (FI) at ImageCLEFphoto 2009. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • Gunes H, Piccardi M (2005) Affect recognition from face and body: early fusion vs. late fusion. In: 2005 IEEE International Conference on Systems, Man and Cybernetics, vol 4. IEEE Computer Society, Big Island, Hawaii, pp 3437–3443

    Chapter  Google Scholar 

  • Hare JS, Dupplaw DP, Lewis PH (2009) IAM@ImageCLEFphoto 2009: Experiments on maximising diversity using image features. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • Hersh W, Kalpathy-Cramer J, Jensen J (2006) Medical image retrieval and automated annotation: OHSU at ImageCLEF 2006. In: Working Notes of CLEF 2006, Alicante, Spain

    Google Scholar 

  • Hersh W, Kalpathy-Cramer J, Jensen J (2007) Medical image retrieval and automated annotation: OHSU at ImageCLEF 2006. In: Peters C, D. PC, Gey FC, Karlgren J, Magnini B, Oard DW, de Rijke M, Stempfhuber M (eds) CLEF. Lecture Notes in Computer Science (LNCS), vol 4730. Springer, pp 660–669

    Google Scholar 

  • Ho TK, Hull JJ, Srihari SN (1994) Decision combination in multiple classifier systems. IEEE Transactions on Pattern Analysis and Machine Intelligence 16:66–75

    Article  Google Scholar 

  • Hoi SCH (2007) Cross–language and cross–media image retrieval: An empirical study at ImageCLEF2007. In: Working Notes of CLEF 2007, Budapest, Hungary

    Google Scholar 

  • Hoi SCH, Zhu J, Lyu MR (2005) CUHK experiments with ImageCLEF 2005. In: Working Notes of CLEF 2005, Vienna, Austria

    Google Scholar 

  • Inkpen D, Stogaitis M, DeGuire F, Alzghool M (2008) Clustering for photo retrieval at ImageCLEF 2008. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Inoue M, Grover P (2008) Effects of visual concept–based post–retrieval clustering in ImageCLEFphoto 2008. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Jair Escalante H, Hernández CA, López A, Marín HM, Montes M, Morales E, Sucar LE, Villaseñor L (2007) TIA–INAOE’s participation at ImageCLEF 2007. In: Working Notes of CLEF 2007, Budapest, Hungary

    Google Scholar 

  • Jair Escalante H, Gonzáles JA, Hernández CA, López A, Montes M, Morales E, Sucar LE, Villaseñor L (2008) TIA–INAOE’s participation at ImageCLEF 2008. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Jair Escalante H, Gonzáles JA, Hernández CA, López A, Montes M, Morales E, Ruiz E, Sucar LE, Villaseñor L (2009) TIA–INAOE’s participation at ImageCLEF 2009. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • Järvelin A, Wilkins P, Adamek T, Airio E, Jones GJF, Smeaton AF, Sormunen E (2007) DCU and UTA at ImageCLEFphoto 2007. In: Working Notes of CLEF 2007, Budapest, Hungary

    Google Scholar 

  • Jensen JR, Hersh WR (2005) Manual query modification and automatic translation to improve cross–language medical image retrieval. In: Working Notes of CLEF 2005, Vienna, Austria

    Google Scholar 

  • Jones GJF, McDonald K (2005) Dublin City University at CLEF 2005: Experiments with the ImageCLEF St Andrew’s collection. In: Working Notes of CLEF 2005, Vienna, Austria

    Google Scholar 

  • Jones GJF, Groves D, Khasin A, Lam-Adesina A, Mellebeek B, Way A (2004) Dublin City University at CLEF 2004: Experiments with the ImageCLEF St Andrew’s collection. In: Working Notes of CLEF 2004, Bath, England

    Google Scholar 

  • Kalpathy-Cramer J, Hersh W (2007) Medical image retrieval and automatic annotation: OHSU at ImageCLEF 2007. In: Working Notes of CLEF 2007, Budapest, Hungary

    Google Scholar 

  • Kalpathy-Cramer J, Bedrick S, Hatt W, Hersh W (2008) Multimodal medical image retrieval: OHSU at ImageCLEF 2008. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Lacoste C, Chevallet JP, Lim JH, Xiong W, Racoceanu D (2006) IPAL knowledge–based medical image retrieval in ImageCLEFmed 2006. In: Working Notes of CLEF 2006, Alicante, Spain

    Google Scholar 

  • Lee JH (1995) Combining multiple evidence from different properties of weighting schemes. In: Proceedings of the 18th annual international ACM SIGIR conference on research and development in information retrieval. ACM press, pp 180–188

    Google Scholar 

  • Lee JH (1997) Analyses of multiple evidence combination. In: Proceedings of the 20th annual international ACM SIGIR conference on research and development in information retrieval. ACM press, New York, NY, USA, pp 267–276

    Chapter  Google Scholar 

  • Lestari Paramita M, Sanderson M, Clough PD (2009) Diversity in photo retrieval: Overview of the ImageCLEFPhoto task 2009. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • Lim JH, Chevallet JP (2005) A structured learning approach for medical image indexing and retrieval. In: Working Notes of CLEF 2005, Vienna, Austria

    Google Scholar 

  • Lin WC, Chang YC, Chen HH (2004) From text to image: Generating visual query for image retrieval. In: Working Notes of CLEF 2004, Bath, England

    Google Scholar 

  • Magalhães J, Overell S, Rüger S (2007) Exploring image, text and geographic evidences in ImageCLEF 2007. In: Working Notes of CLEF 2007, Budapest, Hungary

    Google Scholar 

  • Maillot N, Chevallet JP, Valea V, Lim JH (2006) IPAL inter–media pseudo–relevance feedback approach to ImageCLEF 2006 photo retrieval. In: Working Notes of CLEF 2006, Alicante, Spain

    Google Scholar 

  • Martín-Valdivia MT, García-Cumbreras MA, Díaz-Galiano MC, Ureña-López LA, Montejo-Raez A (2005) SINAI at ImageCLEF 2005. In: Working Notes of CLEF 2005, Vienna, Austria

    Google Scholar 

  • Martínez-Fernández JL, Serrano AG, Villena-Román J, Sáenz VDM, Tortosa SG, Castagnone M, Alonso J (2004) MIRACLE at ImageCLEF 2004. In: Working Notes of CLEF 2004, Bath, England

    Google Scholar 

  • Montague M, Aslam JA (2001) Relevance score normalization for metasearch. In: Proceedings of the tenth international conference on information and knowledge management. ACM press, pp 427–433

    Google Scholar 

  • Moulin C, Barat C, Géry M, Ducottet C, Largeron C (2008) UJM at ImageCLEFwiki 2008. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Moulin C, Barat C, Lemaître C, Géry M, Ducottet C, Largeron C (2009) Combining text/image in WikipediaMM task 2009. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • Mulhem P (2008) LIG at ImageCLEFphoto 2008. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Mulhem P, Chevallet JP, Quénot G, Al Batal R (2009) MRIM–LIG at ImageCLEF 2009: Photo retrieval and photo annotation tasks. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • Müller H, Geissbuhler A, Ruch P (2004) Report on the CLEF experiment: Combining image and multi–lingual search for medical image retrieval. In: Working Notes of CLEF 2004, Bath, England

    Google Scholar 

  • Müller H, Geissbuhler A, Marty J, Lovis C, Ruch P (2005) Using medGIFT and easyIR for the ImageCLEF 2005 evaluation tasks. In: Working Notes of CLEF 2005, Vienna, Austria

    Google Scholar 

  • Müller H, Deselaers T, Kim E, Kalpathy-Cramer J, Deserno TM, Clough PD, Hersh W (2008) Overview of the ImageCLEFmed 2007 medical retrieval and annotation tasks. In: CLEF 2007 Proceedings. Lecture Notes in Computer Science (LNCS), vol 5152. Springer, Budapest, Hungary, pp 473–491

    Google Scholar 

  • Myoupo D, Popescu A, Le Borgne H, Moëllic PA (2009) Visual reranking for image retrieval over the Wikipedia corpus. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • Navarro S, Díaz MC, Muñoz R, García MA, Llopis F, Martín MT, Ureña-López LA, Montejo-Raez A (2008a) Text–mess in the medical retrieval ImageCLEF08 task. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Navarro S, García MA, Llopis F, Díaz MC, Muñoz R, Martín MT, Ureña-López LA, Montejo-Raez A (2008b) Text–mess in the ImageCLEFphoto task. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Navarro S, Llopis F, Muñoz R (2008c) Different multimodal approaches using IR–n in ImageCLEFphoto 2008. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Navarro S, Muñoz R, Llopis F (2008d) A multimodal approach to the medical retrieval task using IR–n. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Navarro S, Muñoz R, Llopis F (2009) Evaluating fusion techniques at different domains at ImageCLEF subtasks. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • O’Hare N, Wilkins P, Gurrin C, Newman E, Jones GJF, Smeaton AF (2008) DCU at ImageCLEFPhoto 2008. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Overell S, Llorente A, Liu H, Hu R, Rae A, Zhu J, Song D, Rüger S (2008) MMIS at ImageCLEF 2008: Experiments combining different evidence sources. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Popescu A, Le Borgne H, Moëllic PA (2008) Conceptual image retrieval over the Wikipedia corpus. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Quinlan RJ (1986) Induction of decision trees. Machine Learning 1(1):81–106

    Google Scholar 

  • Rácz S, Daróczy B, Siklósi D, Pereszlényi A, Brendel M, Benczúr A (2008) Increasing cluster recall of cross–modal image retrieval. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Radhouani S, Kalpathy-Cramer J, Bedrick S, Bakke B, Hersh W (2009) Multimodal medical image retrieval improving precision at ImageCLEF 2009. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • Rahman MM, Sood V, Desai BC, Bhattacharya P (2006) CINDI at ImageCLEF 2006: Image retrieval & annotation tasks for the general photographic and medical image collections. In: Working Notes of CLEF 2006, Alicante, Spain

    Google Scholar 

  • Rahman MM, Desai BC, Bhattacharya P (2007) Multi–modal interactive approach to ImageCLEF 2007 photographic and medical retrieval tasks by CINDI. In: Working Notes of CLEF 2007, Budapest, Hungary

    Google Scholar 

  • Ruiz ME (2009) UNT at ImageCLEFmed 2009. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • Ruiz ME, Southwick SB (2005) UB at CLEF 2005: Medical image retrieval task. In: Working Notes of CLEF 2005, Vienna, Austria

    Google Scholar 

  • Ruiz ME, Srikanth M (2004) UB at CLEF2004: Part 2 — cross language medical image retrieval. In: Working Notes of CLEF 2004, Bath, England

    Google Scholar 

  • Salton G, Buckley C (1988) Term weighting approaches in automatic text retrieval. Information Processing and Management 24(5):513–523

    Article  Google Scholar 

  • Saracevic T, Kantor P (1988) A study of information seeking and retrieving. ii. users, questions, and effectiveness. Journal of the American Society for Information Science 39:177–196

    Article  Google Scholar 

  • Shaw JA, Fox EA (1994) Combination of multiple searches. In: TREC–2: The Second Text REtrieval Conference, pp 243–252

    Google Scholar 

  • Simpson M, Rahman MM, Demner-Fushman D, Antani S, Thoma GR (2009) Text– and content–based approaches to image retrieval for the ImageCLEF 2009 medical retrieval track. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • Smeulders AWM, Worring M, Santini S, Gupta A, Jain R (2000) Content–based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(12):1349–1380

    Article  Google Scholar 

  • Snoek CGM, Worring M, Smeulders AWM (2005) Early versus late fusion in semantic video analysis. In: Proceedings of the 13th annual ACM international conference on Multimedia. ACM press, New York, NY, USA, pp 399–402

    Chapter  Google Scholar 

  • Tollari S, Detyniecki M, Fakeri-Tabrizi MR, Ali ad Amini, Gallinari P (2008) UPMC/LIP6 at ImageCLEFphoto 2008: on the exploitation of visual concepts (VCDT). In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Torjmen M, Pinel-Sauvagnat K, Boughanem M (2007) Using pseudo–relevance feedback to improve image retrieval results. In: Working Notes of CLEF 2007, Budapest, Hungary

    Google Scholar 

  • Torjmen M, Pinel-Sauvagnat K, Boughanem M (2008) Methods for combining content–based and textual–based approaches in medical image retrieval. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Villena-Román J, González-Cristóbal JC, Goñi-Menoyo JM, Martínez-Fernández JL, Fernández JJ (2005) MIRACLE’s combination of visual and textual queries for medical images retrieval. In: Working Notes of CLEF 2005, Vienna, Austria

    Google Scholar 

  • Villena-Román J, Lana-Serrano S, González-Cristóbal JC (2007a) MIRACLE at ImageCLEFmed 2007: Merging textual and visual strategies to improve medical image retrieval. In: Working Notes of CLEF 2007, Budapest, Hungary

    Google Scholar 

  • Villena-Román J, Lana-Serrano S, Martínez-Fernández JL, González-Cristóbal JC (2007b) MIRACLE at ImageCLEFphoto 2007: Evaluation of merging strategies for multilingual and multimedia information retrieval. In: Working Notes of CLEF 2007, Budapest, Hungary

    Google Scholar 

  • Vogt CC, Cottrell GW (1999) Fusion via a linear combination of scores. Information Retrieval 1(3):151–173

    Article  Google Scholar 

  • Wilhelm T, Eibl M (2006) ImageCLEF 2006 experiments at the Chemnitz Technical University. In: Working Notes of CLEF 2006, Alicante, Spain

    Google Scholar 

  • Wilhelm T, Kürsten J, Eibl M (2007) Experiments for the ImageCLEF 2007 photographic retrieval task. In: Working Notes of CLEF 2007, Budapest, Hungary

    Google Scholar 

  • Yamauchi K, Nomura T, Usui K, Kamoi Y, Eto M, Takagi T (2008) Meiji University at ImageCLEF2008 photo retrieval task: Evaluation of image retrieval methods integrating different media. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Ye Z, Huang X, Lin H (2009) Towards a better performance for medical image retrieval using an integrated approach. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • van Zaanen M, de Croon G (2004) FINT: Find Images aNd Text. In: Working Notes of CLEF 2004, Bath, England

    Google Scholar 

  • Zhao Z, Glotin H (2008) Concept content based Wikipedia WEB image retrieval using CLEF VCDT 2008. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Zhou X, Gobeill J, Ruch P, Müller H (2007) University and Hospitals of Geneva at ImageCLEF 2007. In: Working Notes of CLEF 2007, Budapest, Hungary

    Google Scholar 

  • Zhou X, Gobeill J, Müller H (2008a) MedGIFT at ImageCLEF 2008. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Zhou X, Eggel I, Müller H (2009) The MedGIFT group at ImageCLEF 2009. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

  • Zhou X, Depeursinge A, Müller H (2010) Information fusion for combining visual and textual image retrieval. In: Pattern Recognition, International Conference on. IEEE Computer Society, Istambul, Turkey

    Google Scholar 

  • Zhou Z, Tian Y, Li Y, Liu T, Huang T, Gao W (2008b) PKU at ImageCLEF 2008: Experiments with query extension techniques for text–based and content–based image retrieval. In: Working Notes of CLEF 2008, Aarhus, Denmark

    Google Scholar 

  • Zuccon G, Leelanupab T, Goyal A, Halvey M, Punitha P, Jose JM (2009) The University of Glasgow at ImageClefPhoto 2009. In: Working Notes of CLEF 2009, Corfu, Greece

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University and University Hospitals of Geneva (HUG), Rue Gabrielle–Perret–Gentil 4, 1211, Geneva 14, Switzerland

    Adrien Depeursinge

  2. TechnoArk 3, Business Information Systems, University of Applied Sciences Western Switzerland (HES–SO), 3960, Sierre, Switzerland

    Henning Müller

Authors
  1. Adrien Depeursinge
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Henning Müller
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Adrien Depeursinge .

Editor information

Editors and Affiliations

  1. HES-SO Business Information Systems, TechnoArk 3, Sierre, 3960, Switzerland

    Henning Müller

  2. Dept. Information Studies, University of Sheffield, Portobello Street 211, Sheffield, S1 4DP, United Kingdom

    Paul Clough

  3. , Computer Vision Lab/ETF-C 113.2, ETH Zürich, Zürich, 8092, Switzerland

    Thomas Deselaers

  4. Idiap Research Institute, rue Marconi 19, Martigny, 1920, Switzerland

    Barbara Caputo

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Depeursinge, A., Müller, H. (2010). Fusion Techniques for Combining Textual and Visual Information Retrieval. In: Müller, H., Clough, P., Deselaers, T., Caputo, B. (eds) ImageCLEF. The Information Retrieval Series, vol 32. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15181-1_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-15181-1_6

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-15180-4

  • Online ISBN: 978-3-642-15181-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation