Advertisement

PLIERS: A Parallel Information Retrieval System Using MPI

  • A. MacFarlane
  • J. A. McCann
  • S. E. Robertson
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1697)

Abstract

The use of MPI in implementing algorithms for Parallel Information Retrieval Systems is outlined. We include descriptions on methods for Indexing, Search and Update of Inverted Indexes as well as a method for Information Filtering. In Indexing we describe both local build and distributed build methods. Our description of Document Search includes that for Term Weighting, Boolean, Proximity and Passage Retrieval Operations. Document Update issues are centred on how partitioning methods are supported. We describe the implementation of term selection algorithms for Information Filtering and finally work in progress is outlined.

Keywords

Inverted Index Inverted List Collective Operation Text Collection Information Filter 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    MacFarlane, A., Robertson, S.E., McCann, J.A.: Parallel Computing in Information Retrieval-An updated Review. Journal of Documentation. Vol. 53 No. 3 (1997) 274–315CrossRefGoogle Scholar
  2. 2.
    S. E. Robertson: Overview of the OKAPI projects. Journal of Documentation. Vol. 53 No. 1 (1997) 3–7CrossRefGoogle Scholar
  3. 3.
    Jeong, B., Omiecinski, E.: Inverted file partitioning schemes in multiple disk systems. IEEE Transactions on Parallel and Distributed Systems. Vol. 6 No. 2 (1995) 142–153CrossRefGoogle Scholar
  4. 4.
    Robertson, S.E., Walker, S., Jones, S., Hancock-Beaulieu, M.M. Gatford, M.: Okapi at TREC-3. In: Harman, D.K. (ed): Proceedings of Third Text Retrieval Conference, Gaithersburg, USA (1994) 109–126Google Scholar
  5. 5.
    Alasdair, R., Bruce, A., Mills J.G., Smith, A.G.: CHIMP/MPI User Guide Version 1.2, EPCC-KTP-CHIMP-V2-USER1.2. Edinburgh Parallel Computing Centre (1994)Google Scholar
  6. 6.
    Gropp, W., Lusk, E.: Users guide for MPICH, a portable Implementation of MPI. Mathematics and Computer Science Division, Argonne National Laboratory, University of Chicago (1998)Google Scholar
  7. 7.
    MPI User’s Guide. ANU/Fujitsu CAP Research Program, Department of Computer Science, Australian National University (1994)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1999

Authors and Affiliations

  • A. MacFarlane
    • 1
    • 2
  • J. A. McCann
    • 1
  • S. E. Robertson
    • 1
    • 2
  1. 1.School of InformaticsCity UniversityLondon
  2. 2.Microsoft Research LtdCambridge

Personalised recommendations