Skip to main content
SpringerLink
Log in

Generating a meta-DL by federating search on OAI and non-OAI servers

  • Published:
Journal of Intelligent Information Systems Aims and scope Submit manuscript

Abstract

Federation of intelligent systems is important to practice in applications. More recently, Digital Library (DL) interoperability has played an important role towards providing more visibility and accessibility to the broad range of rich digital resources collected by digital libraries and web-based services worldwide. In this paper, we describe how DL interoperability can be applied to mediating federated intelligent systems. Exemplified by the Digital Library for Life Science Learners (DLLSL) federated search project and the Open Archives Initiatives Protocol for Metadata Harvesting (OAI-PMH), we develop the design of an integrated DL system using harvesting methods towards DL interoperability, and the proposal of integrating federated search of non-OAI and harvesting of OAI repositories, which provides an even broader accessibility to intelligent systems with digital resources. This Meta-DL system helps researchers to locate, explore and use the resources in the expanding body of scholarly information by a simple middleware, such as Emerge (see “Section 2”).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. http://www.opentext.com/

  2. http://dlt.ncsa.uiuc.edu/archive/emerge/about/emerge.html

  3. http://www.ncbi.nlm.nih.gov/Entrez/

  4. http://mobot.mobot.org/W3T/Search/vast.html

  5. http://www.biomedcentral.com/

References

  • Adam, N., Atluri, V., & Adiwijaya, I. (2000). Systems integration in digital libraries. Communications of the ACM, 43(6), 64–72. doi:10.1145/336460.336476.

    Article  Google Scholar 

  • ANSI/NISO (2003). Information retrieval: Application service definition & protocol specification. ANSI/NISO Z39.50-2003. Bethesda: NISO Press. ISBN: 1-880124-55-6.

    Google Scholar 

  • ANSI/NISO (2007). The Dublin core metadata element set. ANSI/NISO Z39.85-2007. Bethesda: NISO. ISBN: 978-1-880124-73-4.

    Google Scholar 

  • Bowman, C., Danzig, P., Hardy, D., Manber, U., & Schwartz, M. (1995). The harvest information discovery and access system. Computer Networks and ISDN Systems, 28, 119–125. doi:10.1016/0169-7552(95)00098-5.

    Article  Google Scholar 

  • Chen, S., & Choo, C. (2002). A DL Server with OAI capabilities: Managing the metadata complexity. In Proceedings of the joint conference on digital libraries (JCDL’2002) (p. 388). Portland, OR, August.

  • Cliff, P. (2001). Building ResourceFinder. Ariadne issue 30. http://www.ariadne.ac.uk/issue30/rdn-oai/intro.html.

  • Dushay, N., French, J. C., & Lagoze, C. (1999). A characterization study of NCSTRL distributed searching. Technical Report TR99-1725, Cornell University, NY, USA. http://cs-tr.cs.cornell.edu/Dienst/UI/1.0/Display/ncstrl.cornell/TR99-1725.

  • Florescu, D., Levy, A., & Mendelzon, A. (1998). Database techniques for world-wide web: A survey. SIGMOD Record, 27(3), 59–74. doi:10.1145/290593.290605.

    Article  Google Scholar 

  • Futrelle, J., Chen., S., & Chang, K. C. (2001). NBDL: A CIS framework for NSDL. In Proceedings of the first ACM/IEEE-CS joint conference on digital libraries (JCDL’ 2001) (pp. 124–125). Roanoke, Virginia, 24–28 June.

  • Gonçalves, M. A., France, R. K., Fox, E. A., Hilf, E. R., Hohlfeld, M., Zimmermann, K., et al. (2001). Flexible interoperability in a federated digital library of theses and dissertations. In Proceedings of 20th world conference on open learning and distance education. Düsseldorf, Germany, April.

  • Gravano, L., Chang, C.-C. K., Garcia-Molina, H., & Paepcke, A. (1997). STARTS: Stanford proposal for internet meta-searching. In Proceedings of the ACM SIGMOD international conference on management of data (pp. 207–218). ACM Press.

  • Kim, H., Choo, C., & Chen, S. (2003). An integrated digital library server with OAI and self-organizing capabilities. In Proceedings of the 7th European conference on research and advanced technology for digital libraries (ECDL 2003) (pp.164–175). Trondheim, Norway, August.

  • Lagoze, C., & Davis, J. R. (1995). Dienst-an architecture for distributed document libraries. Communications of the ACM, 38(4), 47. doi:10.1145/205323.205331.

    Article  Google Scholar 

  • Lagoze, C., & Fielding, D. (1998). Defining collections in distributed digital libraries. D-Lib magazine. http://www.dlib.org/dlib/november98/lagoze/11lagoze.html.

  • Lagoze, C., & Van de Sompel, H. (2001) The open archives initiative: Building a low-barrier interoperability framework. In Proceedings of the first ACM/IEEE joint conference on digital libraries (pp. 54–62). Roanoke, VA.

  • Lagoze, C., & Van de Sompel, H. (2004). The open archives initiative protocol for metadata harvesting. Protocol version 2.0, open archives initiative. http://www.openarchives.org/OAI/openarchivesprotocol.html.

  • Liu, X., Maly, K., Zubair, M., & Nelson, M. L. (2001). Arc—an OAI service provider for digital library federation. In D-Lib magazine (Vol. 7, no. 4). http://www.dlib.org/dlib/april01/liu/04liu.

  • Liu, X., Maly, K., Zubair, M., & Nelson, M. L. (2002). DP9—an OAI gateway service for web crawlers. In Proceedings of the second ACM/IEEE joint conference on digital libraries (pp. 283–284). Oregon, USA, June.

  • Mahoney, D., & Giacomo, M. D. (2001). Flashpoint @ LANL.gov: A simple smart search interface. Issues in science and technology librarianship. http://www.istl.org/istl/01-summer/article2.html.

  • Marcus, R. S. (1983). An experimental comparison of the effectiveness of computers and humans as search intermediaries. Journal of the American Society for Information Science, 34(6), 381–404. doi:10.1002/asi.4630340605.

    Article  Google Scholar 

  • McCown, F., Liu, X., Nelson, M. L., & Zubair, M. (2006). Search engine coverage of the OAI-PMH corpus. IEEE Internet Computing, 10(2), 66–73. doi:10.1109/MIC.2006.41.

    Article  Google Scholar 

  • National Center for Biotechnology Information (NCBI) (2006). PubMed overview. http://www.ncbi.nlm.nih.gov/entrez/query/static/overview.html.

  • Paepcke, A., Chang, C. C. K., Winograd, T., & García-Molina, H. (1998). Interoperability for digital libraries worldwide. Communications of the ACM, 41(4), 33–42.

    Article  Google Scholar 

  • Sadeh, T. (2007). Transforming the metasearch concept into a friendly user experience. Internet Reference Services Quarterly, 12(1 and 2), 1–25, special 2007 double issue on federated searching.

    Article  Google Scholar 

  • Schatz, B., Mischo, W., Cole, T., Bishop, A., Harum, S., Johnson, E., et al. (1999). Federated search of scientific literature. IEEE Computer, 32(2), 51–59, special Issue on Digital Libraries.

    Google Scholar 

  • Selberg, E., & Etzioni, O. (1995). Multi-service search and comparison using the metacrawler. In Proceedings of the 4th international world wide web conference (pp. 11–14).

  • Shen, R., Vemuri, N. S., Fan, W., & Fox, E. A. (2008). Integration of complex archaeology digital libraries: An ETANA-DL experience. Information Systems, 33(7–8), 699–723.

    Article  Google Scholar 

  • Sompel, H. V., & Lagoze, C. (2002). Notes from the interoperability front: A progress report on the open archives initiative. In Proceedings of European conference on digital libraries (ECDL)(pp. 144–157). Roma, Italy.

  • United States Library of Congress (2004). SRU: Search/retrieve via URL: SRU revision 1.1. http://www.loc.gov/standards/sru/.

Download references

Acknowledgements

Support for our projects mentioned in this paper comes from the NSF NSDL 0221965 and 0126690 programs. The authors acknowledge the support and assistance from Joe Futrelle at NCSA for providing the Emerge software.

Author information

Authors and Affiliations

  1. Speech/Language Information Research Department, Electronics and Telecommunications Research Institute, 138 Gajeongno, Yuseong, Daejeon, 305-700, Republic of Korea

    Hyunki Kim

  2. Computer and Information Science and Engineering Department, University of Florida, Gainesville, FL, 32611, USA

    Chee-Yoong Choo

  3. CAS-MPG Partner Institute of Computational Biology, Shanghai Institutes of Biological Sciences, Chinese Academy of Sciences, 320 Yue Yan Road, Shanghai, 200031, China

    Su-Shing Chen

Authors
  1. Hyunki Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chee-Yoong Choo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Su-Shing Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hyunki Kim.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kim, H., Choo, CY. & Chen, SS. Generating a meta-DL by federating search on OAI and non-OAI servers. J Intell Inf Syst 34, 177–191 (2010). https://doi.org/10.1007/s10844-009-0084-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10844-009-0084-9

Keywords

Search

Navigation