Skip to main content
SpringerLink
Log in

On-Demand Big Data Analysis in Digital Repositories: A Lightweight Approach

  • Conference paper
  • First Online:
Digital Libraries: Providing Quality Information (ICADL 2015)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9469))

Included in the following conference series:

Abstract

We describe a use and reuse driven digital repository integrated with lightweight data analysis capabilities provided by the Docker framework. Using building sensor data collected from the Virginia Tech Goodwin Hall Living Laboratory, we perform evaluations using Amazon EC2 and Container Service with a Fedora 4 repository backed with storage in Amazon S3. The results confirm the viability and benefits of this approach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Akers, K.G., et al.: Building Support for Research Data Management: Biographies of Eight Research Universities. International Journal of Digital Curation 9(2), 171–191 (2014)

    Article  Google Scholar 

  2. Higgins, S.: The DCC curation lifecycle model. International Journal of Digital Curation. 3(1), 134–140 (2008)

    Article  MathSciNet  Google Scholar 

  3. Farcas, C., et al.: Biomedical cyberinfrastructure challenges. In: Proceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to Discovery, pp. 6:1–6:4. ACM, New York (2013)

    Google Scholar 

  4. Xie, Z., et al.: Towards use and reuse driven big data management. In: Proceedings of the 15th ACM/IEEE-CS Joint Conference on Digital Libraries, pp. 65–74. ACM, New York (2015)

    Google Scholar 

  5. ISO 14721:2003: Open Archival Information System - Reference Model (2003)

    Google Scholar 

  6. Barga, R., et al.: The Client and the Cloud: Democratizing Research Computing. IEEE Internet Computing 15(1), 72–75 (2011)

    Article  Google Scholar 

  7. Turnbull, J.: The Docker Book: Containerization is the new virtualization. James Turnbull (2014)

    Google Scholar 

  8. Hamilton, J.M., et al.: Characterization of human motion through floor vibration. In: Catbas, F.N. (ed.) Dynamics of Civil Structures, vol. 4, pp. 163–170. Springer International Publishing (2014)

    Google Scholar 

  9. Turk, M.J., et al.: yt: A Multi-code Analysis Toolkit for Astrophysical Simulation Data. ApJS. 192(1), 9 (2011)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University Libraries, Virginia Polytechnic Institute and State University, Blacksburg, USA

    Zhiwu Xie, Yinlin Chen, Tingting Jiang, Julie Speer & Tyler Walters

  2. Department of Mechanical Engineering, Virginia Polytechnic Institute and State University, Blacksburg, USA

    Pablo A. Tarazaga & Mary Kasarda

Authors
  1. Zhiwu Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yinlin Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tingting Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Julie Speer
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Tyler Walters
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Pablo A. Tarazaga
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Mary Kasarda
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhiwu Xie .

Editor information

Editors and Affiliations

  1. Yonsei University, Seoul, Korea (Republic of)

    Robert B. Allen

  2. School of ITEE, University of Queensland, St. Lucia, Queensland, Australia

    Jane Hunter

  3. School of Library & Info Sci, Kent State University, KENT, Ohio, USA

    Marcia L. Zeng

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Xie, Z. et al. (2015). On-Demand Big Data Analysis in Digital Repositories: A Lightweight Approach. In: Allen, R., Hunter, J., Zeng, M. (eds) Digital Libraries: Providing Quality Information. ICADL 2015. Lecture Notes in Computer Science(), vol 9469. Springer, Cham. https://doi.org/10.1007/978-3-319-27974-9_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-27974-9_29

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-27973-2

  • Online ISBN: 978-3-319-27974-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation