Skip to main content
SpringerLink
Log in
Book cover

From the Web to the Grid and Beyond pp 225–266Cite as

Databases in High Energy Physics: A Critical Review

  • Chapter
  • First Online:

Part of the book series: The Frontiers Collection ((FRONTCOLL))

Abstract

This chapter traces the history of databases in High Energy Physics (HEP) over the past quarter century. It does not attempt to describe in detail all database applications, focusing primarily on their use related to physics data processing. In particular, the use of databases in the accelerator sector, as well as for administrative applications–extensively used by today’s large-scale collaborations–are only covered in passing.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Databases and bookkeeping for HEP experiments, ECFA Working Group 11, ECFA/83/78 (Sept 83)

    Google Scholar 

  2. See http://en.wikipedia.org/wiki/SQL

  3. KAPACK - Random Access I/O Using Keywords, CERN Program Library Entry Z303

    Google Scholar 

  4. Mount, R.P.: Database systems for HEP Experiments. Comput. Phys. Comm. 45, 299–310 (1987)

    Article  Google Scholar 

  5. The L3 database system, Nuclear Instruments and Methods in Physics Research A309, 318–330 (1991)

    Google Scholar 

  6. ZEBRA Data Structure Management Package, CERN Program Library Entry Q100

    Google Scholar 

  7. Computing at CERN in the 1990s, July 1989

    Google Scholar 

  8. The ALEPH DAta MOdel - ADAMO. In: The proceedings of [14]. http://adamo.web.cern.ch

  9. ALEPH bookkeeping and SCANBOOK, Jacques

    Google Scholar 

  10. FATMEN - File and Tape Management Package, CERN Program Library Entry Q123

    Google Scholar 

  11. HEPDB - Database Management Package, CERN Program Library Entry Q180

    Google Scholar 

  12. Isnard, C., et al.: CHEOPS: A batch data dissemination system based on the OLYMPUS satellite. In: Proceeding of the International Conference on the Results of the OLYMPUS Utilisation Programme, Sevilla, 20-22 April, 1993

    Google Scholar 

  13. see for instance http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=00182285 and also http://www.esa.int

  14. Data Structures for Particle Physics Experiments: Evolution or Revolution? ISBN 981-02-0641-0

    Google Scholar 

  15. Goossens, M., Schaile, O.: DZDOC – Bank Documentation Tool. In: ZEBRA, CERN Program Library Long Writeups Q100/Q101

    Google Scholar 

  16. Kunz, P., Word, G.: The Cheetah Data Management System, SLAC-PUB-5450 March 1991 (E/I)

    Google Scholar 

  17. Barone, L.M.: Database Management and Distributed Data in High Energy Physics: Present and Future. In: The Proceedings of CHEP “91. ISBN 4-946443-09-6

    Google Scholar 

  18. Database Computing in High Energy Physics. In: The Proceedings of CHEP91, ISBN 4-946443-09-6

    Google Scholar 

  19. HEPDB Package, CERN Program Library Entry Q180

    Google Scholar 

  20. http://lcg.web.cern.ch/LCG

  21. Linder, B., Mount, R., Shiers, J.: Databases for High Energy Physics. In: The proceedings of CHEP92. ISBN 0007-8328

    Google Scholar 

  22. Bos, K.: The Moose project. Comput. Phys. Comm. 110(1-3), 160–163 (1998)

    Article  Google Scholar 

  23. http://geant4.web.cern.ch/geant4

  24. See http://wwwasd.web.cern.ch/wwwasd/cernlib/rd45/

  25. See http://wwwasd.web.cern.ch/wwwasd/lhc++/indexold.html

  26. ROOT - an Object-Oriented Data Analysis Framework - see http://root.cern.ch/

  27. May, E., et al.: The PASS Project: Database Computing for the SSC. Proposal to the DOE HPCC Initiative, Argonne National Lab, 1991, unpublished

    Google Scholar 

  28. See http://www.hep.net/ssc/

  29. http://www.slac.stanford.edu/BF/

  30. POOL - Persistency Framework - see http://pool.cern.ch/

  31. Malon, D., May, E.: Critical Database Technologies for High Energy Physics. In: The Proceedings of VLDB97, available from vldb.org

    Google Scholar 

  32. Sphicas, P.: Conference summary talk, CHEP 2000, Padua, Italy

    Google Scholar 

  33. Objectivity Data Migration. In: The Proceedings of CHEP 2003, La Jolla, California

    Google Scholar 

  34. Nowak, M., Nienartowicz, K., Valassi, A., Lbeck, M., Geppert, D.: Objectivity Data Migration, Computing in High Energy and Nuclear Physics, La Jolla, California. March 2003 24–28

    Google Scholar 

  35. Becla, J., Wang, D.: Lessons learnt from Managing a Petabyte, SLAC. In: The Proceedings of the 2006 CIDR Conference

    Google Scholar 

  36. Girone, M.: Database services for Physics at CERN. In: The Proceedings of CHEP07

    Google Scholar 

  37. http://proj-openlab-datagrid-public.web.cern.ch/proj-openlab-datagrid-public/

  38. http://eu-datagrid.web.cern.ch

  39. Computing at CERN in the LEP era, CERN, May 1983

    Google Scholar 

  40. Martelli, B., et al.: LHCb experience with LFC database replication. In: The Proceedings of CHEP07

    Google Scholar 

  41. The ALICE Collaboration, Technical Design Report of the Computing, CERN-LHCC-2005-01, ALICE TDR 012, 15 June 2005

    Google Scholar 

  42. See http://alien2.cern.ch

  43. Lueking, L., et al.: FroNtier: High Performance Database Access Using Standard Web Components in a Scalable Multi-Tier Architecture. In: Proceedings of CHEP04, Interlaken (September 2004)

    Google Scholar 

  44. Oracle streams - see http://www.oracle.com/

  45. See http://lcgapp.cern.ch/project/CondDB/

  46. Düllmann, D., et al.: Production experience with Distributed Deployment of Databases for the LHC Computing Grid. In the Proceedings of CHEP07

    Google Scholar 

  47. Gaponenko, I., et al.: Using Multiple Persistent Technologies in the Conditions Database of BaBar. In: Proceedings of CHEP06, February 2006

    Google Scholar 

  48. Valassi, A., et al.: COOL Development and Deployment: Status and Plans. In: The Proceedings of the CHEP 2006 Conference

    Google Scholar 

  49. Papadopoulos, I., et al.: CORAL, A Software System for Vendor-neutral Access To Relation Databases. In: The Proceedings of the CHEP 2006 conference

    Google Scholar 

  50. Abadie, L., et al.: Grid-Enabled Standards-based Data Management, submitted to the 24th IEEE Conference on Mass Storage Systems and Technologies. Boucrot, in “The ALEPH Experience”, p 128

    Google Scholar 

  51. In Proceedings of Symposia On Advanced Computer Programs for Digital Computers, sponsored by ONR. Republished in Annals of the History of Computing, Oct. 1983, pp. 350–361. Reprinted at ICSE’87, Monterey, California, USA, March 30-April 2, 1987, June 1956

    Google Scholar 

  52. Girone, M., Shiers, J.: WLCG Operations and the First Prolonged LHC Run to appear in the proceedings of CHEP 2010

    Google Scholar 

Download references

Acknowledgements

Numerous people have contributed to the story of Databases in HEP, including the many who worked on various aspects of the CERN Program Library and the ZEBRA, FATMEN and HEPDB packages. Members of the PASS and RD45 projects, together with the ROOT and POOL and related projects as well as all those who have contributed to database deployment at the various HEP sites throughout the years also played key roles in this story. Particular thanks are due to Harry Renshall for his careful reading of this and many other documents during the past 25 years, together with frequent guidance and mentoring. Finally, the “Grid Guys & Gals” (3G), working on the various middleware components and associated services, for deploying a host of database applications and in anticipation of the many years of LHC data taking to come. LHC data archive anyone?

Author information

Authors and Affiliations

  1. CERN, Geneva, Switzerland

    Jamie Shiers

Authors
  1. Jamie Shiers
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jamie Shiers .

Editor information

Editors and Affiliations

  1. CERN, Geneva, 1211, Switzerland

    René Brun

  2. CERN, Geneva, 1211, Switzerland

    Federico Carminati

  3. Unité de la Psychiatrie du, Développement Mental, Hopitaux Universitaire de Genève, ch du Petit Bel Air 2, Chene-Bourg, 1225, Switzerland

    Giuliana Galli Carminati

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Shiers, J. (2011). Databases in High Energy Physics: A Critical Review. In: Brun, R., Carminati, F., Galli Carminati, G. (eds) From the Web to the Grid and Beyond. The Frontiers Collection. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23157-5_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-23157-5_9

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-23156-8

  • Online ISBN: 978-3-642-23157-5

  • eBook Packages: Physics and AstronomyPhysics and Astronomy (R0)

Publish with us

Policies and ethics

Search

Navigation