Archiving Experimental Data
Preservation; Reference collections
The archiving of data is the process by which a project preserves both data and representation information that is needed to interpret the data.
An increasing fraction of science research is based on the analysis of large data collections. Experimental data are collected from measurements by sensors from repeatable experiments conducted in laboratories. Observational data are collected from sensors that measure properties of the natural environment. Simulation output files are generated by applications that run on supercomputers. The size of each of these types of research data can be massive, measured in petabytes (thousands of terabytes), such that there is physically not enough room to keep the data on high-speed disk file systems.
The archiving of experimental data traditionally focused on the migration of data from high-performance (more costly) storage systems to the lowest cost media that were...
- 1.BaBar B meson high energy physics project. Available at: http://www.slac.stanford.edu/BFROOT/
- 2.Integrated Rule-Oriented Data System (iRODS). Available at: http://irods.org/
- 3.Large Synoptic Survey Telescope (LSST). Available at: http://www.lsst.org/lsst//
- 4.Miller SW. Mass storage reference model special topics. In: Proceedings of the 9th IEEE Symposium on Mass Storage Systems; 1988. p. 3–7.Google Scholar
- 5.Moore R. Building preservation environments with data grid technology. Am Arch. 2006;69(1):139–58.Google Scholar
- 6.OAIS, reference model for an open archival information system, ISO standard ISO 14721:2003. Available at: http://nost.gsfc.nasa.gov/isoas/ref_model.html
- 7.Southern California Earthquake Center (SCEC). Available at: http://www.scec.org/
- 8.8-micron all sky survey. Available at: http://www.ipac.caltech.edu/2mass/