Digital preservation

Some of the information in this article or section has not been verified and might not be reliable. It should be checked for inaccuracies and modified as needed, citing sources.

Digital preservation refers to the management of digital information over time. Preservation of digital information is widely considered to require more constant and ongoing attention than preservation of other media. This constant input of effort, time, and money to handle rapid technological and organisational advance is considered the main stumbling block for preserving digital information. Indeed, while we are still able to read our written heritage from several thousand years ago, the digital information created merely a decade ago is in serious danger of being lost.

Digital preservation can therefore be seen as the set of processes and activities that ensure the continued access to information and all kinds of records, scientific and cultural heritage existing in digital formats.In the language of digital imaging and electronic resources, preservation is no longer just the product of a program but an ongoing process. In this regard the way digital information is stored is important in ensuring their longevity.

Digital preservation is defined as: long-term, error-free storage of digital information, with means for retrieval and interpretation, for all the time span that the information is required for. "Retrieval" means obtaining needed digital files from the long-term, error-free digital storage, without possibility of corrupting the continued error-free storage of the digital files. "Interpretation" means that the retrieved digital files, files that, for example, are of texts, charts, images or sounds, are decoded and transformed into usable representations. This is often interpreted as "rendering", i.e. making it available for a human to access. However, in many cases it will mean able to be processed by computational means.

Strategies

There are several strategies which individuals and organizations may use to combat the loss of digital information.

Refreshing

Refreshing is the copying of data onto newer media or systems. For example, transferring census data from an old tape to a new one or transferring an MP3 from a hard drive to CD. This strategy may need to be combined with migration when the software or hardware required to read the data is no longer available or is unable to understand the format of the data. Refreshing will likely always be necessary due to the deterioration of physical media.

Migration

Migration is the transferring of data to newer system environments (Garrett et al., 1996). This may include conversion of resources from one format to another (e.g., conversion of Microsoft Word to PDF or OpenDocument), from one operating system to another (e.g., Solaris to Linux) or from one programming language to another (e.g., C to Java) so the resource remains fully accessible and functional. Resources that are migrated run the risk of losing some type of functionality since newer formats may be incapable of capturing all the functionality of the original format, or the converter itself may be unable to interpret all the nuances of the original format. The latter is often a concern with proprietary data formats.

Replication

Creating duplicate copies of data on one or more systems is called replication. Data that exists as a single copy in only one location is highly vulnerable to software or hardware failure, intentional or accidental alteration, and environmental catastrophes like fire, flooding, etc. Digital data is more likely to survive if it is replicated in several locations. Replicated data may introduce difficulties in refreshing, migration, versioning, and access control since the data is located in multiple places.

Emulation

Emulation is the replicating of functionality of an obsolete system (Rothenberg, 1998). For example, emulating an Atari 2600 on a Windows system or emulating WordPerfect 1.0 on a Macintosh. Emulators may be built for applications, operating systems, or hardware platforms. Emulation has been a popular strategy for retaining the functionality of old video game systems. The feasibility of emulation as a catch-all solution has been debated in the academic community (Granger, 2000).

Raymond A. Lorie has suggested a Universal Virtual Computer (UVC) could be used to run any software in the future on a yet unknown platform (Lorie, 2001). The UVC strategy uses a combination of emulation and migration. The UVC strategy has not yet been widely adopted by the digital preservation community.

Trustworthy digital objects

Digital objects that can speak to their own authenticity are called trustworthy digital objects (TDOs). TDOs were proposed by Henry M. Gladney to enable digital objects to maintain a record of their change history so future users can know with certainty that the contents of the object are authentic (Gladney, 2004). Other preservation strategies like replication and migration are necessary for the long-term preservation of TDOs.

Examples of digital preservation initiatives

• National Digital Information Infrastructure and Preservation Program. The Library of Congress's National Digital Information Infrastructure and Preservation Program (NDIIPP) is dedicated to ensuring that the digital information that conveys our history and heritage is available and accessible for generations to come. As a pioneer in the field of digital information, the Library has continued to provide digitized access to its vast collections, especially through sites such as American Memory, America's Library, and Exhibits.
• Portico. Portico, originally launched by JSTOR in 2002, is an electronic archiving service which provides "a permanent archive of electronic scholarly journals".
• FDsys. FDsys is system being developed by the United States Government Printing Office to authenticate, preserve, and provide access to government information from all three branches of the Federal government.
• Elsevier Science digital archive. In 2002, the Koninklijke Bibliotheek became the official digital archive for 7 terabytes of Elsevier Science journals.
• LOCKSS. The LOCKSS Program ("Lots Of Copies Keep Stuff Safe"), under the auspices of Stanford University, develops and supports open-source software for digital preservation based on a distributed network of preservation appliances running a sophisticated voting protocol. Originally designed to preserve scholarly journals, the LOCKSS technology is now being used to preserve electronic theses and dissertations, government documents, books, blogs, websites, image collections, etc. The LOCKSS Program also runs its own preservation network ([1], [2]).
  • MetaArchive Project. Six universities (Emory University, the Georgia Institute of Technology, the Virginia Polytechnic Institute and State University, Florida State University, Auburn University and the University of Louisville) and the Library of Congress are developing "a cooperative for the preservation of at-risk digital content [about] the culture and history of the American South" in a private LOCKSS network.
  • ASERL ETDs. Eight universities of the Association of Southeastern Research Libraries (Florida State University, the Georgia Institute of Technology, North Carolina State University, the University of Kentucky, the University of Miami, the University of Tennessee, Vanderbilt University and the Virginia Polytechnic Institute and State University) are preserving each other's collections of electronic theses and dissertations (ETDs) in a private LOCKSS network.
  • GPO LOCKSS Pilot. The Government Printing Office conducted a pilot program to "manage, disseminate, and preserve access to Web-based Federal Government e-journals that are within the scope of the FDLP and IES" (Federal Depository Library Program and International Exchange Service), using LOCKSS technology. Pilot participants included 18 universities, the German National Library, the United States National Agricultural Library and the Government Printing Office ([3]).
  • Alaska State Publications Program. To continue complying with its obligations under Alaska state statutes to "make state publications freely available to Alaskans by distributing them to local depository libraries", the Alaska State Library is expanding its depository program to preserve Alaska State publications that are Web-only ([4]) by making them accessible to LOCKSS collection ([5]).
  • CLOCKSS. The CLOCKSS ("Controlled LOCKSS") is "a not-for-profit community partnership among publishers and libraries that is developing a distributed, validated, comprehensive archive that preserves and ensures continuing access to electronic scholarly content" using a private LOCKSS network. It mobilizes the resources of twelve large publishers (American Chemical Society, American Medical Association, American Physiological Society, Blackwell Publishing, Elsevier, Institute of Physics, Nature Publishing Group, Oxford University Press, SAGE Publications, Springer Science+Business Media, Taylor and Francis and John Wiley & Sons) and seven institutions (Indiana University, the New York Public Library, the OCLC, Rice University, Stanford University, the University of Virginia and the University of Edinburgh).
• New media art preservation. Arts organizations (including the Solomon R. Guggenheim Museum, the Berkeley Art Museum, the Daniel Langlois Foundation for Art, Science and Technology, the New Museum of Contemporary Art's's Rhizome.org [6] and the Franklin Furnace Archive, amongst others) have been collaborating on various initiatives in the research of New media art preservation. Such initiatives include the Variable Media Network [7] and the Arching the Avant Garde project [8].
• NDHA.The National Digital Heritage Archive (NDHA) Programme is a partnership between the National Library of New Zealand, Ex Libris Group and Sun Microsystems to develop a digital archive and preservation management system.

See also

• Data Format Management
• Digital curation
• Digital obsolescence
• Digital object identifier
• Enterprise content management
• File format
• Library of Congress Digital Library project
• Metadata
• National Digital Information Infrastructure and Preservation Program
• New media art preservation
• Universal Virtual Computer
• Web archiving
• Web crawler

References

• Garrett, J., D. Waters, H. Gladney, P. Andre, H. Besser, N. Elkington, H. Gladney, M. Hedstrom, P. Hirtle, K. Hunter, R. Kelly, D. Kresh, M. Lesk, M. Levering, W. Lougee, C. Lynch, C. Mandel, S. Mooney, A. Okerson, J. Neal, S. Rosenblatt, and S. Weibe (1996). "Preserving digital information: Report of the task force on archiving of digital information". Commission on Preservation and Access and the Research Libraries Group.

• Gladney, H. M. (2004). "Trustworthy 100-year digital objects: Evidence after every witness is dead". ACM Transactions on Information Systems 22 (3): 406-436.

• Granger, Stewart (2000). "Emulation as a Digital Preservation Strategy". D-Lib Magazine 6 (10).

• Hedstrom, M., Ross, S., Ashley, K., Christensen-Dalsgaard, B., Duff, W., Gladney, H., Huc, C., Kenney, A.R., Moore, R., Neuhold, E. (2003). "Invest to Save: Report and Recommendations of the NSF-DELOS Working Group on Digital Archiving and Preservation". NSF/DELOS.

• Jantz, R. & Giarlo, M.J. (2005). "Digital preservation: Architecture and technology for trusted digital repositories". D-Lib Magazine 11 (6).

• Lorie, Raymond A. (2001). "Long Term Preservation of Digital Information". Proceedings of the 1st ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '01), 346-352.

• Ross, S (2000). Changing Trains at Wigan: Digital Preservation and the Future of Scholarship. London, UK: National Preservation Office (British Library). ISBN 0-7123-4717-8. 

• Ross, S. and Gow, A. (1999). Digital archaeology? Rescuing Neglected or Damaged Data Resources. Bristol & London: British Library and Joint Information Systems Committee. ISBN 1-900508-51-6. 

• Rothenberg, Jeff (1998). Avoiding Technological Quicksand: Finding a Viable Technical Foundation for Digital Preservation. Washington, DC, USA: Council on Library and Information Resources. ISBN 1-887334-63-7. 

• Rothenberg, Jeff (1995). "Ensuring the Longevity of Digital Documents". Scientific American 272 (1).

• Rothenberg, Jeff (1999). "Ensuring the Longevity of Digital Information".

Expanded version of Ensuring the Longevity of Digital Documents.

External links

• CAMiLEON project — Emulation research conducted at the University of Michigan and University of Leeds in 2000–2002
• LOCKSS official site (see also CLOCKSS official site)
• Digital Preservation Tutorial - Cornell University Library
• DELOS Digital Preservation Cluster
• DigitalPreservationEurope
• Digital Preservation Coalition (UK). http://www.dpconline.org/
• DLM-Forum of the European Commission
• DOCAM - Documentation and Preservation of the Media Arts Heritage - international research alliance on the development of new methodologies and tools to address the issues of preserving and documenting digital, technological and electronic works of art
• ERPANET
• Guidelines for the Preservation of Digital Heritage. UNESCO, March 2003.
• International Research on Permanent Authentic Records in Electronic Systems (InterPARES)
• Library of Congress, National Digital Information Infrastructure and Preservation Program
• The Library of Congress, Sustainability of Digital Formats
• Managing and Preserving Digital Content - Canadian Heritage Information Network (CHIN)
• Preserving Access to Digital Information (PADI)
• UK Arts and Humanities Data Service
• UK Digital Curation Centre (DCC)
• UK Economic and Social Data Service (ESDS)
• Humanities Advanced Technology and Information Institute (HATII)
• CASPAR
• PLANETS
• RODA — An initiative from the Portuguese National Archives that aims at creating a digital repository system capable of preserving authentic digital objects.
• CRIB — A Service Oriented Architecture designed to assist cultural heritage institutions in the implementation of migration-based preservation interventions.
• Variable Media Network