David Giaretta

Vast amounts of scientific, cultural, social, business and government, and other, information is being created every day. There are billions of objects, in a multitude of formats, semantics and associated software. Much, perhaps the majority, of this information is transitory but there is still an immense amount which should be preserved for the medium and long term – perhaps even indefinitely. Preservation requires that the information continues to be usable, not simply to be printed or displayed. Of course, the digital objects (the bits) must be preserved, as must the “metadata” which enables the bits to the understood which includes the software. Before LABDRIVE no system could adequately preserve such information, especially in such gigantic volume and variety. In this paper we describe the development of LABDRIVE and its ability to preserve tens or hundreds of petabytes in a way which is conformant to the OAIS Reference Model and capable of being ISO 16363 certified.

As information and communication technology has become pervasive in our society, we are increasingly dependent on both digital data and repositories that provide access to and enable the use of such resources. Repositories must earn the trust of the communities they intend to serve and demonstrate that they are reliable and capable of appropriately managing the data they hold.

To preserve digitally encoded information over a long term following the OAIS Reference Model requires that the information remains accessible, understandable and usable by a specified Designated Community. These are significant challenges for repositories. It will be argued that infrastructure which is needed to support this preservation must be seen in the context of the broader science data infrastructure which international and national funders seek to put in place. Moreover aspects of the preservation components of this infrastructure must themselves be preservable, resulting in a recursive system which must also be highly adaptable, loosely coupled and asynchronous. Even more difficult is to be able to judge whether any proposal is actually likely to be effective. From the earliest discussions of concerns about the preservability of digital objects there have been calls for some way of judging the quality of digital repositories. In this chapter several interrelated efforts which contribute to solutions for these issues will be outlined. Evidence about the challenges which must be overcome and the consistency of demands across nations, disciplines and organisations will be presented, based on extensive surveys which have been carried out by the PARSE.Insight project (http://www.parse-insight.eu). The key points about the revision of the OAIS Reference Model which is underway will be provided; OAIS provides many of the key concepts which underpin the efforts to judge solutions. In the past few years the Trustworthy Repositories Audit and Certification: Criteria and Checklist (TRAC) document has been produced, as well as a number of related checklists. These efforts provide the background of the international effort (the RAC Working Group http://wiki.digitalrepositoryauditandcertification.org) to produce a full ISO standard on which an accreditation and certification process can be built. If successful this standard and associated processes will allow funders to have an independent evaluation of the effectiveness of the archives they support and data producers to have a basis for deciding which repository to entrust with their valuable data. It could shape the digital preservation market. The CASPAR project (http://www.casparpreserves.eu) is an EU part funded project with total spend of 16MEuros which is trying to faithfully implement almost all aspects of the OAIS Reference Model in particular the Information Model. The latter involves tools for capturing all types of Representation Information (Structure, Semantics and all Other types), and tools for defining the Designated Community. This chapter will describe implementations of tools and infrastructure components to support repositories in their task of long term preservation of digital resources, including the capture and preservation of digital rights management and evidence of authenticity associated with digital objects. In order to justify their existence, most repositories must also support contemporaneous use of contemporary as well as “historical” resources; the authors will show how the same techniques can support both, and hence link to the fuller science data infrastructure.

The proper preservation of both the current and historical scientific data will underpin a multitude of ecological, economic and political decisions in the future of our society. The SCIDIP-ES project addresses the long-term persistent storage, access and management needs of scientific data by providing preservation infrastructure services. Taking exemplars from the Earth Science domain we highlight the key preservation challenges and barriers to be overcome by the SCIDIP-ES infrastructure. SCIDIP-ES augments existing science data e-infrastructures by adding specific services and toolkits, which implement core preservation concepts, thus guaranteeing the long-term access to data assets across and beyond their designated communities.

Network modelling provides a framework for the systematic analysis of needs and options for preservation. A number of general strategies can be identified, characterised and applied to many situations; these strategies may be combined to produce robust preservation solutions tailored to the needs of the community and responsive to their environment. This paper provides an overview of this approach. We describe the components of a Preservation Network Model and go on to show how it may be used to plan preservation actions according to the requirements of the particular situation using illustrative examples from scientific archives.

The proper preservation of both current and historical scientific data will underpin a multitude of ecological, economic and political decisions in the future of our society. The SCIDIP-ES project addresses the long-term persistent storage, access and management needs of scientific data by providing preservation infrastructure services. Taking exemplars from the Earth Science domain we highlight the key preservation challenges and barriers to be overcome by the SCIDIP-ES infrastructure. SCIDIP-ES augments existing science data e-infrastructures by adding specific services and toolkits, which implement core preservation concepts, thus guaranteeing the long-term access to data assets across and beyond their designated communities.

The challenge of digital preservation of scientific data lies in the need to preserve not only the dataset itself but also the ability it has to deliver knowledge to a future user community. A true scientific research asset allows future users to reanalyze the data within new contexts. Thus, in order to carry out meaningful preservation we need to ensure that future users are equipped with the necessary information to re-use the data. This paper presents an overview of a preservation analysis methodology which was developed in response to that need on the CASPAR and Digital Curation Centre SCARP projects. We intend to place it in relation to other digital preservation practices, discussing how they can interact to provide archives caring for scientific data sets with the full arsenal of tools and techniques necessary to rise to this challenge.

This paper provides an overview of the needs and threats for digital preservation and summarizes the findings from project PARSE.Insight. This project, co‐funded by the EU, contains one of the first large worldwide surveys about digital preservation including most players of the STM information chain: researchers, libraries, data managers, publishers, and research funders. One of the conclusions is that in the present data deluge, it is extremely important that all players in the information chain work together on proper digital preservation of all research output, to ensure its future usability, understandability, and authenticity. This poses a new role for publishers who can ensure better discoverability and citability via good linking and integration of data and publications.

Purpose: The purpose of this paper is to describe the use of XML formatted data unit (XFDU) technology to implement OAIS‐based information packaging in the CASPAR project.Design/methodology/approach: The paper outlines new tools and techniques in working with XFDU for the purpose of preserving complex digital information.Findings: The preservation of digital assets was facilitated by using the features of XFDU in the CASPAR project.Practical implications: The paper is of interest to those responsible for the archival or long term preservation of digital assets.Originality/value: The paper demonstrates new tools and techniques, which together provide an integrated system suitable for solving complex issues of preserving digital assets using information packaging.