Refreshment (CPP-030)

CPP-IdentifierCPP-030
CPP-LabelRefreshment
AuthorJohan Kylander
ContributorsMatthew Addis
EvaluatorsFelix Burger, Maria Benauer
Change historyComments
Version 1.0.0 - 2025-08-29Milestone version
Version 1.1.0 - 2026-03-25Migration to XML

1. Description of the CPP

The TDA replaces the Information Packages on a storage medium, copying them to a new medium and discarding the old one at the end of a storage medium's life cycle.

Inputs and outputs

Input(s)
Data
AIP
Metadata
Storage management information
Documentation/guidance
Storage management policy - Media
Output(s)
Data
AIP
Metadata
Storage management information
Record of decommissioning

Definition and scope

Refreshment is the process of anticipating the end of life of a storage medium and copying data to a new storage medium in order to safeguard AIPs on viable storage media at all times. It is a vital part of storage life-cycle management, and minimises the risk of data corruption.

A TDA may also decide to refresh a storage medium for various reasons such as:

  • Mitigate corruption: Large, media-wide errors or corruption are detected (e.g. a magnetic tape has become unreadable) by CPP-004 (Data Corruption Management).
  • Mitigate costs and risks: A storage medium (e.g. a server) reaches the end of its life and is no longer being supported by the vendor, potentially resulting in increased support costs or risks of unpatched security vulnerabilities.
  • Reduce costs and/or improve efficiency: For example, refreshing storage to take advantage of new generations of data tape and increase read/write speed, or to reduce physical footprint, power consumption etc.

The process of refreshment makes no changes to the AIPs themselves but only operates on the storage layer. A TDA may decide to physically replace the medium with an identical medium (e.g. replace an old magnetic tape by a new similar one), or choose a new medium (e.g. replace magnetic tapes with a new generation of tapes or a completely different type of storage medium). During refreshment, all AIPs on an old storage medium are copied onto a new storage medium and their fixity is verified. It is important to note that the medium undergoing refreshment is not always the source for replicating the data (e.g. copies on offline storage media or corrupted storage media are typically refreshed from an available storage medium). The old storage medium (including all data on it) then is removed from use and is either destroyed, recycled or repurposed (depending on its type).

A TDA may use a wide range of storage mediums to achieve data replication and storage diversity. Examples of a storage medium include discrete physical media (e.g. data tapes or archival storage discs), storage servers (e.g. online storage provided as NAS, SAN, DAS etc.) or any combination of these (e.g. tiered storage that combines files servers and tape libraries). This is not an exhaustive list. Each copy of a TDA’s data can be on a storage medium that consists of software, hardware and media.

The choice of storage types and their longevity is determined by Risk Mitigation (CPP-012). The TDA must have a strategy and a plan in place for:

  • Managing its storage hardware, software and media
  • Defining intervals of regular replacement for different storage
  • Procedures for the refreshment of the storage medium before it reaches the end of its life cycle

Process description

Trigger event(s)

Trigger EventCPP-identifier
A storage medium is near the end of its life cycle and must be replaced by a new storage medium
Detection of corruption or errors in a storage mediumCPP-004 (Data Corruption Management)
Potentials for reducing costs or improving efficiency by benefiting from storage medium technologies are identified

Step-by-step description

NoSupplierInputStepsOutputCustomer
 sequence
1CPP-012 (Risk Mitigation)Storage management policy - Media, flagging a storage medium that must be refreshedIdentify and locate the storage medium to be refreshedThe old storage medium that is to be refreshed
CPP-004 (Data Corruption Management)Detection of a faulty storage medium
Refreshment is identified as a way to reduce costs, increase efficiency, or improve environmental sustainability
2 Storage management information List all AIPs on the old storage mediumInventory of AIPs involved in the refreshment
3Storage management policy - MediaSelect source medium to copy the AIPs from (can be from storage other than the medium to be replaced)Authoritative storage medium for replicating/copying the AIP s
4Provision of a fresh storage medium that will replace the old oneThe fresh storage medium that will replace the old one
5Source storage medium of AIPsFor each AIP individually, start the copy process (steps 6 to 10):
Fresh storage medium
Inventory of AIPs involved in the refreshment
6Retrieve the AIP from the source storage medium
7Copy the AIP to the fresh storage mediumNew copy of AIP
8Existing/previous Fixity metadata Validate the fixity of the AIP on the fresh storage mediumValid status (9) - Fixity metadata
Invalid status (go back to 6) - Fixity metadata
9Record the fixity for the new AIP copy Fixity metadata
10Update the storage location for the new AIP copy Storage management information
11Inventory of AIPs involved in the refreshmentCheck that all AIPs in the inventory have been successfully copiedConfirm completeness of the copy process (12)
Error (go back to copy process loop)
12Update information about the fresh storage medium (e.g. File locations, media identifiers) and mark the old medium and its contents as ready for deletion/decommissioning Storage management information
13Create a preservation event for the refreshment Provenance metadata
14Old storage medium that has been refreshedEnsure data security and that confidentiality is not compromised by making sure that data on the old storage medium is properly deleted
15Decommission the old storage mediumRecord of decommissioning

Rationale(s) and worst case(s)

RationaleImpact of inaction or failure of the process
Manage the storage infrastructure life cycleStorage medium deteriorates/ degrades/ becomes faulty over time, which increases the risk of data corruption.Storage medium is no longer supported by the vendor, which increases risks to data due to lack of maintenance or unpatched security vulnerabilities.
Have multiple copies of data on multiple viable storage mediaIn cases of data corruption or destruction, recovery depends on having other intact copies
The TDA should achieve sustainabilityUsing old or obsolete storage media results in higher costs, lower operational efficiency, or higher environmental impact (compared to latest storage medium technologies).
Open source storage solutionsVendor lock-in in storage solutions pose a risk of a strong dependency to an external partner.

2. Dependencies and relationships with other CPPs

Dependencies

CPP-IDCPP-TitleRelationship description
CPP-012Risk MitigationThe strategy for data storage and storage infrastructure management is defined in a storage management policy which is based on a TDAs risk assessment and mitigation.

Other relations

RelationCPP-IDCPP-TitleRelationship description
Not to be confused withCPP-011ReplicationReplication creates new parallel copies of individual AIPs, refreshment creates new copies that replace the old ones. Moreover, CPP-011 aims for redundancy on an IP level, whereas Refreshment operates on a storage medium level.
Affinity withCPP-002Checksum ValidationAll new AIP copies must have their checksum validated to verify that the process was successful. The checksum validation is more mechanical in its nature in Refreshment, only aiming at verification of the copy process. In contrast to CPP-002, it does not have to negotiate with producers or examine the results.

4. Reference implementations

Publicly available documentation

InstitutionOrganisation typeLanguageHyperlink
TIB – Leibniz Information Centre for Science and Technology and University Library, DENational library
Non-commercial digital preservation service
Research infrastructure
Research performing organisation
English https://wiki.tib.eu/confluence/spaces/lza/pages/93608373/Archival+Storage#ArchivalStorage-Mediamigration
CSC – IT Center for Science Ltd., FINon-commercial digital preservation serviceEnglishhttps://urn.fi/urn:nbn:fi-fe2023062157386
(Section 3.2.4)
Finnishhttps://urn.fi/urn:nbn:fi-fe2024051731943
(Annex 3, section 2.1.1)