Creation of Derivatives (CPP-028)

CPP-IdentifierCPP-028
CPP-LabelCreation of Derivatives
AuthorKris Dekeyser
ContributorsJuha Lehtonen
EvaluatorsMatthew Addis, Felix Burger
Change historyComments
Version 1.0.0 - 2025-08-29Milestone version
Version 1.1.0 - 2026-04-24Migration to XML

1. Description of the CPP

The TDA generates derivative copies to address the specific needs of its Designated Community.

Inputs and outputs

Input(s)
Data
Source Representation of an Object
Documentation/guidance
File format policy - Derivatives
Output(s)
Data
A new Representation, a new AIP, or a DIP
Metadata
Provenance metadata
Structural metadata

Definition and scope

The process of Creation of Derivatives refers to generating new Representations of a digital Object (based on the original Representation of the Object) to address specific needs of the Designated Community. Some of these needs are:

  • Provide easy access to the information for a broader community (e.g. conversion from TIFF to JPEG in order to allow viewing in a web browser)
  • Provide access for a specific user base (e.g. converting CAD Files to a specific format that is more commonly in use by a group of researchers)
  • Provide different forms of access to the data (e.g. combining a tree of HTML-pages, images and other resources into a WARC File; unpacking a ZIP File; compiling data into a pivot table or chart)
  • Provide access to the data in formats that address accessibility challenges (e.g. creating DAISY derivatives of PDFs for visually impaired consumers)
  • Restricting or protecting the access to the data (e.g. creating a PDF from an e-book containing only the first few pages; lowering the resolution and watermarking; thumbnails)
  • Enriching the information (e.g. adding AI-generated transcriptions as subtitles to a video; overlaying transparent OCR text over a scanned image in a PDF; adding AI-generated Descriptive metadata)

Creation of Derivatives differs from other processes that create new Files or Representations:

  • Unlike File Migration (CPP-014), Creation of Derivatives reproduces only the information and significant properties of the original that is useful to address specific needs of the Designated Community. Thus, the output of Creation of Derivatives may lack part of the information that is not required to satisfy said needs.
  • File Normalisation (CPP-026) is performed during ingest and aims at reducing the number of formats by converting Files or Representations to preservation formats defined by the institutional formats policy.
  • File Migration (CPP-014) is performed after ingest to address a specific preservation risk.

Derivative copies can be short-lived and there can be more than one derivative copy for a given original. For example, derivative copies for a video master File could include multiple resolutions, different levels of compression and different encoding schemes (e.g. suited for previewing rather than reuse). The derivative videos may be generated to support contemporary web delivery standards such as HTML5 and as a result may be short lived compared to the copies created as a result of migration and/or normalisation.

It is up to the TDA to decide how far they take this and if they support any of these use cases, if at all. The generation of the derivative copies can be performed during delivery, during or before the ingestion or any time during the Object’s life cycle in the TDA. Performance, Object size, availability of conversion tools and workflows, and user requirements will be some of the elements that could play a role in this decision.

Depending on whether the derivative copy maintains the significant properties of the original Object, the derivative copy may then (a) be added to the same AIP as the original (e.g. as a new Representation), (b) result in a new AIP that is stored in addition to the original and is linked to it, or (c) may be held in a DIP which in turn may be stored temporarily or permanently, and is linked to the original AIP. In PREMIS terms, the derivative copies can be stored as a new Representation if the derivative copy is a complete and meaningful rendition of the Intellectual Entity. However, if the derivative copies change the meaning and of the original (e.g. significant properties are not maintained) then a new AIP or DIP is recommended.

Process description

Trigger event(s)

Trigger EventCPP-identifier
Request for access to a digital ObjectCPP-025 (Enabling Access)
SIP processing during IngestCPP-029 (Ingest)

Step-by-step description

NoSupplierInputStepsOutputCustomer
 sequence
1 alternative - Alternative triggers
1.aCPP-025 (Enabling Access)Request for access copy and requested Object(s)Identify the Representation to be processedRepresentation
1.bCPP-029 (Ingest)Ingest of a SIPIterate over the Representations in the SIPRepresentation
2Representation Determine if a derivative is needed by applying the rules in the policy to the Files in the Representation. End the process unless a derivative is needed
File format policy - Derivatives
3Representation Determine the migration path and apply it to the source File(s) in the Representation New File or set of Files
File format policy - Derivatives: tools
4File format policy - Derivatives Decide on the packaging of the File(s): a new Representation, a new AIP or a DIP. Representation, AIP or DIP
5 alternative - Alternative outputs step 4
5.aDIPDeliver the DIP and end the process
5.bCPP-001 (Checksum Generation and Recording)
CPP-008 (File Format Identification)
CPP-009 (Metadata Extraction)
CPP-010 (File Format Validation)
Representation or AIP Apply the characterisation processes against the new Object, optionally by running the ingest process and all its subprocessesValidated ObjectCPP-015 (Emulation and Rendering Tools)
6Report migration performed, success/failure, Files generatedAudit trail
Provenance metadata
Structural metadata

Rationale(s) and worst case(s)

RationaleImpact of inaction or failure of the process
FAIR Interoperable: I1. (Meta)data use a formal, accessible, shared, and broadly applicable language for knowledge representation. FAIR Reusable: R1.3. (Meta)data meet domain-relevant community standards i.o.w. To support Interoperability and Reuse of the data, it should be made available in a format or structure that closely matches its usage. The consumer of the data may resort to other tools to convert it and corrupt or distort the data in the process. The consumer of the data may be unable to use the data because it is not in a format they can use and they do not have the tools/knowledge to convert it themselves.
FAIR Findable Without derivative copies, the consumer of the data may find it difficult and time consuming to assess whether the data contains the content they need, for example they cannot easily preview/inspect derivatives that allow them to determine if they should go ahead and retrieve the full dataset.

2. Dependencies and relationships with other CPPs

Dependencies

CPP-IDCPP-TitleRelationship description
CPP-022Significant Properties Definition Though derivative copies may not be subject to the same requirements as preservation copies, providing access through copies that do not convey significant properties might be considered a TDA failure.
CPP-025Enabling Access The request for access can trigger the creation of a derivative copy for rendering purposes.

Other relations

RelationCPP-IDCPP-TitleRelationship description
May requireCPP-005Identifier Management A derivative copy of a File may get its own identifier.
May requireCPP-029Ingest During ingest derivative copies may be created.
Required byCPP-013Object Management Reporting Creation of new Objects provides data for statistical reporting.
FacilitatesCPP-015Emulation and Rendering Tools Derived copies in a different format or structure than the original Representation can help in rendering the data or simulating the environment.
Not to be confused withCPP-014File Migration Creation of a derivatives creates an additional Representation to be retained, while the migration outcome is supposed to replace its source.
Not to be confused withCPP-026File Normalisation Unlike File Normalisation (CPP-026), Creation of Derivatives (CPP-028) reproduces only the information and significant properties of the original that is useful to address specific needs of the Designated Community. Thus, the output of Creation of Derivatives may lack part of the information that is not required to satisfy said needs. Normalisation aims to maintain all the significant properties of the original.

4. Reference implementations

Publicly available documentation

InstitutionOrganisation typeLanguageHyperlink
TIB - Leibniz Information Centre for Science and Technology and University Library , DENational library
Non-commercial digital preservation service
Research infrastructure
Research performing organisation
Englishhttps://wiki.tib.eu/confluence/spaces/lza/pages/93608628/Pre-Ingest?preview=/93608628/93608629/pre-ingest.png
(part of pre-ingest routines)
Englishhttps://wiki.tib.eu/confluence/spaces/lza/pages/93608628/Pre-Ingest?preview=/93608628/310285401/film_digitization.png
(part of pre-ingest routines)
Archivematica, CADigital preservation systemEnglishhttps://www.archivematica.org/en/docs/archivematica-1.17/user-manual/ingest/ingest/#normalize
( In Archivematica, creating derivatives (called access copies) are part of normalisation. ​)
Englishhttps://www.archivematica.org/en/docs/archivematica-1.17/user-manual/preservation/preservation-planning/#normalization
( In Archivematica, creating derivatives (called access copies) are part of normalisation. ​)