Object Management Reporting (CPP-013)

CPP-IdentifierCPP-013
CPP-LabelObject Management Reporting
AuthorJohan Kylander
ContributorsMatthew Addis
EvaluatorsFranziska Schwab, Felix Burger, Maria Benauer
Change historyComments
Version 1.0.0 - 2025-08-29Milestone version
Version 1.1.0 - 2026-03-26Migration to XML
Version 1.2.0 - 2026-05-18Reassigned step numbers based on new numbering rules.

1. Description of the CPP

The TDA delivers reporting to enable the effective management of Objects. This must include a wide range of functional, operational, and statistical reports and analytics.

Inputs and outputs

Input(s)
Metadata
Provenance metadata
Technical metadata
Rights data
Errors and Warnings
Output(s)
Metadata
Provenance metadata
Documentation/guidance
Reports
Statistical data

Definition and scope

Object management reporting is a process in which the TDA creates reports; outputs Provenance metadata; and produces statistical data on the content it preserves. The reporting is needed to enable effective management of Objects. Reporting is done for both the TDA itself, helping it in its preservation planning and as input for Risk Mitigation (CPP-012), and for the designated communities and stakeholders that produce and consume the data. Effective reporting enables a TDA to conduct digital preservation and to select the Information packages or Objects when performing preservation actions.

Reporting on the content includes reports and Provenance metadata from other CPPs that perform actions on digital content. For example, this includes processes that periodically check the quality of the data in Data Quality Assessment (CPP-019) or during triggered events such as Ingest (CPP-029) and Enabling Access (CPP-025):

  • Reports from periodic Integrity Checking (CPP-003);
  • Preservation actions taken and documented in Data Corruption Management (CPP-004);
  • Virus Scanning reports (CPP-007);
  • File Format Identification (CPP-008) reports;
  • File Format Validation (CPP-010) reports;
  • File Migration (CPP-014);
  • Data on Emulation and Rendering Tools (CPP-015);
  • Metadata from Metadata Ingest and Management (CPP-016);
  • Metadata from Rights Management (CPP-020);
  • Metadata from Significant Properties Definition (CPP-022);
  • Preservation actions taken and documented in File Repair (CPP-027);
  • Data from the Creation of Derivatives (CPP-028) process;
  • Metadata from the access and use of Objects in TDA by the designated community;
  • Metadata on the data volumes and growth rates of the Objects held by the TDA.

As the purpose of reporting is to enable the preservation and the management of digital Objects, the reports usually cover the main types of data that a TDA operates with. This may include data on:

  • File formats;
  • Technical metadata and significant properties of Objects;
  • Tools and software needed to manage the content;
  • The health of Objects and actions taken to remedy errors;
  • The hardware infrastructure;
  • Metadata and metadata standards;
  • The provenance of the Objects;
  • The licenses and rights to retain, preserve and provide access to Objects;
  • The level of usage of Objects in the TDA;

The report types produced in the reporting process can be categorised as follows:

  • Statistical data (e.g. number of Objects, file sizes etc.): Used for helping a TDA or stakeholder assess the scope of preservation actions;
  • Provenance metadata (i.e. documented preservation actions by the TDA): Used for assessing the state of Objects, the so called "health" of the Files, and to add authenticity by documenting the life-cycle of all digital content in a TDA;
  • In depth machine-actionable reports (usually produced by tools): These are used as input in other processes conducted by the TDA;
  • Links to knowledge base resources (e.g. file format registries): These are used to help a TDA in preservation planning.

Reporting activities as well as the report types listed above feed into a wide range of management processes and decision making. Some examples include:

  • Risk assessment and preservation planning (e.g. using reports on file formats);
  • Reporting to funders and stakeholders (e.g. by providing usage statistics);
  • Capacity planning and purchasing decisions (e.g. purchasing and refreshment of storage infrastructure based on statistics on data volumes and growth rates);
  • Compliance assessments (e.g. using reports on rights and participant consent to check that personal data is retained in compliance with GDPR);
  • Optimisation and cost management (e.g. identification of expensive or inefficient processes based on execution time and steps required, or optimising the use of different storage classes for frequently or infrequently accessed data based on usage statistics);
  • Identification of anomalies in error rates or failures (e.g. unusually problematic content from specific depositors);
  • Deaccessioning of Objects (e.g. reports on Objects that no longer need to be retained because their retention schedules are about to expire, or reports on quality assessment that mean Objects no longer meet the needs of a designated community);
  • Environmental sustainability (e.g. use of storage, processing and access statistics as an input to calculating carbon footprint).

When the process description uses the term report, it can be any of the above.

Process description

Trigger event(s)

Trigger EventCPP-identifier
IngestCPP-029 (Ingest)
Enabling AccessCPP-025 (Enabling Access)
Risk MitigationCPP-012 (Risk Mitigation)
Data Quality AssessmentCPP-019 (Data Quality Assessment)
Reporting needs from the stakeholders or designated communities

Step-by-step description

NoSupplierInputStepsOutputCustomer
 sequence
1 sequence - Determination and collection of required data
1.1 sequence - Evaluation of Reporting requests
1.1.1CPP-029 (Ingest)
CPP-025 (Enabling Access)
CPP-012 (Risk Mitigation)
CPP-019 (Data Quality Assessment)
Reporting request (from CPPs, stakeholders or the consumers) in the form of a Report SpecificationThe TDA receives the request and determines what data is required to provide the requested reportSpecification of the data required for the report
1.1.2Specification of the data required for the reportDetermine if reporting data is available (e.g. is it already an output of other CPPs)Availability of data required for the report
1.1.3Availability of data required for the report.Optional: Determine if changes are needed to data aggregation.If the reporting data is not available:
  1. Determine the steps that would be needed in order to capture it
  2. Discuss reporting requirements with the requestor and agree revisions to report
Updated Report Specification
Updated Specification of data required for the report
1.2 sequence - Revising report specification
1.2.1Updated Specification of data required for the report (from 1.1.3)Optional: In case of changes to data requirements, the CPPs that produce the required data are revised so that the necessary data is produced and compiles the report (as provided by other CPPs)
1.2.2Updated Specification of data required for the report (from 1.1.3)Optional: The TDA gathers and aggregates the data needed for the test report.Data required for report
1.2.3Data required for reportOptional: The test report is compiled and reviewed with the requestor.If further modifications are needed to the data and data collection, then go back to step 1.2.1.Finalised Specification of Report
Report Specification
2 sequence - Handling recurring reports
2.1Reporting scheduleOptional: If the report is required on a regular basis, e.g. monthly, then a reporting schedule is set for collecting data on a regular basisScheduled report data aggregation
3 sequence - Data aggregation and report creation
3.1Specification of data required for the report (from 1.1.1 or 1.1.3)Gather and aggregate data for reportData required for report.CPP-029 (Ingest)
CPP-025 (Enabling Access)
CPP-012 (Risk Mitigation)
CPP-019 (Data Quality Assessment)
Scheduled report data aggregation (from 2.1)
3.2Data required for report (from 3.1)Produce Report and deliver to Requestor.If a report is produced regularly, then loop to Step 3.1.Report
Report Specification (from 1.1.1 or 1.2.3)

Rationale(s) and worst case(s)

RationaleImpact of inaction or failure of the process
The TDA knows what Information packages it preserves and what they containWithout being able to locate and report the data it holds, the TDA cannot perform any preservation actions or provide (e.g. searching by Rights, Provenance and Descriptive metadata within the Information packages).
The TDA knows which file formats it holds and can locate these Objects within Information packagesWithout knowing in what format the Objects it holds are, the TDA cannot plan preservation actions or inform the designated communities about preservation strategies.
The TDA knows what metadata standards it holds and which standards apply to which ObjectsWithout being able to analyse the Objects and their significant properties, the TDA cannot plan preservation actions, provide discovery or access.
The TDA maintains and generates Provenance metadata during preservationProcesses that produce reports and provenance data must have their output stored. This information is needed to analyse the Objects in a TDA, create quality reports, provide designated communities with assurance of a high quality digital preservation
The TDA knows its hardware infrastructure and has a plan for its managementWithout knowledge on the hardware infrastructure, the TDA cannot maintain high-quality bit-level preservation and report to the stakeholders.
The TDA knows the rights it has to preserve and provide access to its holdings.Without knowledge of rights and retention schedules, the TDA cannot know with confidence that it has the permission to preserve its holdings or whether it is holding content that should be deaccessioned.

2. Dependencies and relationships with other CPPs

Dependencies

CPP-IDCPP-TitleRelationship description
CPP-003Integrity CheckingPeriodic integrity checking provides reports on the integrity of data and reports corrupted AIPs.
CPP-004Data Corruption ManagementFixing corrupted AIPs produces Provenance metadata and data for quality reporting to the stakeholders.
CPP-007Virus ScanningReports on virus scanning activities, frequency of threats, and outcomes of the actions provide essential input for operational management and risk assessment.
CPP-008File Format IdentificationFile format identification reports are required for a TDA to enable it to manage its content.
CPP-010File Format ValidationFile format validation provide essential information on the well-formedness and validity of the Objects; validation errors; and data on the tools used in the process.
CPP-014File MigrationFile migration provides information on the outcome of the process as well as tools used.
CPP-015Emulation and Rendering ToolsThe process of selecting tools for emulation and rendering provides data to the TDA for reporting to the designated communities.
CPP-016Metadata Ingest and ManagementMetadata ingest provides new Provenance metadata.
CPP-022Significant Properties DefinitionTo report on the characteristics of Objects for deeper analysis, the significant properties must have been defined.
CPP-027File RepairFixing invalid Files produces Provenance metadata and data for quality reporting to the stakeholders.
CPP-028Creation of DerivativesCreation of new Objects provides data for statistical reporting.

Other relations

RelationCPP-IDCPP-TitleRelationship description
May requireCPP-005Identifier ManagementThe management and reporting should require that the data is identified with PIDs.
Affinity withCPP-029IngestIngest is both an important provider of reporting data to the TDA (via other CPPs) as well as a customer, as the ingest checks and outcomes must be reported to the producer.
Affinity withCPP-025Enabling AccessEnabling Access of contents include providing Provenance metadata, statistical data and quality reports to the consumer.
Affinity withCPP-012Risk MitigationTo plan and mitigate risks in preservation, a TDA needs to provide input on the preservation system, the quality of the data, significant properties in Objects, storage management Metadata etc.
Affinity withCPP-019Data Quality AssessmentTo evaluate the quality of the data, the process needs input in the form of various Metadata.

4. Reference implementations

Publicly available documentation

InstitutionOrganisation typeLanguageHyperlink
TIB - Leibniz Information Centre for Science and Technology and University Library , DENational library
Non-commercial digital preservation service
Research infrastructure
Research performing organisation
English https://knowledge.exlibrisgroup.com/Rosetta/Training/Rosetta_Essentials/Data_Management/7.1_Searching_the_Rosetta_Permanent_Repository
English https://knowledge.exlibrisgroup.com/Rosetta/Knowledge_Articles/Is_there_a_list_of_all_of_the_SOLR_search_fields_in_Rosetta%3F
English https://wiki.tib.eu/confluence/spaces/lza/pages/93608951/Metadata
CSC - IT Center for Science Ltd., FINon-commercial digital preservation serviceEnglish https://digitalpreservation.fi/en/services/quality_reports/2024
Archivematica, CADigital preservation systemEnglish https://www.archivematica.org/en/docs/archivematica-1.18
( Limited reporting. However, Archivematica is built on MySQL and ElasticSearch so there is the potential to generate more reports by directly accessing the databases/indexes. )
Rosetta, UKDigital preservation systemEnglish https://knowledge.exlibrisgroup.com/Rosetta/Training/Rosetta_Essentials/Data_Management/7.1_Searching_the_Rosetta_Permanent_Repository
English https://knowledge.exlibrisgroup.com/Rosetta/Knowledge_Articles/Is_there_a_list_of_all_of_the_SOLR_search_fields_in_Rosetta%3F