Topic 7 - Data Management, Systems & Migration

Overview

  • Types of systems for managing files and data:
    DAMS, MAMS, DPS
  • Everything about migration

MAM? DAM!

A short list

of some popular OpenSource CMS:

A loooong list…

of not only OpenSource CMS:

https://bits.ashleyblewer.com/blog/2017/08/09/collection-management-system-collection/

A look into: CollectiveAccess

(NOTE: Do never ever use CA though. Ever.)

Basic descriptive metadata

Object/Agent Relationships

Controlled Vocabulary

Handling Media

Handling Media

DPS: Digital Preservation System

There are several workflows with individual tasks to be performed for preservation of digital objects.

DPS can help/improve organizing, monitoring and maintaing these tasks.

Archivematica website (2019)

Demo installation (Sandbox)

DVA-Profession: Mediathek website (2019)

Workflow management

Quality control

Other stuff

Comments?

Questions?

Now for something completely different…

Migration

XKCD #1909 Digital Resource Lifespan

How long?

Infinity +1

Eternal Migration

  • There is no final carrier.
  • There is no evergreen format.

Therefore fact: Any data must sooner or later be migrated.

Migration Types

  • Storage
  • Format
  • Software / platform / environment

Migration Types

Or more generically speaking:

  • Hardware
  • Software
  • File

Device Media

Optical Disks Hard Disk Drive Data Tape (LTO) Solid State Disk (no cover)

…or other media types (holograms, DNA, etc)

Data Format(s)

Digital Video Trinity

Mission Migration

Device Format Migration

  1. Plan your migration
  2. Copy the data
  3. Check integrity of copy
  4. Cross your fingers…

Migration Planning

  • Consider which changes are needed.
  • Evaluate when, how and who.
  • Make sure you have a valid backup.
  • Schedule possible downtime (and impact on work).
  • Impact on IT-administration/access?
  • Estimated duration until migration is finished?

Software / platform / environment

Might require:

  • Data format migration
  • Reorganizing file structure (relocate, rename)
  • Change of physical equipment
  • Testing to avoid regressions
  • etc.

Things can happen…

  • Silent regression
  • Unseen (meta)data changes
  • Domino-effect: Forced updates of other things
    I’m loving it! ®
  • etc.

Media Format Migration

How to check integrity of format/codec migration?

FrameMD5

FrameMD5 example

Eternal Migration

“After migration is before migration”

  • Embrace the concept of “Eternal migration”
  • Try considering how to get out of a technology before, or while you’re using it.
  • Find your timing sweet spot

Obsolescence monitoring

  • So, when is a good time to migrate?
  • What could happen if you wait too long?
  • Which vital components might become obsolete?

Migration Summary

  • Keep “Eternal Migration” in mind
  • Consider migrations before you buy
  • Migration + integrity checks = BFF
  • Ask for documentation!
  • Archive the sourcecode / schematics
  • Monitor technology news
  • Don’t wait too long…

Questions?

Comments?