1 / 11

Metadata requirements for archiving structured data

This article provides an overview of the integrated metadatabase (IMDB) in the survey life cycle and outlines the processes for archiving and disposal. It discusses the different types of metadata needed for archiving and provides insights into the management of archive repositories.

swade
Download Presentation

Metadata requirements for archiving structured data

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Metadata requirements for archiving structured data Alice BornStatistics Canada Joint UNECE/Eurostat/OECD Work Session on Statistical Metadata (9-11 April 2008)

  2. IMDB business model – archive focus Survey Applications/Software Datafiles in archive repository Frame and sample Survey instance Questionnaire Datasets Products(COR) Survey design Data elements Value domains

  3. Outline • Overview of the integrated metadatabase (IMDB) in the survey life cycle • Archive and disposal processes • Metadata requirements for archiving • Registration

  4. IMDB in the survey life cycle Data Warehouses Operations Management Quality Assurance Analysis Dissemination IMDB IMDB Metadata Design Collect Edit Estimate Tabulate Publish Archive + disposal Operational Data Registers Survey Data Administrative Data Operational Data Stores

  5. Processes for archiving and disposal 8. Archiving and disposal 8.1 Manage archive repository • define archival format, format data, load data, record event dates, links to metadata registry (IMDB) 8.2 Preserve data and associated metadata • Identify data/metadata, record archive request, transfer data/metadata, etc. 8.3 Dispose data and associated metadata • Identify data to dispose, remove from archive, etc.

  6. Types of metadata for archiving structured data (1) • Administrative metadata • Maintaining and keeping track of the archived datafile • Link to an IMDB record – SDDS or unique datafile identifier • Structural metadata • Name of the datafile • File format – record layout • Software • Storage media, location

  7. Types of metadata for archiving structured data (2) 3. Survey and definitional metadata • Already in the IMDB • Survey description • Questionnaires, questions, response choice • Methodology • Measures of data quality • Variables (ISO 11179) • Additional documentation – interviewer guide, coding tool

  8. Administrative layer Statistical Activity Organization Survey Stewardship Contact Universe Documentation Frame Identification Survey instance Identification Time Frame Instrument Keyword Question Classification Theme Data file Methodology Data Element Instrument designSamplingData sourceError detectionImputationEstimationQuality evaluationDisclosure controlRevisions and seasonal adjustmentData accuracy Data Element Concept Administereditems Object Class Property Formula Conceptual Domain Value Domain

  9. Registration status Disposed Registration Authority Preferred standard (Completeness, accuracy, adherence to quality and terminological description standards) Archived Standard Retired Standards Division Registrar Qualified Regular Registrar Recorded Responsible Owner (Content) Candidate Historical Submitter Steward Incomplete

  10. IMDB Corporate Memory: Data and metadata for archive and disposal phases Operational data Registers Survey Data Administrative Data Metadata for archive and disposal Public Use Microdata Files Archive repository + Clean Master Files Disposal

More Related