Operational metadata for federating statistical reference systems at eurostat
This presentation is the property of its rightful owner.
Sponsored Links
1 / 16

OPERATIONAL METADATA FOR FEDERATING STATISTICAL REFERENCE SYSTEMS AT EUROSTAT PowerPoint PPT Presentation


  • 77 Views
  • Uploaded on
  • Presentation posted in: General

OPERATIONAL METADATA FOR FEDERATING STATISTICAL REFERENCE SYSTEMS AT EUROSTAT. G. Pongas, F. Vernadat EC Eurostat B2. Overview of the talk. Introduction CVD (Cycle de Vie des Données) REFIN: Internal Reference Eurostat Dissemination Portal (Site 3) Conclusion. Introduction.

Download Presentation

OPERATIONAL METADATA FOR FEDERATING STATISTICAL REFERENCE SYSTEMS AT EUROSTAT

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Operational metadata for federating statistical reference systems at eurostat

OPERATIONAL METADATA FOR FEDERATING STATISTICAL REFERENCE SYSTEMS AT EUROSTAT

G. Pongas, F. Vernadat

EC Eurostat B2


Overview of the talk

Overview of the talk

  • Introduction

  • CVD (Cycle de Vie des Données)

  • REFIN: Internal Reference

  • Eurostat Dissemination Portal (Site 3)

  • Conclusion


Introduction

Introduction

Metadata in statistical information:

  • define some of the semantics of data

  • needed for proper production and usage of data

  • make data comparable

  • ensure some level of data quality

  • required for efficient search


Cvd cycle de vie des donn es

CVD (Cycle de Vie des Données)


Current situation at eurostat

Current Situation at Eurostat


Operational metadata for federating statistical reference systems at eurostat

EUROSTAT INTERNAL REFERENCEThe problem

Two many different systems at EUROSTAT for handling data:

  • FAME

  • Oracle Express

  • Oracle RDBMS

  • SAM

  • SAS


Operational metadata for federating statistical reference systems at eurostat

REFIN: The problem (Cont’d)

  • Some of them are general purpose (e.g. Oracle RDBMS) whereas others may include special features (for data validation or computation) but they all have their own access methods and user interfaces (Express Analyser, FAME...)

  • Major drawbacks:

    • High complexity for users

    • Data comparison between different systems is not easy


Operational metadata for federating statistical reference systems at eurostat

What is REFIN ?

The REFIN system specifically addresses these issues

  • Gives access to heterogeneous systems

  • Provides the users with a common interface

    • Data location and source system is hidden

    • Data not duplicated, access to the original data.

  • Uses a unique exchange format (PIVOT)

  • Implements specific security rules


Operational metadata for federating statistical reference systems at eurostat

REFIN architecture

SECURITY LAYER

REFIN

INTERNAL REFERENCE

METADATA

REFIN ADAPTOR

METADATA + LOCALISATION DATA + PROCEDURES

HLI

SNAPI

OCI

RPC/DCE or XML

DAO/ODA/ODBC

ORACLE EXPRESS

DATA Bases

+METADATA

FAME

DATA Bases

+METADATA

ORACLE DBMS

DATA bases

+METATDATA

MICROSOFT ACCESS

SAM+METADATA


Operational metadata for federating statistical reference systems at eurostat

1) Generation of REFIN metadata

2) Mapping to Common Metadata

REFIN architecture

REFIN

Particular

Metabases

Metabase

Builder

FAME

Metabase

Converter

SAM

EXPRESS

REFIN

Common

Metabase

ORACLE


Operational metadata for federating statistical reference systems at eurostat

REFIN architecture

HLI

FAME

FAME Driver

ODBC

SAM Driver

SAM

REFIN

API

SNAPI

EXPRESS

EXPRESS Driver

OCI

ORACLE

ORACLE Driver


Operational metadata for federating statistical reference systems at eurostat

New possibilities provided by REFIN

To build heterogeneous data sets by mixing data from different origins and systems


Eurostat dissemination portal site 3

Business Layer

Back-office Layer

Presentation Layer

Data

sets

(fixed)

XML/XSL

JSP

ESTAT Portal Platform

SUITE

NewCronos

(Num. Data

+ metadata)

WSDL/SOAP

Data

sets

(open)

EVA/EVALight

Service

call

Open Datasets

Web services

Web

Cache

Professional

user

Application Server

Comext DB

(Ref. Data

+ statistical

metadata)

Comext

Client

Comext

Server

Quick/Adv. Search

Subscription

Alert/Info push

Content Download

Content Import

Print

E-commerce

XML/XSL

JSP

Portal

Web

Server

Application Integration

Internet

RAMON

CODED

Statistical

Metadata

Internet user

CIRCA

User Groups

. EC

. Journalists

. Students

. Citizens

. ...

STATPUB

DOUCEUR

LDAP

Publications

Datasets

Publications

EU-Bookshop

(OPOCE)

API

Local DB/

File server

EU-DOR

EU off. Publi.

Dedicated

sections

+ virtual Publi/Datasets (URL’s)

+ METADATA

Eurostat Dissemination Portal (Site 3)


Site 3 metadata

Site 3 Metadata


Site 3 metadata1

Site 3 Metadata


Conclusion

Conclusion

  • Importance of linking data and metadata

  • Importance of having an integrated metadata environment

  • Clear distinction between

    • Statistical metadata

    • IT metadata

    • Dissemination metadata


  • Login