Etl and metadata l.jpg
This presentation is the property of its rightful owner.
Sponsored Links
1 / 8

ETL and Metadata PowerPoint PPT Presentation


  • 197 Views
  • Uploaded on
  • Presentation posted in: General

ETL and Metadata. The ETL Process. Presentation System. Source Systems. Staging Area. Transform. Extract. Load. Source. Business Owner. IS Owner. Platform. Location. Data Source Description. Source Data. Record the name location and data that exists in the TPS environment.

Download Presentation

ETL and Metadata

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Etl and metadata l.jpg

ETL and Metadata


The etl process l.jpg

The ETL Process

Presentation

System

Source

Systems

Staging

Area

Transform

Extract

Load


Source data l.jpg

Source

Business

Owner

IS

Owner

Platform

Location

Data Source

Description

Source Data

Record the name location and data that exists in the TPS environment.

  • File names and location

  • Layout

  • Attribute meaning


Extraction l.jpg

Target Table

Target Column

Data Type

Len

Target Column Description

Source System

Source Table / File

Source Col / Field

Data Txform Notes

Extraction

Copy specific data directly from the source tables into a working dataset in the staging area.


Transformation dimension tables l.jpg

Transformation(Dimension Tables)

  • Generate surrogate key in a primary-surrogate table. Make this permanent.

  • Insert the surrogate key into the working dimension tables.

  • Conduct any editing/cleaning operations you need (usually on the working table)

  • Generate any derived attributes you need.

  • Generate and retain process logs.


Transformation fact tables l.jpg

Chg Flag

Fact Group

Derived Fact Name

Derived Fact Description

Type

Agg Rule

Formula

Constraints

Transfor- mations

Transformation(Fact tables)

  • Join all dimensions to the fact table (using original primary keys). Insert surrogate keys

  • Generate derived facts

  • Generate indicator flags


Target data l.jpg

Table

Name

Column

Name

Data

Type

Len

Nulls?

Column

Description

PK

PK

Order

FK

Target Data

Describe the presentation data structure.

  • Model

  • Metadata

  • Usage and constraints


Flow documentation l.jpg

Flow Documentation

  • DFD for the ETL process

  • ERD for Source, Staging and Target databases.

  • Metadata

  • Usage notes.


  • Login