etl and metadata
Download
Skip this Video
Download Presentation
ETL and Metadata

Loading in 2 Seconds...

play fullscreen
1 / 8

ETL and Metadata - PowerPoint PPT Presentation


  • 245 Views
  • Uploaded on

ETL and Metadata. The ETL Process. Presentation System. Source Systems. Staging Area. Transform. Extract. Load. Source. Business Owner. IS Owner. Platform. Location. Data Source Description. Source Data. Record the name location and data that exists in the TPS environment.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'ETL and Metadata' - ianna


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
the etl process
The ETL Process

Presentation

System

Source

Systems

Staging

Area

Transform

Extract

Load

source data

Source

Business

Owner

IS

Owner

Platform

Location

Data Source

Description

Source Data

Record the name location and data that exists in the TPS environment.

  • File names and location
  • Layout
  • Attribute meaning
extraction

Target Table

Target Column

Data Type

Len

Target Column Description

Source System

Source Table / File

Source Col / Field

Data Txform Notes

Extraction

Copy specific data directly from the source tables into a working dataset in the staging area.

transformation dimension tables
Transformation(Dimension Tables)
  • Generate surrogate key in a primary-surrogate table. Make this permanent.
  • Insert the surrogate key into the working dimension tables.
  • Conduct any editing/cleaning operations you need (usually on the working table)
  • Generate any derived attributes you need.
  • Generate and retain process logs.
transformation fact tables

Chg Flag

Fact Group

Derived Fact Name

Derived Fact Description

Type

Agg Rule

Formula

Constraints

Transfor- mations

Transformation(Fact tables)
  • Join all dimensions to the fact table (using original primary keys). Insert surrogate keys
  • Generate derived facts
  • Generate indicator flags
target data

Table

Name

Column

Name

Data

Type

Len

Nulls?

Column

Description

PK

PK

Order

FK

Target Data

Describe the presentation data structure.

  • Model
  • Metadata
  • Usage and constraints
flow documentation
Flow Documentation
  • DFD for the ETL process
  • ERD for Source, Staging and Target databases.
  • Metadata
  • Usage notes.
ad