Defining source metadata
This presentation is the property of its rightful owner.
Sponsored Links
1 / 41

Defining Source Metadata PowerPoint PPT Presentation


  • 94 Views
  • Uploaded on
  • Presentation posted in: General

Defining Source Metadata. Objectives. After completing this lesson, you should be able to do the following: Define and create flat file and Oracle modules Import and sample flat file sources Import relational database objects in an Oracle module View source data in Data panel. Lesson Agenda.

Download Presentation

Defining Source Metadata

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Defining source metadata

Defining Source Metadata


Objectives

Objectives

  • After completing this lesson, you should be able to do the following:

    • Define and create flat file and Oracle modules

    • Import and sample flat file sources

    • Import relational database objects in an Oracle module

    • View source data in Data panel


Lesson agenda

Lesson Agenda

  • Data warehouse implementation: Typical steps

    • Metadata to data

    • Relational and flat file source metadata: Difference

    • Data sources

  • Flat file sources

    • Create a flat file module

    • Import and sample a flat file

  • Oracle database sources

    • Create an Oracle module and import Oracle database objects

    • View the source tables data


Data warehouse implementation typical steps

1. Define the source metadata.

2. Define staging area metadata.

3. Define a relational dimensional

model.

4. Create process flows.

5. Deploy the mappings.

6. Execute or run the mappings.

7. View the data.

Data Warehouse Implementation: Typical Steps

Part 1

Part 2


Metadata to data

Metadata to Data

1. Initialize and organize the modules.

2. Import the metadata.

(This gives you only the data definition.)

3. Use the metadata to define

the mapping.

4. Deploy and execute the mapping

to load the data.


Difference between obtaining relational and flat file source metadata

Difference Between Obtaining Relational and Flat File Source Metadata

XSALES Tables

The database link extracts Oracle tables metadata.

Staging area

Oracle Databasemodule:XSALES

The flat files are imported and sampled.

Flat filesource module:FILE_SOURCE


Source module

Source Module

  • A module is a logical grouping of related objects under a single folder.

  • Source modules hold metadata describing source systems from which you extract data.

OWB 11g does not distinguish between source and target modules


Lesson agenda1

Lesson Agenda

  • Data warehouse implementation: Typical steps

    • Metadata to data

    • Relational and flat file source metadata: Difference

    • Data sources

  • Flat file sources

    • Create a flat file module

    • Import and sample a flat file

  • Oracle database sources

    • Create an Oracle module and import Oracle database objects

    • View the source tables data


Data sources

Flat file source

FILE_SOURCE

customers.txt (delimited)

file_geography_multi.csv (multi-record)

Relational source

XSALES

Channels

Products

Cities

ORDERS_SRC

Data Sources


Creating a flat file source module

Creating a Flat File Source Module

2

1

3


Create module wizard connection information

Create Module Wizard: Connection Information

Location is the path or the drive and directory in the file system where the flat files reside.


Metadata to data1

Metadata to Data

1. Initialize and organize the modules.

2. Import the metadata.

(This gives you only the data definition.)

3. Use the metadata to define

the mapping.

4. Deploy and execute the mapping

to load the data.


Importing source metadata

Importing Source Metadata

  • You can import and sample the following types of flat files using the Flat Files Sample wizard:

    • Simple delimited

    • Fixed-length

    • Multirecord


Selecting the flat file for sampling

Selecting the Flat File for Sampling


View the sample file

View the Sample File


Flat file sample wizard welcome

Flat File Sample Wizard: Welcome

The Flat File Sample wizard provides the ability to define simple, delimited text files in as few steps as possible.


Describing the file

Describing the File


Sampling simple delimited file

Sampling Simple Delimited File

The Flat File Sample Wizard allows specification of more than one character for record terminators, field delimiters and field enclosures. It recognizes X'hex-value' and x'hex-value' as hex-format where 'hex-value' is 0-9 or A-F.


Setting field properties

Setting Field Properties


Flat file sample wizard summary

Flat File Sample Wizard: Summary


Advanced record organization

Advanced: Record Organization

The Sample Wizard enables you to define files that contain logical records.


Advanced selecting the file format

Advanced: Selecting the File Format

Specify the file format to be Delimited or Fixed Length


Advanced file layout

Advanced: File Layout

Select Multi Record if file contains two or more types of records. In the Record Types page, specify the Type Value and their corresponding record names.


Advanced field properties

Advanced: Field Properties

For each record type, you define the fields.

This option is available in the Create Flat File wizard or in the Edit Flat File window > Structure link.


Defining source metadata

Quiz

  • OWB samples the following types of flat files (select all that apply):

    • Character-delimited files

    • Fixed-length files

    • Multirecord files

    • Multibyte fixed length


Defining source metadata

Quiz

  • Out of the following, which one describes the correct sequence of tasks you perform in OWB to use flat file sources:

    • Create a flat file module, select the file for import, and then run through the Sampling wizard to define its metadata.

    • First sample the file to define its metadata, create a flat file module, and then import the flat file.


Lesson agenda2

Lesson Agenda

  • Data warehouse implementation: Typical steps

    • Metadata to data

    • Relational and flat file source metadata: Difference

    • Data sources

  • Flat file sources

    • Create a flat file module

    • Import and sample a flat file

  • Oracle database sources

    • Create an Oracle module and import Oracle database objects

    • View the source tables data


Data sources1

Data Sources

Flat file source

FILE_SOURCE

customers.txt (delimited)

file_geography_multi.csv (multi-record)

Relational source

XSALES

Channels

Products

Cities

ORDERS_SRC


Creating an oracle module

Creating an Oracle Module


Create module wizard name and description

Create Module Wizard: Nameand Description

ORACLE MODULE

NON-ORACLE MODULE

For Non-Oracle modules, you can select the access method.


Create module wizard connection information1

Create Module Wizard: Connection Information


Editing the oracle database location

Editing the Oracle Database Location


Finishing module creation and proceeding to import

Finishing Module Creation and Proceeding to Import

You can either select "Import after finish" option in the Connection Information page or right-click the module in the Projects Navigator panel, and select Import > Database Objects.


Import metadata wizard filter information

Import Metadata Wizard: Filter Information

Filter the objects you want to import


Selecting the tables for import

Selecting the Tables for Import

Use the arrow to move available objects to the selected list


Completing the metadata import

Completing the Metadata Import


Viewing data

Viewing Data


Defining source metadata

Quiz

  • To get the XSALES schema tables as sources, you will perform the following tasks (select all that apply):

    • Create a separate OWB project

    • Create an Oracle Module

    • Edit the module location to point to XSALES schema

    • Import the selected tables


Summary

Summary

  • In this lesson, you should have learned how to:

    • Define and create flat file and Oracle modules using the Create Module wizard

    • Import and sample flat file sources using the File Import and the Flat File Sample wizard

    • Import relational database objects in an Oracle module

    • View source data in Data panel


Practice 4 1 overview defining and importing flat files and a relational source

Practice 4-1 Overview: Defining and Importing Flat Files and a Relational Source

  • This practice covers the following topics:

    • Creating a flat file source module

    • Importing two flat files:

      • customers.txt (delimited)

      • File_geography_multi.csv (multi-record)

    • Examining the XSALES Oracle database module

    • Importing ORDERS_SRC table into the XSALES module.


  • Login