slide1 n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Oracle Data Integration Solutions Product Update: Oracle GoldenGate and Oracle Data Integrator PowerPoint Presentation
Download Presentation
Oracle Data Integration Solutions Product Update: Oracle GoldenGate and Oracle Data Integrator

Loading in 2 Seconds...

play fullscreen
1 / 57

Oracle Data Integration Solutions Product Update: Oracle GoldenGate and Oracle Data Integrator - PowerPoint PPT Presentation


  • 282 Views
  • Uploaded on

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Oracle Data Integration Solutions Product Update: Oracle GoldenGate and Oracle Data Integrator' - maine


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
slide2

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

oracle data integration solutions product update oracle goldengate and oracle data integrator
Oracle Data Integration SolutionsProduct Update: Oracle GoldenGate and Oracle Data Integrator
program agenda
Program Agenda
  • Market Overview
  • Oracle Data Integration Overview
  • Oracle Data Integrator Product Update
  • Oracle GoldenGate Product Update
  • More Information
market overview exponential growth in data volumes
Market OverviewExponential Growth in Data Volumes

45 PB+

Maintained by Large Orgs

45%+

Annual Growth

15 out of 17

Industry Sectors in the U.S. Have

More Data

Than the U.S. Library of Congress

market overview exponential growth in data volumes1
Market OverviewExponential Growth in Data Volumes

More Data

leads to

More Data Challenges

market overview data integration and data quality markets
Market OverviewData Integration and Data Quality Markets

estimates the DI market

will reach $2.8 billion

estimates the DQ market

will reach $1.75 billion

by 2016

with an average growth rate of

18.2%

oracle data integration dis
Oracle Data Integration (DIS)

Breadth Enables Leverage and Agility

Data Quality

Data Integration

Match/Merge

Profiling

Standardization

Heterogeneous

Virtualization

Big Data

ETL/E-LT

Replication

oracle data integration
Oracle Data Integration

Complete Offering for Enterprise Data Integration

  • Complete and best-of-breed approach for enterprise data integration
  • Maximum performance with lower TCO, ease of use and reliability
  • Certified for leading technologies to deliver fast time to value

Oracle Data Integrator

Legacy

Oracle GoldenGate

Applications

Oracle Enterprise Data Quality

OLTP

Oracle Data Services Integrator

  • Oracle Customers Report:
      • 80% lower TCO
      • Five times higher performance
      • 70% reduction in development costs

Unstructured

Modernization

Custom

MDM

BI

Big Data

Synchronization

SOA

oracle data integrator
Oracle Data Integrator

Bulk Data Processing and Data Transformation

  • Certified for leading technologies to deliver fast time to value High-performance, low cost of ownership E-LT architecture
  • Lightweight deployment
  • Flexible, easy to enrich functionality

Oracle Data Integrator

Legacy

High Performance E-LT

Declarative Design

Applications

Extensible Knowledge Modules

OLTP

CEP Data Services

Unstructured

Capable of Integrating Structured & Unstructured Data

oracle goldengate
Oracle GoldenGate

Real-time Data Integration

  • High-performance, low-impact real-time data integration and replication
  • Timely data for improved business insight
  • Continuous availability for 24/7 operations

Oracle GoldenGate

Legacy

Log-based Change Data Capture and Delivery

Active-Active Replication

Applications

Heterogeneous Source and Targets

OLTP

Reliability and Transaction Integrity

Unstructured

CEP Integration, Real-time Events

why data integrator for oracle
Why Data Integrator for Oracle?
  • Heterogeneous Database Platforms
    • Native Support for Oracle and Non-Oracle Databases
  • Faster and Simpler Architecture for High-end Warehouses
    • E-LT Architecture is Superior fastest data loading
    • Transformations can run anywhere: Sources, Mid-Tier or Target
  • Easily & Elegantly Embedded
    • Runs native to SOA and Oracle Application stack technologies
    • 100% Java, JEE and JSE Deployment Modes
    • E-LT Architecture means no data choke points in mid-tier
  • Flexible Batch or Real-Time Data Flows
    • Common design point and easy migration to realtime data flows
    • Automatically generates DB CDC or best-of-breed CDC with GoldenGate
slide15

Oracle Data Integration: Two Part Strategy

Embedded Technology & Content

Best of Breed Standalone Platform

  • Unique value proposition: Apps include pre-built integration content
  • Dramatically lowers the cost of adding & integrating an application
  • Examples: Oracle BI Applications, Oracle Governance Risk & Compliance, Application Integration Architecture (AIA), many more…
slide16

Key ODI Internal OEM Patterns

ERP

ODI

GRC

ERP

ODI

ERP

DW

ODI

App

App

ODI

engineered together @ oracle

Note: This list is not all inclusive

Engineered Together @ Oracle

ODI Integrated

ODI Embedded

Pre-built Content

ODI Integrated

ODI Embedded

Pre-built Content

Key:

ODI Integrated  ODI has special technical integrations or features to support the named Oracle Application / Component

ODI Embedded  ODI is included with the Oracle Application / Component with a special license type (eg: Restricted Use etc)

Pre-built Content  the Oracle Application / Component is delivered with pre-built ETL mappings/content that run in ODI

evolving data integration roadmap oracle s investment direction is constantly reviewed and refined
Evolving Data Integration RoadmapOracle’s Investment Direction is Constantly Reviewed and Refined

Roadmap 2000 to 2007

Roadmap 2007 to 2008

ODI

OWB-EETL

OWB-EETL

OWB

2006

2007

OWB (free DB features)

OWB (free DB features)

Roadmap 2009 to 2010

Roadmap from Jan 2010 to Current

ODI

ODI

New ETL

KMs

KMs

OWB-EETL

OWB-EETL

OWB (free DB features)

OWB (free DB features)

slide20

Oracle ETL Roadmap Since Jan 2010

As Communicated to OWB and ODI Customers World-Wide

ODI 12c12.1

UnifiedTeam

ODI-EE

License

OWB-EE

11gR2

ODI 11g11.1.1.3

ODI 11g11.1.1.6

ODI 11g11.1.1.7

Late 2011

CY13

CY13

Oct 2008

Jan 2009

Sep 2009

Jul 2010

OWB-EETLConcepts

Knowledge

Modules

ODI-EE License

In-Database ETL Features

No new major feature enhancements. Bug fixes, patches and DB certifications continue

odi core release cycle
ODI Core Release Cycle

CY13

H1CY13

H1CY12

H1CY12

H1CY11

slide23

OWB Support Policies

Customer Downloadable OWB Support Policies:

http://www.oracle.com/us/support/library/lifetime-support-technology-069183.pdf

For more Information about Support Levels:

http://www.oracle.com/us/support/lifetime-support/index.html

slide24

Must OWB Customers Migrate to ODI?

  • Existing OWB customers are NOT being forced to migrate to ODI
    • Oracle is not intending to create a “forcing-function” for existing OWB customers to pay more License fees
    • Oracle offers “Lifetime Support” option for Sustaining Support on all OWB features
  • For OWB customers who are initiating new ‘greenfield’ ETL projects – Oracle recommends to consider ODI first
  • For any new customers who are initiating new ‘greenfield’ ETL projects – Oracle recommends to consider ODI first
  • ODI is the strategic go-forward ETL platform from Oracle
slide25

Oracle Best Practices for Tech Migrations

  • Understand that OWB and ODI are different ETL tools
    • There is no “free lunch” when migrating – a technical migration between different tools will never be 100% perfect or predictable
  • Manual re-implementation might be the best-bet
    • Optimizing ETL jobs in ODI will typically yield the best performing results (vs. semi-automatic conversion utilities)
  • Semi-automated conversion services are available
    • Oracle Partners offer semi-automatic conversion utilities and offshore services that may dramatically accelerate your conversion from OWB to the ODI product.
    • Oracle does not guarantee any of these services, but does advise and give input to the 3rd party partners on the development of their conversion utilities.
slide26

OWB to ODI Component Equivalency

  • OWB ETL  Oracle Data Integrator
    • All OWB ETL features would map to ODI (where applicable, this does not mean that the two products are feature-equivalent)
  • OWB Data Quality  Oracle Enterprise Data Quality for ODI
    • All OWB DQ features would map to EDQ for ODI (where applicable, this does not mean that the two products are feature-equivalent)
    • Exceptions: ODI offers built-in “Check Flow” features that supply light DQ functionality inline to the ETL – these are considered base ETL features
  • OWB Data Profiling  Oracle Enterprise Data Profiling
    • All OWB DP features would map to EDP (where applicable, this does not mean that the two products are feature-equivalent)
slide27

OWB Features Not Supported in ODI 11g

  • Oracle Data Integrator is a highly advanced best-of-breed ETL product, but OWB had evolved several features that were strongly coupled to other Oracle technologies. Here are our plans to fill the gaps:
  • Oracle Discoverer Integration
    • Why: ODI integrates with OBIEE for Lineage & Impact Analysis
    • Future: deep ODI integration with Oracle BI Server
  • Dimensional Modeling
    • Why: With ODI, data modeling comes from best-of-breed modeling tools
    • Future: tightly integrate ODI with Oracle SQL Developer
  • OMB Scripting
    • Why: Scripting with ODI leverages ODI Java SDK APIs
    • Future: integrated Groovy scripting
  • PL/SQL Code Generation
    • Why: ODI generates transformation SQL (native to whichever DB is required), no procedural code is generated from ODI.
overview of new features
Overview of New Features
  • Integrated Capture
  • Enhanced Conflict Detection & Resolution
  • Support for Global Deployments
  • Security and Performance
  • Extensibility
  • Manageability and Monitoring
  • Expanded Heterogeneity
integrated capture
Integrated Capture
  • Overview

Integrated Capture for Oracle Database

Oracle

GoldenGate

11gR2

  • Moves GoldenGate’s capture capabilities closer to the Oracle Database engine.
  • Enables 100% support for capture and delivery of compressed objects within Oracle Database and Oracle Exadata
integrated capture1
Brings GoldenGate Capture (Extract) closer to the RDBMS engine

Leverages Proprietary Oracle Database Mining API

Parallelism in mining and transforming redo records into LCRs

Improved RAC coordination and automated node handling

Tighter integration and faster development of new Oracle features

Multi Threaded

Uses producer thread to capture REDO record and consumer thread to process the REDO records.

Performance gain from parallel processing

Integrated Capture

Overview

integrated capture2
Supports multiple deployment configuration

Source : Source database and Integrated Capture process are in the same machine

Downstream : Source database and Integrated Capture process are in the different machine

Easy transition for existing GoldenGate customers

Customers may choose which option they prefer based on their requirements.

Integrated Capture

Overview

“On Source”

“Downstream”

classic capture
When to Consider Classic Capture

If you don’t need XML types, XA on RAC, compressions etc.

Future Direction

Classic Capture will be around for long time

Core specific features, bug fixes and patches will be available on both Captures

Oracle specific features will be only available in integrated extract.

Adding Oracle specific feature exclusively to classic extract will not be possible. 

Classic Capture
enhanced conflict detection resolution cd r
Enhanced Conflict Detection & Resolution (CD&R)
  • Overview

Enhanced Conflict Detection & Resolution

Oracle

GoldenGate

11gR2

  • Automated detection and resolution of data conflicts for active-active or multi-master deployments.
  • Robust, easier to code, and less time to implement.
enhanced conflict detection resolution
Enhanced Conflict Detection & Resolution

Overview

  • Replaces expensive hand-coding of CD&R rules with easy and expandable rules.
  • Options to use pre-built methods to resolve conflicts
    • Overwrite, Ignore, Discard, Usemax and Usemin
  • Supported datatypes
    • NUMERIC, DATE, TIMESTAMP, CHAR/NCHAR, VARCHAR/ NVARCHAR
  • Supports heterogeneous deployments
support for global deployments
Support for Global Deployments
  • Overview

Global Deployment Support

Oracle

GoldenGate

11gR2

  • Allows Oracle GoldenGate to support databases using multi-byte/Unicode object and column names.
support for global deployments1
GoldenGate deployment in a non-English environment

Supports European Accent characters, Multi-byte characters

Automatic conversions of transactional data across different character set environments

Native error messages, supports case sensitivity

Database object name support

Non US-ASCII Character Support (both DDL/DML)

Database Like Object Level Case Sensitivity Support

Support for Global Deployments

Overview

security
Security
  • Overview

Security

Oracle

GoldenGate

11gR2

  • The Most Secure Version of GoldenGate
  • Oracle GoldenGate 11gR2 supports Federal Information Protection Standard (FIPS) and BLOWFISH encryption algorithms to provide secure data movement across systems and regions
security1
Support FIPS compliant encryption algorithm in addition to current BLOWFISH algorithm

On disk encryption for trail file

In password encryption

When transferring data across the network

NOTE: Only supported on Linux, Windows, and Unix.

IPv6 support

Mandate from the government

The existing GoldenGate library of IPC routines is based on IPv4. All existing GoldenGate calls using IPv4 AP were changed to use IPv6 APIs.

Security

Overview

performance
Performance
  • Overview

Performance Improvements

Oracle

GoldenGate

11gR2

  • Performance improvements for data replication across geographically separated systems in high-latency networks
performance1
Performance

Overview of Data Pump Improvements

  • Prior to Oracle GoldenGate 11gR2
    • Synchronous data communication between Data Pump and remote collector process
  • Oracle GoldenGate 11gR2
    • Acknowledgement message can be skipped for every data sent
    • Remote collector does not send an acknowledgement to the Data Pump unless a packet contains a flag requesting a response.
extensibility
Extensibility
  • Overview

Extensibility

Oracle

GoldenGate

11gR2

  • Using Event Markers allows GoldenGate implementations to be extended to kick-off actions based on an incident (DML,DDL, data value)
extensibility1
Extensibility

Overview

  • Event Marker Systems
    • Enables the Oracle GoldenGate processes to take a defined action based on an event record in the transaction log or in the Trail
    • Supported Event Actions
      • TRACE, LOG, CHECKPOINT BEFORE, IGNORE, DISCARD, SHELL, ROLLOVER, REPORT ABORT, CHECKPOINT AFTER, FORCESTOP, STOP
  • Robust option for customers requiring non-standard processing based on specialized events.
event marker system
Event Marker System

User/Application changes

Event record

Event record

Event record

LAN / WAN / INTERNET

Over TCP/IP

Target

Database

Source

Database

Transaction Logs

manageability monitoring
Manageability & Monitoring
  • Overview

Monitoring

Oracle

GoldenGate

11gR2

  • The new Oracle GoldenGate Monitor product provides complete view of the GoldenGate implementations.
  • Integration with Oracle Enterprise Manager
management pack for oracle goldengate
Management Pack for Oracle GoldenGate

Monitoring

  • Advanced monitoring, alerting (SNMP support), lag graphs, and historical repository.
  • Based on new agent infrastructure, which will be the foundation for all future integration projects. Supports GoldenGate 11.1.1.1.1+
  • Oracle GoldenGate Monitor
management pack for oracle goldengate1
Management Pack for Oracle GoldenGate

Monitoring

  • Oracle Preferred monitoring tool, covers entire Oracle stack – Database, Storage, FMW etc
  • For customers, who prefers to drill into DB sessions, OS stats, etc, apart from monitoring GoldenGate process
  • Included in Management Pack
  • Enterprise Manager Plug-in
expanded heterogeneity
Expanded Heterogeneity
  • Overview

Expanded Heterogeneity

Oracle

GoldenGate

11gR2

  • Expanded data type support for existing supported platforms
  • Added native log based capture from IBM DB2 on iSeries and Delivery to PostgreSQL
expanded heterogeneity1
Expanded Heterogeneity

Overview

Platform

Description

db2 iseries capture
Supported Datatypes

Numeric (BIGINT, DECIMAL, DOUBLE, FLOAT, INTEGER, NUMERIC, REAL, SMALLINT)

String, Binary (CHAR, BINARY, VARCHAR, VARBINARY)

Large Objects (BLOB, CLOB, DBCLOB, GRAPHIC, VARGRAPHIC)

Times and Dates (DATE,TIME, TIMESTAMP)

Un supported Datatypes

DATALINK, UDT, DECFLOAT and XML

DB2 iSeries Capture
summary oracle goldengate 11gr2
Summary: Oracle GoldenGate 11gR2
  • Largest Number of New Features Ever Released

Oracle

GoldenGate

11gR2

Integrated Capture

Enhanced Conflict Detection & Resolution

Support for Global Deployments

Security & Performance

Extensibility

Manageability & Monitoring

Expanded Heterogeneity

slide53

Oracle Data Integration

Oracle OpenWorld Shanghai - Schedule

Thursday (25-July)

Session ID: CON2068
Session Title: Real-Time Data Warehousing with Oracle Data Integrator and Oracle GoldenGate
Venue / Room: Expo Centre - Room 425
Date and Time: 7/25/13, 10:15 - 11:15

Session ID: CON2067
Session Title: Oracle Data Integration Services Product Update: Oracle GoldenGate and Oracle Data Integrator
Venue / Room: Expo Centre - Room 616
Date and Time: 7/25/13, 14:00 - 15:00

Wednesday (24 – July)

Session ID: CON1732
Session Title: Managing Your Data with Oracle’s Data Integration Platform
Venue / Room: Expo Centre - Room 425
Date and Time: 7/24/13, 14:00 - 15:00

HOL1738 Hands-On Lab
Session Title: Deep Dive into Oracle GoldenGate 
Venue / Room: Expo Centre - Room 407/408
Date and Time: 7/24/13, 17:15 - 18:15

join the data integration community
Join the Data Integration Community

LinkedIn“Oracle Data Integration”

Oracle’s Data Integration blogblogs.oracle.com/dataintegration

Twittertwitter.com/ORCLGoldenGate

Facebookfacebook.com/OracleDataIntegration

Oracle’s Data GoldenGate YouTube channelyoutube.com/oraclegoldengate

Oracle.com/goto/dataintegration

slide56

The preceding is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract.It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.