Presentation Transcript

1. Integrating Oracle GoldenGate with the Oracle Database(CON8524) JagdevDhillon, Vice President Lik Wong, Senior Director Oracle
2. The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
3. Agenda Oracle GoldenGate Overview Oracle GoldenGate 12c Integration with Oracle Database Overview Resources Q & A
4. Oracle GoldenGateOverview
5. Oracle Data Integration Solutions Thousands of customers including Fortune 500 companies, representing Financial Services, Communications, Healthcare, Public Sector, Retail, Utilities industries 4 of top 5 largest commercial banks 3 of top 3 busiest ATM networks 5 of top 5 financial data services companies 5 of top 5 telecommunications providers 3 of top 5 largest food & drug stores
6. Fun Facts About Oracle GoldenGate That’s the Magic of Macy’s Shopping at the worlds largest retails and your credit card transactions are moved in real-time to data centers around the world, before being approved, using Oracle GoldenGate (Retail Decision) Good TV. Better TV. DirecTV. If you call DIrecTV customer service, your call data will move to their data warehouse via Oracle GoldenGate, so the rep can provide you with personalized recommendations and promotions. Say it with Flowers Ordering from 1800-Flowers, Oracle GoldenGate will move your order to their reporting systems to help process and track your order seamlessly No Charge ATM Fees 3 of the 3 busiest ATM Networks use Oracle GoldenGate for Continuous Availability. Get Sick in Pittsburgh If you get a health check at UPMC, the clinical applications that doctors use are supported by Oracle GoldenGate to enable high-availability
7. Oracle Data Integration (DIS) Breadth Enables Leverage and Agility Data Quality Data Integration Match/Merge Profiling Standardization Heterogeneous Virtualization Big Data ETL/E-LT Replication
8. Real-time replication; optimized for Database 12c and Oracle Exadata End-to-end integrated with simplified deployment Unified tooling for both structured data sources and Hadoop / NoSQL Flexible deployment on-premise or in the Cloud for heterogeneous systems Expanded support for 3rd party systems and Oracle Applications in real-time data integration and continuous availability solutions Oracle Data Integration 12c Delivering Real-Time Integration for Big Data and Cloud Cloud Oracle Data Integrator Apps Oracle GoldenGate Oracle Enterprise Data Quality Database Oracle Data Service Integrator Big Data
9. Oracle Data IntegratorBulk Data Processing and Data Transformation Oracle Data Integrator Certified for leading technologies to deliver fast time to value High-performance, low cost of ownership E-LT architecture Lightweight deployment Flexible, easy to enrich functionality Cloud High Performance E-LT Apps Declarative Design Database Extensible Knowledge Modules CEP Data Services Big Data Capable of Integrating Structured & Unstructured Data
10. Oracle GoldenGate Real-time Data Integration Oracle GoldenGate High-performance, low-impact real-time data integration and replication Timely data for improved business insight Continuous availability for 24/7 operation Cloud Log-based Change Data Capture and Delivery Apps Active-Active Replication Heterogeneous Source and Targets Database Reliability and Transaction Integrity Big Data Java Integration, Real-time Events
11. Oracle Enterprise Data Quality Data Quality for Customer and Product Data Oracle Enterprise Data Quality Improves data accuracy, usability and ‘fitness for purpose Unified interface for ease-of-use, lower TCO Depth of capability in multiple data domains reduces project risk Cloud Profile, Explore, Audit Apps Parse, Standardize, Cleanse Match, Merge, Enrich Database Governance Big Data Case Management
12. Oracle Data Services Integrator Data Federation and Virtualization Oracle Data Services Integrator Easily develop data services and ad-hoc queries without infrastructure changes Open and standards based—SOA, Web Services, Java, Service Data Object Cloud Federated Data Services Apps Data Virtualization Integrates with Oracle SOA Database Bidirectional Reads & Writes Big Data Integrates with Oracle Business Analytics
13. Oracle GoldenGate Low-Impact, Real-Time Data Integration & Transactional Replication Zero Downtime Upgrade & Migration New DB/HW/OS/APP Fully Active Distributed DB High Availability/ Disaster Recovery Legacy Systems Log-based Changed Data Query & Report Offloading Reporting Database Data Warehouse Real-time BI, Operational Reporting, MDM Oracle & Non-OracleDatabase(s) Data Integrator Global Data Centers ODS Data Synchronization within the Enterprise Message Bus Message Bus Event Driven Architecture, SOA
14. How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. As of V.11.2.1, GoldenGate offers two options for capture for Oracle; Classic & Integrated Capture LAN / WAN / Internet Over TCP/IP Capture TargetOracle & Non-OracleDatabase(s) SourceOracle & Non-OracleDatabase(s)
15. How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. As of V.11.2.1, GoldenGate offers two options for capture for Oracle; Classic & Integrated Capture LAN / WAN / Internet Over TCP/IP Trail: stages and queues data for routing. Capture Trail Files TargetOracle & Non-OracleDatabase(s) SourceOracle & Non-OracleDatabase(s)
16. How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. As of V.11.2.1, GoldenGate offers two options for capture for Oracle; Classic & Integrated Capture LAN / WAN / Internet Over TCP/IP Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Capture Pump Trail Files TargetOracle & Non-OracleDatabase(s) SourceOracle & Non-OracleDatabase(s)
17. How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. As of V.11.2.1, GoldenGate offers two options for capture for Oracle; Classic & Integrated Capture LAN / WAN / Internet Over TCP/IP Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s). Capture Pump Trail Files Trail Files TargetOracle & Non-OracleDatabase(s) SourceOracle & Non-OracleDatabase(s)
18. How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. As of V.11.2.1, GoldenGate offers two options for capture for Oracle; Classic & Integrated Capture LAN / WAN / Internet Over TCP/IP Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s). Delivery: applies data with transaction integrity. Newwith GoldenGate 12c, Coordinated & Integrated Delivery. Capture Pump Delivery Trail Files Trail Files TargetOracle & Non-OracleDatabase(s) SourceOracle & Non-OracleDatabase(s)
19. How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. As of V.11.2.1, GoldenGate offers two options for capture for Oracle; Classic & Integrated Capture LAN / WAN / Internet Over TCP/IP Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s). Delivery: applies data with transaction integrity. New with GoldenGate 12c, Coordinated & Integrated Delivery. Capture Pump Delivery Trail Files Trail Files Trail Files Trail Files Delivery Capture Pump TargetOracle & Non-OracleDatabase(s) SourceOracle & Non-OracleDatabase(s) Bi-directional
20. GoldenGate: Flexible Deployment Architectures Unidirectional Query OffloadingZero-Downtime Migration Bi-Directional Hot Standby or Active-Active for HA Peer-to-Peer Load Balancing Multi-Master Broadcast Data Distribution Integration/Consolidation Data Warehouse Data Distribution via Messaging BPM BAM CEP
21. Oracle GoldenGate 12cIntegration with Oracle Database Overview
22. Oracle GoldenGate 12c Integration with Oracle 12c Overview Optimized for Oracle Database 12c Multitenant and Cloud-based Real-Time Replication Integrated Delivery for the Oracle Database Leveraging lightweight Streaming API built Exclusively for Oracle GoldenGate Improved Usability and Security Schema Wildcarding, Auto Discard File, Wallet and Credential Store Enhanced High Availability for Zero Data Loss Integration with Data Guard and FSFO for Automated & Transparent failover of Components Expanded Oracle Application and Technology Support Active/Active ATG, Low Downtime E-Business Suite Migrations and Coherence Integration Enhanced Visibilities inside Oracle Database DBA views, dynamic performance view, Pl/SQL packages
23. Optimized for Oracle Database 12c Overview Optimized for Oracle Database 12c Oracle GoldenGate 12c Support for 12c specific features: multitenant database and new data types.
24. Supports three part naming convention in GoldenGate for identifying a table within a pluggable database. <pdb>.<schema>.<table> A single Extract can mine from multiple container databases. Support for 12c data types (e.g. Large Varchar - 32k) Ease of administration with DBMS package, catalog and dynamic performance views. Optimized DDL capture - directly from database redo logs Optimized for Oracle Database 12cOverview
25. Optimized for Oracle Database 12c Support for Non-Consolidated and Multitenant Databases Oracle 12c Container Database Oracle 12c Container Database Non-Consolidated Multitenant Oracle GoldenGate Oracle GoldenGate Oracle GoldenGate Oracle GoldenGate Oracle & Non-Oracle Database(s) Oracle & Non-Oracle Database(s)
26. Integrated Delivery for Oracle DatabaseMoves GoldenGate Delivery (Replicat) closer to the RDBMS engine Overview Integrated Delivery for Oracle Database Oracle GoldenGate 12c Unique, next generation, high-speed data apply using Oracle-only technology. Leverages the database parallel apply servers for auto dependency aware parallel apply.
27. Integrated Delivery Overview Integrated Delivery for Oracle target databases only 12.1.0.1 and 11.2.0.4 Leverages database parallel apply servers for automatic dependency aware parallel apply No changes to existing Replicat Parameter file Single Replicat, no need to use @RANGE or THREAD or other manual partition
28. Integrated Delivery Overview (continued) Intelligent scaling up/down of parallelism based on workload Integrated conflict detection and resolution GoldenGate CDR, REPERROR, and HANDLECOLLISIONS Can invoke existing Oracle Streams conflict resolution and error handlers Unhandled errors redirected to Replicat for retry and failure processing Session redo tags provide fine-grained filtering, such as cycle prevention in bidirectional replication
29. Integrated Delivery Architecture Diagram Oracle Database Inbound Server Coordinator Preparer Receiver Applier N Applier 2 Applier 1 Replicat Reads the trail file Constructs logical change records (LCRs) Transmits LCRs to Oracle Database via the Lightweight Streaming API Inbound Server (Database Apply Process) Receiver: Reads LCRs Preparer: Computes the dependencies between the transactions (primary key, unique indexes, foreign key) , grouping transactions and sorting in dependency order. Coordinator: Coordinates transactions, maintains the order between applier processes. Applier: Performs changes for assigned transactions, including conflict detection and error handling. Lightweight Streaming API Trail Files Replicat
30. Integrated Delivery Performance Duration (seconds) Integrated Replicat 24% faster than 6 manually configured parallel Classic Replicats 129,000 vs. 96,000 DMLs/sec OLTP style workload (modified Swingbench) Integrated Replicat greatly simplifies configuration without manual partitioning No need to understand workload (PK/FK constraints) Automatic apply parallelism No split transaction semantics DMLs per Second
31. Improved Usability Default automatic discard File Automatically creates discard file without manual specification Ease of configuration with schema wildcarding Applications support wildcard schema and catalog Wildcard schema support is available for all databases
32. Utilizes the Oracle wallet to create and store encryption keys, plus open, close, and create the wallet Database passwords are stored in the Oracle CredentialStore Same Oracle Wallet and CredentialStore concept as Oracle databases Available on platforms that Oracle database supports Improved Security
33. Enhanced High Availablility and Zero Data LossIntegrating with Data Guard and FSFO Overview Continuous High Availability for Zero Data Loss Oracle GoldenGate 12c Integration with Data Guard and FSFO provides automated and transparent failover of GoldenGate components with the failover/switchover of the primary database so your replication can continue without any manual intervention.   Downstream Capture utilizing Data Guard redo log transport to process transactions off-source
34. Zero Data loss (On-Source Integrated Capture)Integration with Data Guard and FSFO Observer Primary Database Standby Database Redo Transport Integrated Capture LogMining Server OCI Connection Redo Transport (SYNC or ASYNC) File I/O Trail and other OGG Files In Shared Storage
35. Zero Data loss (On-Source Integrated Capture: Post-Failover)Integration with Data Guard and FSFO Observer (OLD) Primary Database (NEW) Primary Database Integrated Capture Redo Transport LogMining Server LogMining Server OCI Connection Redo Transport (SYNC or ASYNC) File I/O Trail/Checkpoint/BR Files In Shared Storage
36. Zero Data loss (Downstream Integrated Capture)Integration with Data Guard and FSFO Observer Primary Database Standby Database Redo Transport OCI Connection Redo Transport (SYNC or ASYNC) (ASYNC) File I/O LogMining Server Integrated Capture
37. Zero Data loss (Dowstream Integrated Capture: Post-Failover)Integration with Data Guard and FSFO Observer (Old) Primary Database (New) Primary Database Redo Transport OCI Connection Redo Transport (SYNC or ASYNC) File I/O (ASYNC) LogMining Server Integrated Capture
38. Zero Data loss Integration with Data Guard and FSFO Transparently handles no-data-loss and data-loss (new in 12c) failovers On-source deployment can be managed by XAG (new in 12c) No need to write shell script to start up Extract post-failover Redo can be sent to downstream from the standby (new in 12c) Use cascading redo transport Offloads primary database even more needs 12c database
39. Expanded Oracle Application and Technology Support Overview Expanded Oracle Application and Technology Support Oracle GoldenGate 12c Low downtime database migration for E-Business Suite and Active-Active data center synchronization for ATG Web Commerce is now available. Tight Integration with Oracle Coherence to enable real-time change data feeds from source database to the Coherence Cache.
40. Oracle GoldenGate provides data replication between data centers serving a single Web Commerce site Active- Active Data Center Replication using Oracle GoldenGate: Allows maximum application capacity Helps with disaster recovery to facilitate continuous operations. Additional info available at: http://www.youtube.com/watch?v=10tN2ltOSNs Oracle GoldenGate for Oracle ATG Active/ActiveOverview
41. Triple-O: Oracle to Oracle Database Migrations “Online” Online = GoldenGate Developed by ACS and Product Management from both GoldenGate and E-Business Suite to Migrate E-Business Suite Oracle databases. Provide the Means to Migrate to new Platforms and Database versions with extremely low downtime, but does not include Application Upgrades Low Downtime EBS Database MigrationsOverview LAN / WAN / Internet Over TCP/IP Oracle to Oracle Initial Data Load Trail Files Trail Files Capture Pump Delivery TargetE-BusinessDatabase SourceE-BusinessDatabase Ongoing Data Synchronization via Oracle GoldenGate
42. Tighter Integration with Oracle CoherenceOverview The GoldenGate Coherence Adapter runs on the source database where GoldenGate runs Committed changes from third party applications are replicated in real-time from the source to Coherence via the adapter Coherence tier (the target) provides integration via TopLink extensions that consume the data changes from the GoldenGate Coherence Adapter Oracle Coherence Grid Edition 12.1.2 Oracle TopLink Reads/Writes Initiated By Coherence Third Party DML Operations Capture Coherence Adapter Oracle & Non-Oracle Database(s) Trail Files
43. GoldenGate Database Views Configuration DBA_GOLDENGATE_SUPPORT_MODE Columns are OWNER, OBJECT_NAME, SUPPORT_MODE SUPPORT_MODE are FULL, ID KEY, NONE DBA_GOLDENGATE_PRIVILEGES DBA_GOLDENGATE_INBOUND, DBA_GG_INBOUND_PROGRESS DBA_CAPTURE, DBA_CAPTURE_PARAMETERS Capture parameters are set by Extract at runtime DBA_APPLY, DBA_APPLY_PARAMETERS Apply parameters are set by Replicat at runtime
44. GoldenGate Database Views Configuration (cont.) DBA_APPLY_REPERROR_HANDLERS DBA_APPLY_HANDLE_COLLISIONS DBA_APPLY_DML_CONF_HANDLERS All configuration views in 11.2.0.4 and 12.1.0.1
45. GoldenGate Database Views Dynamic Performance Views V$GOLDENGATE_CAPTURE V$GG_APPLY_RECEIVER, V$GG_APPLY_READER, V$GG_APPLY_COORDINATOR, V$GG_APPLY_SERVER V$GOLDENGATE_TABLE_STATS V$GOLDENGATE_CAPABILITIES In 11.2.0.4 and 12.1.0.1
46. OGG Database Privileges DBMS_GOLDENGATE_AUTH.GRANT_ADMIN_PRIVILEGE(grantee  => 'gg_admin); Privileges needed for Extract and Replicat Applies to both Integrated and non-integrated modes Access to DBA_ * views for monitoring database CAPTURE and APPLY Additional optional privileges configurable Example for DataVault and Virtual Private Database (VPD) DBMS_GOLDENGATE_AUTH.GRANT_ADMIN_PRIVILEGE(grantee  => 'gg_admin’, grant_optional_privilege=>’DV_GOLDENGATE_ADMIN,EXEMPT ACCESS POLICY’); Documentation has complete list of optional privileges.
47. GoldenGate AWR report
48. Best Practices Check Oracle GoldenGate MOS article 1557031.1 for recommended Database patches
49. Troubleshooting Aids Use the Oracle GoldenGate integrated health check for the database release. Available via MOS article 1448324.1 Provide default HTML output to support for review when opening SR For performance tuning, use the performance advisor available in $ORACLE_HOME/rdbms/admin/utlspadv.sql. Information on UTL_SPADV in PL/SQL Packages and Types Reference ENABLE_GOLDENGATE_REPLICATION=TRUE INIT.ORA parameter required in 11.2.0.4
50. Summary: Oracle GoldenGate 12c Intelligent Integration Enables Simplified and Fast Deployments Optimized for Oracle Database 12c Integrated Delivery for the Oracle Database Improved Usability Improved Security Continuous Availability for Zero Data Loss Oracle GoldenGate 12c Expanded Oracle Application and Technology Support Enhanced Visibilities inside Oracle Database
51. Resources
52. Questions & Answers
53. Join the Data Integration Community LinkedIn“Oracle Data Integration” Oracle’s Data Integration blogblogs.oracle.com/dataintegration Twittertwitter.com/ORCLGoldenGate Facebookfacebook.com/OracleDataIntegration Oracle GoldenGate YouTube channelyoutube.com/oraclegoldengate Oracle Technology Network Oracle’s Public Help Forumhttp://forums.oracle.com/forums/forum.jspa?forumID=860&start=0 Oracle.com/goto/dataintegration
54. Oracle OpenWorld – Key DIS Sessions Oracle GoldenGate
55. Fusion Middleware Innovation Award Ceremony @ Oracle OpenWorld San Francisco 2013
56. Graphic Section Divider