Oracle exadata v2 fast track
This presentation is the property of its rightful owner.
Sponsored Links
1 / 26

Oracle Exadata v2 Fast Track PowerPoint PPT Presentation


  • 169 Views
  • Uploaded on
  • Presentation posted in: General

Not x2. Oracle Exadata v2 Fast Track. Hüsnü Şensoy Global Maksimum Data & Information Tech Founder, VLDB Expert. Agenda. Why do we need Exadata v2 ? Exadata Hardware Exadata Software Better to show rather than talk. Conclusion. Before completing the year HrOUG in two weeks later

Download Presentation

Oracle Exadata v2 Fast Track

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Oracle exadata v2 fast track

Global Maksimum Data&Information Technologies

Not x2

Oracle Exadata v2Fast Track

HüsnüŞensoy

Global Maksimum Data & Information Tech

Founder, VLDB Expert


Agenda

Global Maksimum Data&Information Technologies

Agenda

  • Why do we need Exadata v2 ?

  • Exadata Hardware

  • Exadata Software

  • Better to show rather than talk.

  • Conclusion


Who am i

Global Maksimum Data&Information Technologies

  • Beforecompletingtheyear

  • HrOUG in twoweekslater

    • OptimizedAnalyticalProcessingCapabilities of 11g Release 2

    • Database Consolidation Best Practices

    • ACED Sessionwith

      • JoseSenegačnik

      • DenesKubiček

  • UKOUG in December

    • OptimizedAnalyticalProcessingCapabilities of 11g Release 2

Who am I ?

  • Data & Information expert on VLDB environments

    • DWH

    • Data Mining

    • Inference Systems

    • Data Archiving Solutions

    • Niche Storage Technologies

    • Recovery Strategies & Solutions

    • HA Systems

  • Oracle ACED on BI field

    • Only one in Turkey

    • Still the youngest one all over the community.

  • DBA of the Year 2009

    • 7th and still the youngest all over the world.

    • Only one in Turkey

  • Member of Oracle CAB for 12g DWH development

  • Worldwide presenter of Oracle conferences and user group events


Global maksimum data information technologies and oracle exadata v2

Global Maksimum Data&Information Technologies

Global Maksimum Data & Information TechnologiesandOracle Exadata v2

  • Only company in Turkey having IB interconnected RAC 11g implementation experience on Linux x86-64bit.

  • Only company in Turkey having sufficient consultancy experience (more than 120 TB conventional system data) on Exadata v2

    • Physical & Architecture Design

    • Migration

    • Performance Optimization

    • Backup & Recovery Architectures Design

  • Trains customers, Oracle partners, and Oracle employees all over the Europe

  • Strong joint relation with Oracle Platinum Partners, Oracle Development Team Head Office, and IB technology leaders.

  • X-Migrator service provider for high capacity customers.


Oracle exadata v2

Global Maksimum Data&Information Technologies

Oracle Exadata v2

Don’t think Exadata as yet another product sold by SALES guys.

As a customer take it as an effortless solution for hardware software integration.

As an engineer take it as an elegant solution of so-called unsolvable I/O problem for Oracle databases.


Who needs exadata v2

Global Maksimum Data&Information Technologies

Who needs Exadata v2 ?

  • Engineers

    • To learn that «The mechanic with a hammer thinks that all problems are nail»

  • Customers

    • Shorter setup time

  • Non-Exadata Customers

    • More stable Oracle releases

  • Oracle

    • Easy to manage/standardize its code repository


Oracle exadata v2 hardware

Global Maksimum Data&Information Technologies

Oracle Exadata v2 Hardware

Best thing about Exadata is that it has nothing magical in it in terms of hardware.

A few Sun Fire X4170 x86-64 bit servers.

A few Sun Fire X4275 x86-64 bit servers.

A few IB switches.


Exadata v2 x ray

Global Maksimum Data&Information Technologies

Sun Datacenter 36-port Managed QDR IB Switched

Exadata Storage Servers

Sun Fire™ X4170 Oracle Database Server

KVM IP Console Switch

Rackmount KMM Keyboard with TFT monitor

48-port Gigabit Ethernet Switch

Exadata v2 X-Ray

42U


Interconnect network hardware

Global Maksimum Data&Information Technologies

Interconnect Network Hardware

  • IB Switches

    • 3 x 36-port managed switches as opposed to Exadata v1 (2+1).

      • 2 “leaf”

      • 1 “spine” switches

    • Spine switch is only available for Full Rack because it is for connecting multiple full racks side by side.

    • A subnet manager running on one switch discovers the topology of the network.

  • HCA

    • Each node (RAC & Storage Cell) has a PCIe x8 40 Gbit HCA with two ports

    • Active-Standby Intracard Bonding.


Rac node

Global Maksimum Data&Information Technologies

RAC Node

  • Sun Fire X4170 Server

  • 2 socket

    • Quad Core

      • 2.53 GHz

      • 2 Hyper-Threads

      • So, CPU_COUNT=16

  • 18 DDR3 DIMM Slots

    • 72 [email protected] MHz (2x3x3x4 GB)

  • 4 10/100/1000Base-T Ethernet ports

    • NET0 : Management

    • NET1 : Public Network

    • NET2 : Public Network

    • NET3 : -

  • PCIe PES24T6G2 Switch

    • x8


Storage node

Global Maksimum Data&Information Technologies

Storage Node

  • Sun Fire X4275 Server

  • 2 socket

    • Quad Core

      • 2.53 GHz

  • 6 DDR3 DIMM Slots

    • 24 [email protected] MHz (2x3x1x4 GB)

  • HDD Storage

    • 12 x 3.5-inch 600 GB 15 K RPM SAS disks

    • 12 x 3-5-inch 2 TB 7.2 K RPM SATA disks

  • 4 Sun Flash Accelerator F20 PCIe Cards


Soft storage node

Global Maksimum Data&Information Technologies

Soft Storage Node

  • CELLSRV

    • Multithreaded block server

      • Buffer cache reads

      • Smart scans

    • Performs I/O Resource Management

    • Gather operational statistics

    • Communicates over iDB with the clients.

  • MS

    • OC4J application

    • Provides functionalities for

      • Cell management

      • Cell administration

      • Aler generation

  • RS

    • First process becoming live in storage cell.

    • Work as a hang analyzer for CELLSRV and MS

IORM

CELLSRV

iDB

MS

Oracle Enterprise Linux 5.3

RS


Hdd sequential read performance

Global Maksimum Data&Information Technologies

HDD Sequential Read Performance

600 GB 15K RPM SAS

2 TB 7.2K RPM SATA

204 MB/s

144 MB/s

122 MB/s

90 MB/s


Hdd random read performance

Global Maksimum Data&Information Technologies

HDD Random Read Performance

600 GB 15K RPM SAS

2 TB 7.2K RPM SATA

175 IOPS @ 2KB

79 IOPS @ 2KB

380 IOPS @ 2KB

182 IOPS @ 2KB


F20 pcie card

Global Maksimum Data&Information Technologies

F20 PCIe Card

  • Not a SATA/SAS SSD driver but a x8 PCIe device providing SATA/SAS interface.

  • 4 Solid State Flash Disk Modules (FMod) each of 24 GB size

    • 256 MB Cache

  • SuperCap Power Reserve (EnergyStorageModule) provides write-back operation mode.

    • ESM should be enabled for optimal write performance

    • Should be replaced in every two years.

    • Can be monitored using various tools like ILOM

  • Embedded SAS/SATA configuration will expose 16 (4 cards x 4 FMod) Linux devices.

    • /dev/sdn

  • 4K sector boundary for Fmods

  • Each FMod consists of several NAND modules best performance can be reached with multithreading (32+ thread/FMod etc)


Performance of f20

Global Maksimum Data&Information Technologies

Performance of F20

Random Write PerformanceDegeneration

  • As the flash cache get full (sustained write)

    • Wear Leveling

    • SLC Update Mechanism : Delete + Write

    • Garbage Collector

      write performance is degeneratedduetoWrite Amplification.

  • That’swhyyouare not advisedto put real-time performancedemandingfiles on flashcards

    • Online RedoLogs

?

?

?


Aggregate capacity

Global Maksimum Data&Information Technologies

Aggregate Capacity

Capacity

Performance


Oracle exadata v2 software

Global Maksimum Data&Information Technologies

Oracle Exadata v2 Software

Exadata hardware is almost sufficient to beat any hardware configuration possible to work with Oracle Database.

But why to stop there while it is possible to do more with

Smart Scan

Storage Indexes

I/O Resource Manager

EHCC


Soft components of exadata v2

Global Maksimum Data&Information Technologies

Soft Components of Exadata v2

  • Open Soft Pieces

    • Oracle Enterprise Linux 5.3

      • Oracle defined set of RPMs

        • Oracle OFED (bug fixed version)

  • Oracle Exadata Storage Software

    • Smart Scan

      • Encrypted Data

      • Data Mining

    • Smart Flash Cache

    • HCC

    • Storage Index

    • IO Resource Manager (IORM)

    • Oracle Exadata Bundle Patches

  • Common Soft Pieces

    • Oracle RDBMS 11.2.0.1

      • Partitioning

        • Pruning

      • Parallel Hash Join

        • Bloom Filtering

        • Pairwise/Semi-pairwise Join

      • Compression

        • HCC

      • DBFS

    • Oracle Grid IS 11.2.0.1

      • ASM

      • Clusterware

    • Oracle Exadata Bundle Patches

  • iDB


Smart scan

Global Maksimum Data&Information Technologies

Smart Scan

  • Smart Scan is initially formed to be column and row filtering based on projection and predicates.

  • But this was just the seed idea. Today Smart Scan can also do

    • Projection (column) filtering

    • Predicate (row) filtering

      • SELECT * FROM v$sqlfn_metadata WHERE offloadable = 'YES';

    • Preperation of bloom filters for join

    • Smart Incremental backup

    • Scan on encrypted data

    • Smart File Creation

      • RMAN Restore

      • Tablespace Creation

      • File Grow

    • Scoring for Data Mining

      • All data mining scoring functions are offloaded


Smart scan off why

Global Maksimum Data&Information Technologies

Smart Scan OFF. Why ?

  • CELL_OFFLOAD_PROCESSING = FALSE

  • The table or partition is small.

  • CBO doesn’t choose to use direct path read.

  • ROW_DEPENDENCY ENABLED or rowscn is fetched.

  • Fetch rows in rowid order.

  • CREATE INDEX ... NOSORT

  • LOB or LONG fetch

  • Scan on flashback table

  • Cell based decryption is disable.

  • Tablespace is not completely on Exadata

  • More than 255 columns are queried.

  • Predicate evaluation on virtual column.

  • For dirty blocks


Storage index

Global Maksimum Data&Information Technologies

Storage Index

  • Smart Scan is about saving RAC node CPUs during I/O processing, but storage index is about saving the processors of Exadata storage cells.

  • Anyhow if we figure out that T = E+W, decreasing E in any layer will decrease T. This means faster queries or more queries within the same period.

  • Storage Index is not something first used in Exadata. It is borrowed from Netezza ZoneMap.

    • Oracle’s SI is in memory

  • It is about filtering out for a super set of actual result set.


First execution

Global Maksimum Data&Information Technologies

First Execution

select A,B,C from T1 where B<2;

RDSoRDMA

CELLSRV

Smart Scan

AU

AU


Next executions

Global Maksimum Data&Information Technologies

Next Executions

select A,B,C from T1 where B<2;

Storage Index

B: 2/10

B: 1/5

B: 3/10

B: 5/10

B: 9/10

B: 3/10

iDB

CELLSRV

Smart Scan

AU

AU


More storage index

Global Maksimum Data&Information Technologies

More Storage Index

Information

Tips

Storage Index may not be built by CELLSRV yet.

Storage Regions are not created on all columns. CELLSRV picks out suitable columns to be indexed.

Column types should be suitable (byte level comparison should match type level comparison)

NLS types are not allowed.

Keep your eyes on cell physical IO bytes saved by storage index statistics in V$SYSSTAT or V$SESSSTAT

Remember that in order to fully utilize storage indexes, data should be physically located in clustered manner on highly queried column

You might thing of as which column would you index if you could.

So modify your ETL in accordancewiththat.


Oracle exadata v2 fast track

Global Maksimum Data&Information Technologies

Q

&

A


  • Login