Distributed data management
Download
1 / 27

Distributed Data Management - PowerPoint PPT Presentation


  • 134 Views
  • Uploaded on

Distributed Data Management. Graeme Kerr Oracle in R&D Programme. Distributed Data Management. Provides access to data when and where you need it Optimizes information access regardless of physical location of data. Enables virtualisation of data in Grids. Types of Data:

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Distributed Data Management' - savanna-angeloz


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Distributed data management

Distributed Data Management

Graeme Kerr

Oracle in R&D Programme


Distributed data management1
Distributed Data Management

  • Provides access to data when and where you need it

    • Optimizes information access regardless of physical location of data.

    • Enables virtualisation of data in Grids.

  • Types of Data:

    • Flat Files, Relational.

    • Structured & unstructured.

    • Text, Binary, proprietary.

    • Scalar, user defined typed, XML, RDF

    • Images, DICOM, LOB, Spatial.

    • High Volumes.


Methods of data distribution
Methods of Data Distribution

  • Distribute

  • Federate

  • Consolidate


Distribute information
Distribute Information

  • Share information between users, applications, databases, organisations and partners.

    • Move or copy / replicate information as needed

    • Traditionally implemented as replication or message queuing

    • Wide range of technology solutions to achieving distribution.

    • Continuous feed and periodic refresh capabilities are key requirements.

  • Common within Scientific Grid Approach

    • Works well when replicas are read-only.

    • Considerable issues when replicas are updateable.


Data distribution example
Data Distribution - Example

Continuous Feeds

SOURCE SITE

REPLICA SITES


Data distribution example1
Data Distribution - Example

Periodic Refresh

Continuous Feeds

SOURCE SITE

REPLICA SITES


Data distribution example2
Data Distribution - Example

Transportable Tablespaces,

RMAN,

Data Pump

Oracle STREAMS

SOURCE DATABASE

REPLICA DATABASES


Cern lcg example

TRIUMPF

Gridka

ASGC

SARA

IN2P3

CNAF

RAL

BNL

PIC

Nordu

CERN LCG Example

Offline DB @

CERN IT

Grid

Online DB @

Detector


Methods of data distribution1
Methods of Data Distribution

  • Distribute

  • Federate

  • Consolidate


Federate information
Federate Information

  • Federate data in multiple data stores into a single virtual database

    • Access both Database and non-Database data

    • Access both structured and unstructured data

    • Hide physical location of data from applications

    • Vendor and open-source solutions.

  • Used mostly as point solution within Commercial World rather than as a key design point.


Data federation example
Data Federation - Example

Excel

DB2

Web

Services


Data federation example1
Data Federation - Example

Excel

DB2

Flat

Files

XML

Text

Web

Services

Flat

Files

Sybase


Data federation example2
Data Federation - Example

Excel

DB2

Flat

Files

XML

Text

Web

Services

Flat

Files

Sybase


Data federation example3
Data Federation - Example

Excel

DB2

Flat

Files

XML

Text

Web

Services

Flat

Files

Sybase


Methods of data distribution2
Methods of Data Distribution

  • Distribute

  • Federate

  • Consolidate


Consolidate information
Consolidate Information

  • Consolidate heterogeneous data into a central pool.

    • Single database or pool of databases

    • Any data (audio, video, XML, email, messages, etc…)

    • Any platform (Linux, Windows, Solaris, HPUX, AIX, Tru64, OpenVMS, OS/390)

    • Proven scalability

      • Hundreds of Very Large Database customers

      • Industry leading benchmarks

  • Very common in commercial world.


Typical data centre view
Typical Data Centre View

DB Users

DB Clusters

Disk


Consolidated clusters with rac asm
Consolidated Clusters with RAC & ASM

DB Users

DB Cluster

Pool

Disk Pool


Db server disk virtualisation
DB Server & Disk Virtualisation

DB Users

DB Cluster

Pool

Disk Pool


Db server disk virtualisation1
DB Server & Disk Virtualisation

DB Users

DB Cluster

Pool

Disk Pool


Db server disk virtualisation2
DB Server & Disk Virtualisation

DB Users

DB Cluster

Pool

Disk Pool


Distributed data management summary
Distributed Data Management : Summary

  • Oracle supports efficient utilization of all resources:

    • Consolidate Information—Scalable access to large amounts of information

    • Federate Information—Data can be located where needed but accessed as single database

    • Share Information—Multiple users and applications can share data/information to operate more effectively

  • Information Integration & fast connectivity critical to Grid Computing


Oracle database versions
Oracle Database Versions.

  • Database 10G Express Edition

    • Entry-Level, small footprint, free to develop, deploy & distribute.

    • 32 Bit Windows, RHEL3 & 4, FC 4, SLES9, Debian 3.1, Ubuntu & Mandriva

  • Database 10G Enterprise Edition

    • Flagship, Full-featured version.

  • Database 10G Standard Edition

    • Limited featured version, RAC, ASM, Streams Apply supported

  • Database 10G Standard Edition 1

    • SE on limited hardware. Streams Apply supported.

  • Data Grid / Distributed Caching

    • TimesTen

    • TangoSol Coherence


Oracle database versions1
Oracle Database Versions.

  • Database 10G Express Edition

    • Entry-Level, small footprint, free to develop, deploy & distribute.

    • 32 Bit Windows, RHEL3 & 4, FC 4, SLES9, Debian 3.1, Ubuntu & Mandriva

  • Database 10G Enterprise Edition

    • Flagship, Full-featured version.

  • Database 10G Standard Edition

    • Limited featured version, RAC, ASM, Streams Apply supported

  • Database 10G Standard Edition 1

    • SE on limited hardware. Streams Apply supported.

  • Data Grid / Distributed Caching

    • TimesTen

    • TangoSol Coherence


For more information
For More Information

Database: www.oracle.com/database/index.html

Express Edition: www.oracle.com/technology/products/database/xe/index.html

Tangosol: www.oracle.com/tangosol/index.html

Times 10: www.oracle.com/database/timesten.html

or

http://search.oracle.com

Database | Tangosol | etc


Emea oracle in r d programme
EMEA Oracle in R&D Programme

[email protected]

[email protected]


ad