1 / 20

Database Deployment at RAL

Database Deployment at RAL. Gordon D. Brown Database Services Manager e-Science, CCLRC. HEPiX - Spring 2006 Rome 3 rd – 7 th April. Overview. Database Services Projects: 3D, FTS, SRB, CASTOR, NGS Monitoring, Back-ups Hardware & Structure Future. Gordon D. Brown e-Science, RAL. 2.

lula
Download Presentation

Database Deployment at RAL

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Database Deployment at RAL Gordon D. Brown Database Services Manager e-Science, CCLRC HEPiX - Spring 2006Rome3rd – 7th April

  2. Overview • Database Services • Projects: 3D, FTS, SRB, CASTOR, NGS • Monitoring, Back-ups • Hardware & Structure • Future Gordon D. Brown e-Science, RAL 2 12 July 2014

  3. Database Services Structure • Part of the Data Management Group in the e-Science Centre • Structure • Database Services Manager • 4 DBA Staff Resource • 1 System Administration Staff Resources • More resources with other groups (including Tier-1) Gordon D. Brown e-Science, RAL 3 12 July 2014

  4. Database Services Set-up • Running Oracle 10g Enterprise Server with Real Application Clusters • Using RedHat Linux (RHEL 4.0 AS) with Oracle Automatic Storage Management (ASM) • Oracle Data Guard • Recovery Manager (RMAN) • Grid Control (Oracle Enterprise Manager) Gordon D. Brown e-Science, RAL 4 12 July 2014

  5. Database Services Hardware Structure

  6. RAL 3D Status • Test implementation early last year • Still in test phase, using test machine • 2 x 2.8GHz xeon processors • 2GB RAM • 120GB HDD • RedHat Enterprise Linux 3 Gordon D. Brown e-Science, RAL 6 12 July 2014

  7. RAL 3D Status • Oracle 10.1.0.4 (single instance) installed • Back-ups configured for RMAN • Successful set-up of: • Oracle Streams (3D) • File Transfer Service (FTS) • Oracle Enterprise Manager (OEM) • COOL Gordon D. Brown e-Science, RAL 7 12 July 2014

  8. RAL 3D Plans • Hardware arrived Feb 2006 • 2 x 2 node Oracle cluster • Dual Opteron CPU, 4GB Memory • Shared storage of 4TB • Oracle installation and pre-production testing April 2006 • Production in autumn 2006 Gordon D. Brown e-Science, RAL 8 12 July 2014

  9. 3DDatabase Hardware Structure

  10. LCG Grid Applications • FTS • The File Transfer Service provides a controlled channel for reliable delivery of files from one SE to another. It maximises utilisation of lines and aims to avoid overloading servers with excessive parallel requests. • LFC • Can run using Oracle Gordon D. Brown e-Science, RAL 10 12 July 2014

  11. File Transfer Service Gordon D. Brown e-Science, RAL 11 12 July 2014

  12. Storage Resource Broker • Developed at San Diego Supercomputer Center • A distributed file system (Data Grid), based on a client-server architecture • Allows users to access files seamlessly across a distributed environment, based upon their attributes rather than just their names or physical locations • It replicates, syncs, archives, and connects heterogeneous resources in a logical and abstracted manner Gordon D. Brown e-Science, RAL 12 12 July 2014

  13. Storage Resource Broker • The MCAT database is a metadata repository that provides a mechanism for storing information used by the SRB system • Includes: • Internal system data required for running the system • Application (user) metadata regarding data sets being brokered by SRB. Gordon D. Brown e-Science, RAL 13 12 July 2014

  14. CASTOR • Cern Advanced STORage system • Hierarchical Storage System developed by CERN for large scale storage of particle physics data • Data access to/from scalable farm of disk servers • Data transparently migrated from disk servers to tape according to defined policies • Database centric architecture (Oracle) Gordon D. Brown e-Science, RAL 14 12 July 2014

  15. CASTOR Architecture Stager DB Svc Job Svc Qry Svc Error Svc Mover DB Mover Disk Servers TapeDaemon Tape Servers Client RH Scheduler RR GC StagerJob MigHunter NameServer RTCPClientD VMGR RTCPD VDQM

  16. National Grid Service • Facilities for grid computing and data analysis • To provide the broad user community with access to large scale resources through the grid interface • To meet users’ evolving requirements for a production grid service by working with the user community, through the User Group established by the Core Programme Gordon D. Brown e-Science, RAL 16 12 July 2014

  17. National Grid Service • Configuration

  18. Back-ups • Current configuration • RMAN • BMAN • Atlas Data Store • RMAN Recovery Catalog • Efficiency Improvements • Improvements to CCLRC Systems • Extension to NGS Gordon D. Brown e-Science, RAL 18 12 July 2014

  19. Oracle Enterprise Manager Gordon D. Brown e-Science, RAL 19 12 July 2014

  20. Questions & (hopefully) Answers Gordon D. Brown e-Science, RAL 20 12 July 2014

More Related