1 / 8

Veridata for Data Consistency in WLCG

Veridata for Data Consistency in WLCG. OpenLab lightning talks 2014. Anti Asko Supervisor: Lorena Lobato Pardavila. The Project Challenge. IT-DB provides replication services between CERN and specific Tier-1 data centers world wide as part of the WLCG project

clancy
Download Presentation

Veridata for Data Consistency in WLCG

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Veridata for DataConsistency inWLCG OpenLablightning talks 2014 Anti Asko Supervisor: Lorena LobatoPardavila

  2. The Project Challenge • IT-DB provides replication services between CERN and specific Tier-1 data centers world wide as part of the WLCG project • Checking data consistency is a challenging task • Oracle GoldenGate Veridata seems a promising solution Anti Asko

  3. GoldenGate Veridata • Data comparison tool • High performance • Cross platform • Checking between divergent databases • Repair out-of-sync data Anti Asko

  4. GoldenGate Veridata Anti Asko

  5. Evaluation Process • Test Process • Mock data generated • Replicated from Cern to Tier-1s • Check data consistency with Oracle GoldenGate Veridata Anti Asko

  6. Evaluation Process • Real Production Data • Atlas data through Tier-1s • Check the consistency with Oracle GoldenGate Veridata • More than 1.23 TB of data checked • More than 21.000 tables were processed Anti Asko

  7. Conclusions • Powerful tool for data comparison and repair • Trustworthy for the WLCG’s rapidly adjusted environment • A tool IT-DB needs Anti Asko

  8. THANK YOU! Anti Asko

More Related