1 / 20

Safe Replication and Data Staging

Safe Replication and Data Staging. Core Services of the EUDAT CDI. Johannes Reetz , RZG 2nd EUDAT conference Rome , 29 Oct 2013. e nrichment processing reduction analysis. Identifier Service. d omain of registered data. Data Stage-Out. individual value. community value.

Download Presentation

Safe Replication and Data Staging

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013

  2. enrichment processing reduction analysis Identifier Service domain of registered data Data Stage-Out individual value community value society value publication acquisition generation description preservation Data Stage-In Safe Replication EPIC Handle PID

  3. Replication fromrepositoriestodatastorages in different administrative domains (long-term) archiving and preservation optimize access for users from different regions bring data closer to powerful computers for data analytics • Typicalpoliciestriggeredby Community Data Managers: • Replicate collection X from my repository to data centres A and B • Store the replica safely for N years • Check theintegrityofthereplicaevery M years

  4. Transferring data from EUDAT storages to compute facilities reliable, efficient, easy-to-use tools to manage data transfers ingest data into the EUDAT domain of registered data

  5. enabled EUDAT sites EPIC EPIC Handle Service Handle Service http://cmon.eudat.eu repositories replicastorages Eachdatacentre (administrative domain) has a dedicated Handle namespace (prefix)

  6. EPIC Handle Service http://cmon.eudat.eu repositories replicastorages GridFTP

  7. CLARIN (MPI-PL/TLA) production

  8. CLARIN (EKUT) production

  9. CLARIN (CUNI/LINDAT) production

  10. ENES (DKRZ/CMIP5) production

  11. EPOS (INGV) production

  12. VPH (UCL) production

  13. EPOS (ORPHEUS/ KNMI) work in progress

  14. INCF (KTH) work in progress

  15. DiXa (EBI) work in progress

  16. Track 1 – Agenda – Session 1 usecases in production 14:00: B2SAFE and B2STAGE: Core Services of the EUDAT CDI, Johannes Reetz 14:10: B2SAFE adoption in the EPOS community, Claudio Cacciari 14:25: B2SAFE for Replicating Linguistic Resources, Willem Elbers 14:40: B2SAFE Setup with a Dspace Repository, PavelStranak 14:55: VPH and the Biomedical Scientific Case for EUDAT, Peter Coveney 15:10: Community integrated B2STAGE tools, Stefan Zasada/Giuseppe Fiameni 15:35: B2SAFE Practical Policies, Willem Elbers 15:45: B2SAFE Data Policy Manager, Maria Francesca Iozzi Track 1 – Agenda – Session 1

  17. usecase in production 14:00: B2SAFE and B2STAGE: Core Services of the EUDAT CDI, Johannes Reetz 14:10: B2SAFE adoption in the EPOS community, Claudio Cacciari 14:25: B2SAFE for Replicating Linguistic Resources, Willem Elbers 14:40: B2SAFE Setup with a Dspace Repository, PavelStranak 14:55: VPH and the Biomedical Scientific Case for EUDAT, Peter Coveney 15:10: Community integrated B2STAGE tools, Stefan Zasada/Giuseppe Fiameni 15:35: B2SAFE Practical Policies, Willem Elbers 15:45: B2SAFE Data Policy Manager, Maria Francesca Iozzi Track 1 – Agenda – Session 1

  18. Track 1 – Agenda – Session 1 practicalpolicies andpolicymanagement 14:00: B2SAFE and B2STAGE: Core Services of the EUDAT CDI, Johannes Reetz 14:10: B2SAFE adoption in the EPOS community, Claudio Cacciari 14:25: B2SAFE for Replicating Linguistic Resources, Willem Elbers 14:40: B2SAFE Setup with a Dspace Repository, PavelStranak 14:55: VPH and the Biomedical Scientific Case for EUDAT, Peter Coveney 15:10: Community integrated B2STAGE tools, Stefan Zasada/Giuseppe Fiameni 15:35: B2SAFE Practical Policies, Willem Elbers 15:45: B2SAFE Data Policy Manager, Maria Francesca Iozzi Track 1 – Agenda – Session 1

  19. SAFE REPLICATION AND DATA STAGING - Speakers Johannes ReetzRZG / MPG Peter Coveney University College London Stefan Zasada University College London Claudio CacciariCINECA Willem Elbers Max-Planck-Institute for Psycholinguistics Giuseppe Fiameni CINECA Maria Francesca IozziSIGMA/Universityof Oslo PavelStranak Charles University

More Related