1 / 16

Data Management: a Grid Enablers Perspective

Data Management: a Grid Enablers Perspective. Mark Santcroos e-BioScience group Bioinformatics Laboratory Academic Medical Center, Amsterdam, NL EGI Technical Forum – Lyon – 19 september 2011. Academic Medical Center. e-BioScience group. Part of Bioinformatics Laboratory

leliad
Download Presentation

Data Management: a Grid Enablers Perspective

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Data Management:a Grid Enablers Perspective Mark Santcroos e-BioScience group Bioinformatics Laboratory Academic Medical Center, Amsterdam, NL EGI Technical Forum – Lyon – 19 september 2011

  2. Academic Medical Center

  3. e-BioScience group • Part of Bioinformatics Laboratory • Medical researchers  BiG Grid • “Grid Enablers” for domains: • Medical Imaging • (Next Genation) Sequencing • Proteomics • Virus Discovery • etc. • Life-Science Grid Community (VRC)

  4. Collaborations

  5. Workflows

  6. Data Architecture

  7. Access Requirements • Normal users ask for normal protocols • Non-data center environments ask for normal protocols • Inter-infrastructure ask for normal protocols • Standards (WEBDAV?) • Abstractions (SAGA?)

  8. Access Requirements (2) • Direct I/O (or at least I) • File access privileges • Integrity (checksums) • Non-file (Databases)

  9. Transfer vs Management • Lifetime, persistency • Provenance • Usage statistics • Coupling with catalogs from domains (syncat?) • Meta-data

  10. Catalog vs Storage Element • One-way only • Out of sync privileges (try to explain that to users!)

  11. Misc observations • Is “grid-storage” write-once or not? • Error reporting … • Testing • Decoupling of client and server • Software developers vs Operators vs Users

  12. API vs Language binding • Protocol / API is just part of the story • Need proper language bindings too • (Will mostly get solved by “normal” protocols)

More Related