1 / 7

eCAS Curation

eCAS Curation. John J. Tran <John.J.Tran@JPL.NASA.GOV>. Current Curation Process & Status * Working with DMCC -- Combining knowledge from ESIS & eCAS into user-friendly interface -- Strategically selection of relevant meta data requirements for eCAS curation interface

ayanna
Download Presentation

eCAS Curation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. eCAS Curation John J. Tran <John.J.Tran@JPL.NASA.GOV>

  2. Current Curation Process & Status * Working with DMCC -- Combining knowledge from ESIS & eCAS into user-friendly interface -- Strategically selection of relevant meta data requirements for eCAS curation interface * Curation process is manual * We’ve collected data from these sites * Holy Grail: semi-automated curation work flow from data to archive BILL GRIZZLE ALVIN LIU WHI COLORADO SELDI, MALDI, & MISC PI DATA “BLOB” –staging area

  3. eCAS high level system design dB & file storage eCAS system web interface meta-data & policy manager batch cmd-line interface policy repository

  4. CURATION PROCESS Repository Manager A. Create/Update/Delete Repository = collection of dataset B. Manage/Update Data Set 1. Create CDEs if no CDEs exist 2. Create map CDEs  Product Type RDF Process CDEs Protocols Publications Biomarkers REPOS XML/MysSQL BILL GRIZZLE DMCC ALVIN LIU ETC Populate Data Elements in Data Set 1. Map to protocol ID (RDF/bmdb) 2. Map to publication 3. Map to biomarker 4. Set policy information for data set Curation Policy Builder ECAS Policy and Catalog Management Curation & Pre-loading Stage 1. Download Data to staging area 2. Define product composition (files organization) 3. Build policy file (CurationPolicy.XML) 4. Make policy file ready for use CurationPolicy.XML DATA LOADING PROCESS Load & Manage Data Load Data 1. Point to data local or remote 2. For each product in data set a. generate metadata b. validate metadata c. catalog product + metada d. write product metadata to repository e. hand transform data f. roll back on errors 3. Commit process DATA “BLOB” –staging area EDRN ECAS ARCHIVE

  5. Curation & Policy/FM Workflow data manager 1. index data 2. search/modify data 3. add data login main menu 1. curate data 2. manage policy & metadata list policy templates <<select from list>> policy wizard 1. build using existing templates 2. start from scratch policy manager 1. list policies 2. add policy 3. policy wizard define data elements input key-pair values elements define product types input values for product types define product type map map relationship b/w product types & elements

  6. CURATION DOCUMENT FLOW breadcrumb: home > repo: core > CDE breadcrumb: home > breadcrumb: home > repo: core CDE: Core Select An Action * List all CDEs * List all EDRN data set * Associate CDE/Data set Please select a repository * Core * Seldi * Maldi * Misc PI - Add new Repository Repository: Core * List all CDEs * List all EDRN data set * Associate CDE/Data set breadcrumb: home > repo: core > MAP breadcrumb: home > repo: core > Data Set MAP: Core EDRN Data Set: Core breadcrumb: home > repo: create New Repository Creator: Description: breadcrumb: home > repo: core > EDRN Data Set > edit breadcrumb: home > repo: core > CDE > edit EDRN Data Set: edit ID: Name: Description: breadcrumb: home > repo: core > MAP > edit CDE : edit ID: Name: Description: Associate CDE/Data set ID: Parent: Elements: abc… cde… CDEs Abc Def Hij javascript javascript Metadata K/V K/V K/V

  7. Sneak Preview of Tool in the Pipe-line

More Related