The tardis framework
This presentation is the property of its rightful owner.
Sponsored Links
1 / 32

The TARDIS Framework PowerPoint PPT Presentation


  • 48 Views
  • Uploaded on
  • Presentation posted in: General

The TARDIS Framework. A Federated Repository Solution For Raw Diffraction Datasets. Steve Androulakis, Monash University, Melbourne Australia International Digital Curation Conference, 2010. Started in late 2007 Public Access to Raw Protein Crystallography Data Fedora Commons Based

Download Presentation

The TARDIS Framework

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


The tardis framework

The TARDIS Framework

  • A Federated Repository Solution For Raw Diffraction Datasets

Steve Androulakis, Monash University, Melbourne Australia

International Digital Curation Conference, 2010


The tardis framework

Started in late 2007

Public Access to Raw Protein Crystallography Data

Fedora Commons Based

Federated Storage

Protein Crystallography Specific Code


The tardis framework federated data storage

The TARDIS FrameworkFederated Data Storage

Repository

Repository

Repository

TARDIS.edu.au

Repository

Repository


Tardis internal structure

TARDIS’ Internal Structure

Thanks to Alistair Grant


Generic parameter support

Generic Parameter Support

Thanks to Alistair Grant


The tardis framework

Why Fedora wasnʼt suitable for large datasets..

HTTP Protocol Multiple / Large File

Downloading Setup and maintenance

Existing repository solutions at institutions..

Willingness / funds for libraries to store large datasets


Data from production to publication

Data - From Production to Publication

Production

Managed by an instrument/facility’s system, such as that at the Australian Synchrotron

Processing

???

Data exists on researchers’ personal computers and is usually NOT managed in any standard, persistent way

Publication

Solutions exist for deposition of data into several sources. TARDIS currently solves for raw Px data


The need for data management at time of processing

The Need for Data Management at Time Of Processing

Processing


The tardis framework

From Capture to Publication


The tardis framework

Also deployed at:

University of Mebourne

La Trobe University


Tardis internals lightweight architecture

TARDIS: Internals Lightweight Architecture


The tardis framework

6 Datasets, 5140 Datafiles ~90GB


The tardis framework

Upcoming Features..

  • Data ‘staging’ mechanism.

MyTARDIS


The tardis framework

Australian Synchrotron / ANSTO

We’re now the ‘official solution’ for instruments at AS + ANSTO!

..so more instruments + facilities

“TARDIS/MyTARDIS system for high-end instrumentation data capture (e.g. X-ray diffraction images) has been chosen by both the Australian Synchrotron and ANSTO (Australian Nuclear Science and Technology Organisation) as the platform for metadata capture. Congratulations to the developers of TARDIS/MyTARDIS: Monash University biochemist, Associate Professor Ashley Buckle and software engineer Mr Steve Androulakis. (Support received from the Monash e-Research Centre, the Victorian eResearch Strategic Initiative, the Australian Synchrotron and the Australian National Data Service).”


The tardis framework

Australian Synchrotron / ANSTO

  • Test instances already receiving SAXS/WAXS and IR data…

  • New Authorisation Engine Enables Various Access Rules For:

    • Groups of users

    • People in specific locations (ip based)

    • Custom rules (such as embargo periods)

  • Powerful Search Interface

    • Generic search across all parameters by various rules

    • Discipline specific ‘canned’ searches

  • Easy Parameter Schema Definition

  • (in conjunction with Monash Metadata Store project)

    • Users to define new parameter sets

    • Coming in a later iteration..

  • Advanced Parameter Editing

  • (in conjunction with Monash Metadata Store project)


The tardis framework

Molecular Biology Auto-Processing

Thanks Grischa Meyer


Upcoming projects

Upcoming Projects…


The tardis framework

Upcoming Projects

  • RMIT – Microscopy

    • 9 Microscopes

    • New ‘Filter’ Module Functionality

    • RMIT eResearch Office – Heinz Schmidt / Ian Thomas

  • The Ian Wark Research Institute – Particle Physics

    • Instrument Linkage

    • University of SA - Ryan Green

  • Peter Mac Institute – Next Gen Sequencing

    • Instrument Linkage

    • Courtesy of VeRSI – Lyle Winton

  • APS Chicago?!


The tardis framework

TARDIS’ Modular Framework

Microscopy

Synchrotron

VBL Download

VBL Authentication

Visual Style

Parameter Schemas

Parameter ‘Filters’

Visual Style

Parameter Schemas

MyTARDIS

http://code.google.com/p/mytardis/ (BSD)

TARDIS.edu.au

Federated Storage Support

Visual Style and Templates

Parameter Schemas


This project is supported by the australian national data service ands

This project is supported by the Australian National Data Service (ANDS)

ANDS is supported by the Australian Government through the National Collaborative Research Infrastructure Strategy Program and the Education Investment Fund (EIF) Super Science Initiative


The tardis framework

Special thanks to..

Find us at:

tardis.edu.au


  • Login