cc nie adamant n.
Skip this Video
Download Presentation

Loading in 2 Seconds...

play fullscreen
1 / 5

CC-NIE ADAMANT - PowerPoint PPT Presentation

  • Uploaded on

CC-NIE ADAMANT. Transforming Computational Science with ADAMANT (Adaptive Data-aware Multi-domain Application Network Topologies) RENCI/UNC Chapel Hill (Ilia Baldine ) Duke University (Jeff Chase ) USC/ISI ( Ewa Deelman )

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about 'CC-NIE ADAMANT' - thanos

Download Now An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
cc nie adamant
  • Transforming Computational Science with ADAMANT (Adaptive Data-aware Multi-domain Application Network Topologies)
    • RENCI/UNC Chapel Hill (Ilia Baldine
    • Duke University (Jeff Chase
    • USC/ISI (
  • An integration award (not a campus infrastructure)
  • Enable computational workflow-driven science on multi-domain IaaS
    • Integrate ORCA resource provisioning with Pegasus WMS
    • Enable provisioning of compute/storage/network resources by workflows in response to their needs through application-specific topology embedding
    • Enable pre-planned movements of data over engineered dynamic connections between domains in support of computational workflow tasks
proposed work 1 3
Proposed work 1/3
  • Application-specific IaaS topology embedding
    • Select appropriate pools of computational resources based on workflow needs
      • Include GENI racks, supercomputers, OSG sites as potential sources of computational resources
    • Create dynamic on-ramps to move raw data sets into the slice for computation and move processed data sets for permanent storage
      • Treat Science DMZ, DYNES, GENI rack, OSG site locations among convenient on-ramp endpoints
        • Working with OSG sites in Wisconsin, RENCI
      • Use available mechanisms to move data (GridFTP, FTD, iRods)
    • Integrate resource provisioning logic into Pegasus WMS
    • Use several driving applications to demonstrate:
      • Astronomy
      • Earth science (CyberShake)
      • High-throughput sequencing
      • They have different demands for computations and data movements and are representative of larger classes of applications
proposed work 2 3
Proposed work 2/3
  • Automatic address space management and authorization
    • Each slice has a dedicated Layer 2 dataplane with its own address space
      • Typically private, can be public
    • Moving data via on-ramps requires automatically managing address spaces between slice and on-ramp touchpoints
    • Use OpenFlow and custom controllers as a mechanism to direct and properly authorize traffic moving the data sets between an ephemeral slice and e.g. persistent campus infrastructure
      • When possible rely on campus OpenFlow deployments as an enabling capability
proposed work 3 3
Proposed work 3/3
  • Bridge Layer 2 air gaps
    • Whenever a dynamic L2 provider does not extend all the way to campus (e.g. via a regional), mechanisms must be devised to get around this to support ADAMANT needs
  • Enable workflow ensemble management
    • Computational science more widely relies on ensembles of workflows for e.g. performing parameter sweeps
    • Need tools to evaluate resource needs of a workflow ensemble in order to provision those