1 / 11

LN: The Story So Far

LN: The Story So Far. Micah Beck Computer Science Dept. University of Tennessee REDDnet I2 Side Mtg Arlington Virginia 25 April, 2007. Logistical Networking Stack. IBP is Mature, Needs Update. As a virtualized storage service it performs adequately, has most needed functionality

caden
Download Presentation

LN: The Story So Far

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. LN: The Story So Far Micah Beck Computer Science Dept. University of Tennessee REDDnet I2 Side Mtg Arlington Virginia 25 April, 2007

  2. Logistical Networking Stack

  3. IBP is Mature, Needs Update • As a virtualized storage service it performs adequately, has most needed functionality • Mechanisms sought to limit strength of capabilities (e.g. Tackett, Hejtmánek) • More complete implementation of programmable NFU operations • Optimization for use in local applications

  4. exNode, LoRS are Stagnant • LoCI libraries & tools are unsupported • Performance and reliability suffer when replication levels are low • Control over data placement is weak • Overall, it is still used successfully

  5. Can LN Succeed? • Not just software tools, but a community of developers and applications? • What are the current of interest & activity? • What challenges must be met? • What is required of you, the participants?

  6. Directory & File System Services • LoDN: lightweight directory services providing naming and exNode warming • Data distribution, file multicast • Interfaces with libStdio • L-Store: more complete file storage and access model: policy, security, size • Interfaces with own client library • StorCore: resource management

  7. Logistical Networking Stack

  8. I/O Interfaces and Applications • libStdio, NetCDF/L and HDF5/L • Layered over LoRS • Heavily multithreaded • End-to-end services • File system (NFS, CIFS) • Data visualization, geospatial data distribution, HEP (ROOT)

  9. Challenge: Interoperability • Common interfaces for common services • Allows unification of software development • Enables exchange of software modules • A hedge against being limited to one development direction • Takes significant effort away from development of core tools

  10. Challenge: Private Resources • Limited sharing is fine, but storage customers are fundamentally local • LN model can be adapted to private resources, but without sharing LN only supports storage virtualization • Is interoperability across private storage pools important?

  11. Challenge: Service Creation • Services can federate private resources into global functionality • Security, utilization policy can be enforced at administrative, institutional boundaries. • How do we define, implement and deploy such services? • What is the path from REDDnet to these other services?

More Related