120 likes | 125 Views
Internet 2 Distributed Storage Infrastructure Update. Micah Beck andTerry Moore Univ. of Tennessee, Knoxville Bert Dempsey Univ. of North Carolina, Chapel Hill Coalition for Networked Information 26 & 27 April 1999, Washington, DC http://dsi.internet2.edu. UT Knoxville / ICL Micah Beck
E N D
Internet2 Distributed Storage Infrastructure Update Micah Beck andTerry Moore Univ. of Tennessee, Knoxville Bert Dempsey Univ. of North Carolina, Chapel Hill Coalition for Networked Information 26 & 27 April 1999, Washington, DC http://dsi.internet2.edu
UT Knoxville / ICL Micah Beck Terry Moore Martin Swany Judi Talley UNC Chapel Hill /SILS Bert Dempsey Paul Jones (MetaLab) Debra Weiss Zhiwei Xiao GigaPOP and Campus Site Managers UCAID/Internet2 Network Storage Working Group Ted HanssApplications Director Ann O’BeayCorp. Relations Director NC Networking Initiative Digital Library Federation I2-DSI Participants
I2-DSI Model: Replicated Services • Clients access nearby server • Everyone gets performance • Local resources implement a global service
replicated core delegated server local users I2-DSI Service Architecture • Replication • Rsynch, Omnicast, AFS/DFSNovell Replication • Resolution • Sonar DNS, Distributed Director • Delegation • Cache prefetch general users
Infrastructure Expansion • StorageTek • 3-4 PC/Linux Servers • 700GB disk, tape backup (hot!) • Novell • 6 PC/NetWare Servers • 100GB disk • Smaller institutions or departments
InfrastructureDevelopment Efforts • Proximity Resolution • Martin Swany: SonarDNS • Geoff Carpenter, German Goldszmidt: Narwhal (IBM) • Replication Mechanisms and Modeling • Bert Dempsey & students: • Debra Weiss: Batch rsync + multicast • Zhiwei Xiao: Network metrics and modeling • Channel Representation and Server • Leif Abrahamsson, Christophe Achouiantz, Patrik Johansson (Ellemtel)
10 applications Indiana: Digital music and media library UNC-CH: Instructional Management System San Jose State: Art history images Vanderbilt: zoomable medical images Viagenie: Network docs database Columbia: Earth sciences environment UNC-CH: Virtual Laboratories Ohio Supercomputer Center: High Volume Datasets CalTech: Globally Interconnected Databases Univ. of Kent: National Software Archive Red Hat: pan-Linux source distribution I2-DSI Applications WorkshopChapel Hill, NCMarch 4 &5, 1999
I2-DSI Applications WorkshopChapel Hill, NCMarch 4 &5, 1999 • 4 technologies • Minnesota: Scalable Video • IBM Research: Multicast, Filter and Store • Moscow Ctr. for New Info. Tech. in Med. Ed.: Semantic Text Analysis • IBM Research: Service Resolution Proxy • http://dsi.internet2.edu/apps99.html • Special issue of the Journal of Network and Computer Applications (Academic Press)
Application Management Partner MetaLab.unc.edu • The site formerly known as SunSITE.unc.edu • Fearless Leader Paul Jones • “A cool, tall glass of sweet tea on a hot day.” • 2 M HTTP & 1/3 M FTP file transfers daily • Collections policy • teaching, research, or public service • use technology in innovative and unique ways • non-commercial or not-for-profit
The Need for Channel Representation Standards locally interpreted files replicated files Origin Server Replicated Server Replicated Server proxy Web clients Standard-based Web traffic Replication of source files
Conclusions • A server platform is in place • Infrastructure development • Service abstractions (search, computation) • Publication and replication protocols • Portable representation and API • Heterogeneous servers • Six months to show results from initial application development efforts