internet2

1. www.internet2.edu

2. Internet2:Infraestructura y Aplicaciones Ana Preston Program Manager, Internet2 International apreston@internet2.edu JT RedIRIS 2002 Salamanca, España

3. Outline for today’s talk • Quick Overview of Internet2 • Focus Areas - highlights • Backbone Infrastructure • Applications • Conclusions / Q&A

4. Research & Education • Universities strive for qualitative and quantitative improvements: • In support of research • In support of teaching and learning • how to accelerate the change in technologies and applications on the internet to support new demands for the research and education community? • how can new technologies be incorporated into the existing Internet? (think back in when the Internet started…) • Stanford -- the Internet protocols • NSFNet -- the scaled-up Internet • CERN -- the WWW protocols • University of Illinois -- the Web browser

5. Internet Development Spiral Commercialization Privatization Today’sInternet Internet2 Research and Development Partnerships Source: Ivan Moura Campos

6. Internet2: Mission and Goals • Develop and deploy advanced network applications and technologies for research and higher education, accelerating the creation of tomorrow’s internet. • Enable new generation of applications • Create leading edge R&E network capability • Transfer technology and experience to the global production Internet

7. Internet2 Universities202 University Members, November 2002

8. University Leadership – Collaborative Partnership • 200+ university members with commitments from their Presidents/Chancellors/Rectors • 60+ corporate members • Over 40 Affiliate Members • Government Research Agencies • Organization - Not for profit (not commercial) – UCAID: University Corporation for Advanced Internet Development. Internet2 is a UCAID project. • Internet2 universities are recreating the partnerships that fostered the Internet in its infancy (industry, government, international) • Support applications developers and users • Provide national-scope advanced networking capabilities for universities, research institutes • Spread availability of new networking technology

9. Internet2 Focus Areas • Applications • Engineering • Middleware • Network Infrastructure • Partnerships

10. Internet2 Focus Areas • Advanced Network Infrastructure • Middleware • Engineering • Advanced Applications • Partnerships

11. Internet2 and the Next Generation Internet Initiative Internet2 NGI Federal agency-led University-led Developing education and research driven applications Agency mission-driven and general purpose applications Building out campus networks, gigaPoPs and inter-gigapop infrastructure Funding research testbeds and agency research networks Interconnecting and interoperating to provide advanced networking capabilities needed to support advanced research and education applications

12. National Networks • Federal Backbone Networks • DREN • ESnet • NREN • SuperNet • vBNS • Abilene • The name of Internet2’s network infrastructure • Apr 1998: Project announced at White House • Jan 1999: Production status for network

13. Internet2 Backbones(2.4 - 10 Gbps) Typical Internet2 University Network Connection University Campus University Campus 155 Mbps – 2.4 Gbps Department 155 Mbps – 2.4 Gbps 100 Mbps Regional Network622 Mbps-2.4 Gbps Lab or Classroom 155 Mbps – 2.4 Gbps University Campus

14. Abilene Network Logical Map

15. Internet2 GigaPoPs31 as of November 2002

16. Abilene: Partnership approach • The Abilene Network is a UCAID project done in partnership with • Cisco Systems (routers, switches, and access) • Juniper Networks (routers) • Nortel Networks (SONET kit) • Qwest Communications (SONET & DWDM circuits, co-location) • Indiana University (network operations center) • Internet2 Test & Evaluation Centers (ITECs) • North Carolina and Ohio

17. Abilene – October, 2002 • IP-over-DWDM (OC-192c) and IP-over-SONET backbone (OC-48c) • 50 direct connections (OC-3c  10-Gbps) • 4 (soon 6) OC-48c & 1 Gig Eth connections • 2 10-Gbps (10 Gig Eth) connections pending • OC-192 SONET also supported • 23 connections at OC-12c or higher • Number of ATM connections soon down to 7 • 219 participants – research univs. & labs • All 50 states, District of Columbia, & Puerto Rico • Expanded access • 54 sponsored participants and 25 state education networks

19. Next Generation Abilene • Partnership with Qwest extended thru 2006 • Juniper T640 routers selected for backbone • 10/11 next generation router nodes in place; 12th location pending • 2 racks in each location (Juniper T640 router & 4 measurement servers) • OC-48c SONET interconnects to Cisco 12008 routers • Very pleased to date with new router performance and interoperability with 1st generation backbone • 10-Gbps backbone  deployment has started this Fall • Transcontinental 10-Gbps ’s: 6 ’s connected to network • DC-NYC-Chicago-Indy-KC-Sunnyvale CA-Los Angeles • First  outage (3.5 hours): fiber cut in NYC • ITEC network performance validation test: 8 Gbps of 2-way traffic (v4 and v6 mix) transmitted without loss or reordering – Sunnyvale to San Diego

20. Next Generation Abilene – more • Incremental, non-disruptive transitionUpgrade Schedule Overview • Aug/Sep – New backbone routers installed • Sep/Oct – ‘First wave’ turn-up • Fall 2002 – Connector & peer circuits migrated to new routers • 2003 – Remaining 10-Gbps ’s commissioned • Advanced service foci • Native, high-performance IPv6 • Enhanced, differentiated measurement • Rapid restoration for resiliency

21. Native IPv6 deployment • Abilene is now running native IPv6 over the entire Cisco 12008 and Juniper T640 backbone • Dual stack mode • IS-ISv6 used for internal routing • Significant number of peers and connectors already have converted • Tunnel support consolidated • IU-NOC provides support for existing tunnels; Not accepting any new tunnels • Abilene provided addressing • 2001:468::/35 from ARIN for participants – 63% allocated • 3ffe:3700::/24 from 6bone for SEGP / sponsored users • Native IPv6 (UCSD iGrid demo: 400 Mbps v6 SD-AMS) • Kudos to Abilene NOC, IPv6 WG, Cisco, and Juniper

22. Connectors (12) Great Plains Network Indiana Gigapop MAX NYSERNet Oregon Gigapop Pittsburgh Gigapop SDSC WiscREN NoX South Florida Gigapop Front Range Gigapop ONEnet Peers/Exchange Points (9) 6TAP APAN/TransPAC CUDI JGNv6/WIDE SingAREN SURFNET vBNS+ AMPATH CA*NET(3) Abilene native IPv6 peerings – October, 2002

23. More key aspects of next generation Abilene backbone - I • Resiliency • Moving from SONET rings to unprotected ’s is significant • Collaboration apps demand convergence times of ~100 ms • Faster converging IP-based IGP as ultimate solution • v4 unicast IGP switch from OSPF to IS-IS • Differentiated measurement capabilities • Starting w/four dedicated servers at each node • Local data collection to capture data at times of network instability • Enhance active probing • Now: latency & jitter, loss, reachability (Surveyor) • Regular TCP/UDP throughput tests – ~1 Gbps • Separate server for E2E performance beacon • Enhance passive measurement • Now: SNMP (NOC) & traffic matrix/type (Netflow) • Routing (BGP & IGP) • Optical splitter taps on backbone links at select location(s)

24. 09 January 2002 Sacramento Washington Los Angeles Abilene International Peering (October 2002) Pacific Wave AARNET, APAN/TransPAC† CA*net4, TANET2 STAR TAP/Star Light APAN/TransPAC†, CA*net4, CERN, NAUKAnet, GEMnet, HARNET, HEANET, KOREN/KREONET2, NORDUnet, SURFnet, SingAREN, TAnet2 NYCM CA*net3, GEANT*, HEANET, NORDUnet SNVA GEMNET, SINET, SingAREN, WIDE LOSA UNINET OC3->OC12 San Diego (CALREN2) CUDI AMPATH ANSP, REUNA, RNP2, RETINA El Paso (UACJ-UT El Paso) CUDI • ARNES, CARNET, CESnet, DFN, GRNET, JANET, NORDUNET, RENATER, RESTENA, SWITCH, HUNGARNET, GARR-B, POL-34, RCCN, RedIRIS • † WIDE/JGN, IMnet, CERNet, CSTnet,

25. Abilene international connectivity model • Abilene is a GTRN - Global Terabit Research Network -partner • Already peering with GTRN router in New York City • Peering at major int’l EPs in U.S. encouraged • Chicago: Star Light (migration from STAR TAP) • Seattle: Pacific Wave • Miami: AMPATH • New York City: MAN LAN (GigE/10GigE switch) 10 Gig Ethernet to Star Light now and P/WAVE when ready • Direct BGP peering preferred • via Layer-2 EP media or direct connection to Abilene router • ATM support generally ends by Sept 2003 • No new ATM peers

26. DANTE-provided router in NYC in GTRN AS DANTE-provided 2.5gbps links across Atlantic to GEANT Abilene providing tunnel between New York, (Chicago), Seattle NSF-funded StarLight will provide GNAP Pacific Wave hosting GNAP in Seattle Global NOC at Indiana University GTRN: Current Infrastructure

27. NGA international update • IEEAF (Internet Educational Equal Access Foundation) transatlantic donations – www.ieeaf.org • 10-Gbps  (unprotected) and OC-12c SONET links • ’s from Los Angeles to Amsterdam! • Now links Abilene in NYC and SURFnet in Amsterdam • Joint effort in time for iGrid2002, Amsterdam (9/2002) • Working collaboratively to extend reach in Europe • GEANT and GTRN

28. Abilene Network objectives - 2003 • Advanced Services • Multicast - high performance • IPv6 - native, high performance • Resiliency • Security • Measurement • Active & passive capabilities • e2e performance initiative support • Abilene Observatory: correlated data archive for network research • Experimentation and collaboration • Abilene Observatory: experiment/overlay co-location • TeraGrid interconnection (LA and Chicago) • 'Lambda Grid' experimentation • International connectivity • IEEAF collaboration (Europe, other regions?) • MAN LAN exchange point in NYC

29. Optical networking technology drivers • Computational science: emerging interdiscipline • Now: Bandwidth + distributed data sensing and storage • Increasingly distributed data collection and storage • NSF Distributed Terascale Facility: TeraGrid Project • At end of aggressive period of fiber construction on the national & metro scales in U.S. • Now rapid industry contraction, capital crisises, bankruptcies • Glut of conduit and fiber, but not of bandwidth • Many university campuses and regional GigaPoPs already use dark fiber • Much metro DWDM/GigE and some regional (state based) DWDM • Optical transport is the focus with switching on horizon

30. U.S. R&E optical networking scaling factors • 11 Next Generation Abilene routers • ~50 Abilene connectors • ~220 Abilene participants • Research universities & labs • But… • 30-60 DWDM access nodes in leading viable carriers’ U.S. networks

31. Regional optical fanout • In the next generation architecture, regional & state based optical networking projects are critical • Three-level hierarchy remains vital • National backbone, GigaPoPs (ARNs), Campuses • Close collaboration with the GigaPoPs • Regional Optical Networking project • U.S. carrier DWDM access is now not nearly as widespread as with SONET circa 1998 • 30-60 cities for DWDM • ~120 cities for SONET

32. UCAID objectives for national fiber optical networking facility • With partners, help build and operate a world-class, national-scale optical networking facility • p2p ’s • IP/optical experimentation & protocol development • Operational requirements (over time) • Serve all of higher education • Coordinate closely with regional optical networking initiatives (Quilt RONCO project) • Focus on optical transport initially Continue to examine prospects for a national fiber optical networkingfacility with key partners

33. More information on Abilene • www.internet2.edu/abilene • Contact: • Steve Corbató corbato@internet2.edu • Director, Backbone Network Infrastructure

34. Internet2 Focus Areas • Advanced Network Infrastructure • Middleware • Engineering • Advanced Applications • Partnerships

35. Internet2 Middleware Initiative – middleware.internet2.edu • Middleware: A layer of software between the network and the applications • Middleware Architecture Committee for Education • Early Harvest and Early Adopters • Internet2 PKI Labs • Shibboleth (authentication) • Computational middleware (Beta Grid) • Medical middleware • Directories

36. Internet2 Focus Areas • Advanced Network Infrastructure • Middleware • Engineering • Advanced Applications • Partnerships

37. Engineering Working Groups • End to End Performance • Technologies • IPv6 • Measurement • Multicast • Quality of Service • Routing • Security • Topology • http://www.internet2.edu/html/working-groups.html

38. End-to-End Performance Initiativehttp://e2epi.internet2.edu/index.shtml • To enable the researchers, faculty, students and staff who use high performance networks to obtain optimal performance from the current infrastructure on a consistent basis. Applications Performance Raw Connectivity • True End-to-End Performance requires a system approachuser perception, OS, Host IP stack, Host network card, …LAN, Campus, regional network/GigaPoP, link to I2 national backbones….all the way to International connections! • E2E piPEline: Performance Environment System: • To allow end-users and network operators to determine performance capabilities, locate problems, and contact the right person to get a problem resolved using a collaborative approach.

39. Internet2 Focus Areas • Advanced Network Infrastructure • Middleware • Engineering • Advanced Applications • Partnerships

40. The new science: e-science • Science used to about test tubes, wet labs and big instruments • But increasingly science is moving to networks and computers; Applications that harness the power of the network at the edges • Science is more global and distributed folding@home SETI@home Arecibo Radio Telescope • running on 500,000+PCs, ~1000 CPU years p/day • over half a million CPU years so far • 22 teraflops sustained 24x7 • A virtual supercomputer • http://www.stanford.edu/group/pandegroup/Cosm/ • http://members.ud.com/vypc/cancer/

41. Virtual Observatory • www.voforum.org • Discovery process will rely on advanced visualization and data mining tools • Not tied to a single brick and mortar location • Will cross correlate existing multi-spectral databases petabytes in size No new telescopes or radio dishes. Just big networks interconnecting large database

42. Attributes of Advanced Apps • Provide qualitative and quantitative improvements in how we conduct research and engage in teaching and learning • Common attributes: • Remote instrumentation and interactive collaboration • Distributed data storage and data mining • Large-scale, multi-site computation • Real-time access to remote resources • Dynamic data visualization • Shared virtual reality • Tele-immersion • Digital Libraries, virtual labs, etc… • …..

43. Health Sciences Veterinary Medicine Arts & Humanities Non-trad’l Theses Arts Performance High Energy and Nuclear Physics GIS … Remote Instrumentation Voice over IP Digital Video Videoconferencing ResearchChannel Network Storage … Internet2 approach: Applications Working Groups

44. Sciences and Engineering highlights – apps.internet2.edu • NEES: Network for Earthquake Engineering Simulation • Earthquake research using real buildings and computer simulations • Remote control of physical experiments requires extremely reliable and consistent network characteristics • Video will be crucial: both for conferencing and data collection • HENP-WG: High Energy and Nuclear Physics Working Group • Terabytes of data (1,000,000,000,000 or 1x1012) per experiment from CERN (Switzerland). • bulk data transfers that are extremely resistant to data loss. Work on several protocols that take advantage of parallel streams and good neighbor practices (passive QOS). • Astronomy: eVLBI - Electronic Very Long Baseline Interferometry • Remote-WG: Cross Disciplinary Remote Instrumentation Working Group

45. Remote Instrumentation and Data Analysis Large scientific projects increasingly draw on resources from many countries. Scientists can use high-performance networks for remote instrument control and to pool computing resources for data analysis, improving ease of use and lowering costs. • The Gemini Observatory – Twin Telescopes • An international collaboration (US, Australia, U.K., Canada, Chile, Argentina, Brazil) • NSF funds US participation Mauna Kea, Hawai’i, USA Cerro Pachon, Chile

46. VLBI - Very Long Baseline Interferometry • Astronomers collect data about a star from many different earth based antennae and send the data to a specialized computer for analysis on a 24x7 basis. • VLBI is not as concerned with data loss as they are with long term stability. • The end goal is to send data at 1Gb/s from over 20 antennae that are located around the globe. Interesting: Successfully ran 788 Mbps sustained test between sites in U.S. Working on prototype experiment to test their ability to run data to Europe and Japan.

47. Health Sciences http://www.internet2.edu/health/ • 3D Brain Map • Visualization of data: real-time MRI, previously stored data, etc. • Computational information transferred to supercomputers and used to understand brain functions in real time • Very large multi-dimensional, multi-modal, time-varying data sets • University of Pittsburgh,Pittsburgh Supercomputing Center • Biomedical Informatics Research Network (BIRN) • Extremely large data sets and repositories • Dynamically generate 3D visualizations from medical records • Generating 36Gbytes/day, so new models for search, retrieval and analysis will be necessary • http://birn.ncrr.nih.gov/and http://www.nbirn.net/

48. Digital Video – Distance Ed • Tele-presence environments • Real-time interactions with very high quality audio and MPEG-2 video • as needed “meetings” connecting faculty and staff across the ocean • Plain and Simple:Language/cultural Exchanges • CCIU World Tour/Univ. of Pennsylvania • Learning foreign languages through cultural exchanges and problem based experiential learning

49. Arts and Humanities • University of Oklahoma Master Classes • High fidelity video and audio via MPEG2 • Optimized latency, audio/video synchronization • Connecting Oklahoma with the New World Symphony in Miami, Florida • Zuckerman Interactive • A collaboration with: • Manhattan School of Music • Columbia University • National Arts Centre of Canada • National Research Council of Canada Photo by R. Andrew Lepley

50. An effort to encourage and support large-scale, distributed collaboration for R&E Enabling one-to-one, one-to-group, and group-to-group collaboration Supporting personal communications, meetings, conferences, and teaching and learning Share best practices Guide to implementations facilitate development & deployment of projects For Internet2 members and their international partners commons.internet2.edu Voice/IP Peer to Peer Collaboratories H.323 Electronic Notebooks Data Sharing Instant Messaging Others VRVS AG MPEG2 Others Other Collaborative Technologies Videoconferencing Technologies The Internet2 Commons The Internet2 Commons