Euro-Link HPIIS Performance Review October 25, 2000

1. Euro-LinkHPIIS Performance ReviewOctober 25, 2000 Tom DeFanti Maxine Brown Jason Leigh Laura Wolf Linda Winkler

2. Euro-Link National Research Networks Canada CERN Denmark Finland France Iceland Israel Netherlands Norway Sweden Australia China Japan Korea Singapore Taiwan Chile Russia US Networks: vBNS, vBNS+, Abilene, ESnet, DREN, NREN/NISN www.startap.net

3. Introduction to Euro-Link • Cooperative Agreement ANI-9730202 to University of Illinois at Chicago • To develop with European National Research Networks (NRNs) a US-European Network Consortium (Euro-Link) to provide US research institutions with high-performance access to outstanding R&E institutions in the European region connected by the European NRNs’ infrastructures.

4. Euro-Link $2.2M Annual Budget • ~ 80% of funds go to cost-sharing the networks • $1.6M Direct payments) to 5 NRNs • $270K Ameritech AADS Local loops • No UIC overhead • ~20% of funds go to staff • Overhead pays for part of business manager • Euro-Link funds cover ~ 25% of the cost of international links

5. Euro-Link Management • Tom DeFanti • Planning and Execution • Budget • Maxine Brown • Management and Documentation • Events • Jason Leigh, Andy Johnson, Dan Sandin • Visualization/Performance Analysis Tools • Linda Winkler, Alan Verlo • Network Engineering

6. Euro-Link Technical Partners • Tony Haeuser, AADS • Michael McRobbie and Jim Williams, Euro-Link NOC, Indiana University • Joe Mambretti, iCAIR and MREN • Manuel Delfino and Olivier Martin, CERN • Ralphi Rom and Hank Nussbacher, IUCC • Peter Villemoes, NORDUnet • Dany Vandromme, RENATER2 • Kees Neggers, SURFnet

7. Euro-Link US Partners • HPIIS Team (IU, UIC, UTK) • Ameritech Advanced Data Services (AADS) NAP • STAR TAP • Indiana University • Argonne National Laboratory/ESnet • vBNS • Abilene/Internet2 • MREN and International Center for Advanced Internet Research (iCAIR) at Northwestern University • NISN/NREN • DREN

8. Euro-Link Statement of Work • To create and maintain a high-performance connection between the vBNS and European NRNs via STAR TAP • To ensure that only approved institutions’ traffic uses the high-performance connection • To monitor Euro-Link performance and use • To develop testbeds of new networking protocols (IPv6, multicast, cache, etc.) • To maintain a Euro-Link web site • To provide user services in support of applications

9. Euro-Link Statement of Work #1: Connections • To create and maintain a high-performance connection between the vBNS and European NRNs via STAR TAP • Provide high-performance circuits connecting European NRNs to NGI networks via STAR TAP • Implement and manage a Level 3 service • Provide a coordinated NOC, NIC and user services on a 24 x 7 basis

10. Euro-Link Statement of WorkConnections: CERN Star Tap 155Mb/s

11. Euro-Link Statement of WorkConnections: Israel

12. Euro-Link Statement of WorkConnections: Nordic Countries 155Mb

13. Euro-Link Statement of WorkConnections: France

14. Euro-Link Statement of WorkConnections: The Netherlands 622Mb SURFnet

15. Euro-Link Statement of WorkConnections: Level 2 and Level 3 • Once connected to STAR TAP, the NRNs, in addition to connecting to the vBNS, can peer with other US NGI networks, the Internet2, and advanced networks from other countries. • NRNs can peer using the STAR TAP Router or by bilateral agreement. • They may also connect to one or more ISPs at the AADS facility, which is outside the scope of Euro-Link, but a useful capability nonetheless.

16. Euro-Link Statement of WorkConnections: Level 2 and Level 3 Note: European peering is either direct or via TEN-155.

17. Euro-Link NOC • http://noc.euro-link.org • HPIIS (Euro-Link, TransPAC, MIRnet) helps support the Global Research NOC staff, network engineers and applications engineers Jim Williams will present the Global NOC.

18. Euro-Link Statement of Work #2: Ensuring High Performance Traffic • To ensure, to the extent supportable by prudent application of networking technology, that only approved institutions’ traffic uses the high-performance connection • Implement routing and switching configurations consistent with AUPs of European NRNs and vBNS • Update routing and switching hardware and software as new capabilities for implementing routing policies become available • Document AUP traffic segregation measures and procedures on Euro-Link web site

19. Euro-Link Statement of WorkEnsuring High Performance Traffic • Compliance with NSF vBNS AUP documented in Euro-Link annual report at http://www.euro-link.org/PUBLICATIONS/ • Most of the NRNs have a policy to connect all the universities in their countries without discrimination as to research need; however, to comply with the NSF AUP, they segregate traffic either at home or on the US East Coast prior to connecting to STAR TAP

20. Euro-Link Statement of Work #3: Monitoring Performance and Use • To monitor Euro-Link performance and use • Monitor traffic parameters to manage the utilization of Euro-Link networks and assure high-performance quality • Develop a new generation of performance and analysis tools. Adopt and adapt emerging network performance monitoring technologies and develop advanced visualization, persistent databases and visualization/VR techniques to create new applications-oriented performance measuring tools for HPIIS

21. Euro-Link Statement of WorkMonitoring Performance and Use • CERN provides its own Internet traffic statistics: http://sunstats.cern.ch/mrtg • Performance monitoring – CERN hosts three Internet probes (Surveyor, RIPE and NIMI) and is also part of the Internet End-to-end Performance Monitoring (IEPM) PINGER project, supported by DOE MICS through the Stanford Linear Accelerator Center • CERN has plans to install Netlogger and to study alternatives to TCP-based file transfer in order to reduce problems linked to error recovery on high-bandwidth delay paths

22. Euro-Link Statement of WorkMonitoring Performance and Use • IUCC statistical information about all its connections (Home page): http://www.internet-2.org.il/stats.html • IUCC FastEthernet1/0 traffic analysis: http://noc.ilan.net.il/stats/TAU-GIGAPOP/tau-gp1-fe-i2.ilan.net.il.html • STAR TAP IUCC peering statistics: http://noc.ilan.net.il/stats/ILAN-I2-uplinks/peers.html • IUCC has, in addition, installed an NLANR passive monitor: http://moat.nlanr.net/Datacube/Data/TAU/

23. Euro-Link Statement of WorkMonitoring Performance and Use • NORDUnet NOC operations are carried out at KTH in Stockholm and by the national Nordic networks • NORDUnet participates in the ANS Surveyor measurement infrastructure with UNINETT, operating a measurement station at the University of Oslo

24. Euro-Link Statement of WorkMonitoring Performance and Use • RENATER2 does not presently have a web page regarding STAR TAP traffic. Hopefully this will change at some time this year, once the current call for tenders is completed. A higher transatlantic link, along with associated services, will improve performance.

25. Euro-Link Statement of WorkMonitoring Performance and Use • STAR TAP SURFnet traffic monitoring: http://www.surfnet.nl/surfnet/persons/bos/startap-traffic/ • SURFnet monitors traffic on its STAR TAP connection, as it does on all its connections (external connections, backbone links, and customer links). Results are put on the web using MRTG or RRDTool. This information is typically protected by userid/passwds and access-lists

26. Euro-Link Statement of WorkMonitoring Performance and Use • EVL visualization network performance analysis tools: Motivation • QoSIMoTo (QoS Internet Monitoring Tool) visualizes historic as well as real-time Netlogger data consisting of bandwidth, latency and jitter: www.evl.uic.edu/cavern/qosimoto • Forward Error Correction schemes, both parity-based and XOR-based, are being developed as an alternative to TCP for transmitting real-time data, which has substantial latency over international links. Jason Leigh will discuss this research this afternoon

27. Euro-Link Statement of Work #4: Engineering Advancements • Cooperate with vBNS and NLANR to develop testbeds of new networking protocols (IPv6, multicast and Mbone, resource reservation, cache services, etc.)

28. Euro-Link Statement of WorkEngineering Advancements • CERN participates in the Internet2 Distributed Storage Initiative • IPv6 (with Lawrence Berkeley Lab via 6TAP) • Exploring DiffServ to deliver the required grade of service to its users (with iCAIR and EVL using STAR TAP DiffServ Router) • Working with Brian Carpenter, IBM/iCAIR, on the Virtual Room Video-conferencing System (VRVS) DiffServtestbed http://vrvs.cern.ch/About/VRVS_Paper.pdf • High-speed file transfer with Caltech/SLAC/Fermilab

29. Euro-Link Statement of WorkEngineering Advancements • IUCC is benchmarking and testing solutions that can negate the influence of large satellite delays that influence TCP throughput; results of testing two products at the Intelsat lab in Washington DC: www.internet-2.org.il/satellite-testing.html • IUCC installed Mentat XH45 boxes in Israel and its co-location site in Chicago and found instances of a 160-fold performance increase for TCP streams. (NASA also tested the Mentat boxes; they help with both high-latency and low-latency (70 ms) links, which is applicable to the US’s high-performance networks. www.mentat.com/skyx/xh45.html • Previously IUCC worked with researchers to TCP tune their systems, but this is not scalable: www.psc.edu/networking/perf_tune.html

30. Euro-Link Statement of WorkEngineering Advancements • NORDUnet has set up native multicast connectivity with most of the STAR TAP-connected networks

31. Euro-Link Statement of WorkEngineering Advancements • RENATER2 is increasing available transatlantic bandwidth. A call for tender is in progress. The transatlantic capacity should be increased above 622 Mbps, including an OC-3 path to STAR TAP. • Experiments with QoS services, aiming at a more efficient (in terms of performance and of bandwidth allocation and usage) use of the costly transatlantic infrastructure, and make them operational as soon as possible. • Experiment with IPv6 as part of the 6Bone activity. • Experiment with end-to-end (campus to campus) QoS services

32. Euro-Link Statement of WorkEngineering Advancements • EVL is collaborating with SARA in The Netherlands on network performance tests • SURFnet is cooperatively planning with CA*net3/4 to bring 2.5Gb to STAR TAP as part of the I-WIRE/ Star Light effort

33. Euro-Link Statement of WorkEngineering Advancements Euro-Link/ STAR TAP • A policy-free IPv4 router enabling STAR TAP-connected networks to exchange routes and traffic with other STAR TAP-connected networks with whom they do not peer directly • IPv6 efforts with ESnet • Web caching with NLANR and the Internet2 Distributed Storage Working Group • Performance measuring using the NLANR Active Measurement Platform (AMP) instrument • DiffServ experiments with the DOE NGI-supported EMERGE testbed • Unicast/multicast digital video QoS efforts with iCAIR at Northwestern University • QBone QoS efforts with Internet2 and iCAIR

34. Euro-Link Statement of Work #5: Web Site • To maintain a publicly-accessible Euro-Link web site about the European NRNs connections and research and education collaborations that enables: • Up-to-date international collaboration information, points of contact, engineering links, documentation and mailing lists • Up-to-date statistical information about the performance of the Euro-Link international connection • Documented Euro-Link success stories, through up-to-date proposals, detailed technical requirements and results

35. Euro-Link Statement of WorkWeb Site www.euro-link.org

36. Euro-Link Statement of Work #6: User Services • In concert with the methodologies developed by NLANR DAST, provide consultative user services supporting the use of Euro-Link for high-performance computing and communications applications • Projects • Applications clearinghouse • Software tools • Training events • Presentations

37. Euro-Link Statement of WorkUser Services • Projects: iGrid2000, etc: www.startap.net/igrid2000 • Applications: www.euro-link.org/APPLICATIONS • Euro-Link annual meetings with HPIIS Team and STAR TAP at INET 1998, 1999, 2000… • Software tools: CAVERNsoft, QoSIMoto • Training sessions • Telecomm 2000, Israel, November 2000 • Eurographics’ Workshop on Virtual Environments held in Amsterdam in June, 2000 • Presentations • 19th Nordic Networking Conference, organized by NORDUnet, held at Finlandia Hall, Helsinki, Finland in September, 2000 • PDC Conference, Center for Parallel ComputersRoyal Institute of TechnologyStockholm, Sweden, Dec 1999

38. Euro-Link Statement of WorkUser Services European participation/collaborations at iGrid 2000 Scenes from iGrid 2000: http://www.startap.net/igrid2000

39. Scientific ApplicationsCERN Networked experiments of the European Laboratory for Particle Physics (CERN) CERN provides experimental facilities for particle physics experiments, mainly in the domain of high-energy physics. Four very large experiments in man-made caverns intersect the LEP tunnel, constituting about half of CERN’s total experimental program for the 1990’s. 50 participating institutions, several hundred physicists, in five continents. CERN’s Large Electron Positron (LEP) collider, in a 27km tunnel – the largest machine of this type in the world http://www.cern.ch

40. Scientific ApplicationsCERN The Globally Interconnected Object Databases (GIOD) Project The Compact Muon Solenoid (CMS) detector will cleanly detect the diverse signatures of new physics at the Large Hadron Collider (LHC), due to be operational in 2005. It will identify and precisely measure muons, electrons and photons over a large energy range. The data is overwhelming. Even though the data from the CERN CMS detector will be reduced by a factor >107, it will amount to over a Petabyte (1015 bytes) of data per year accumulated for scientific analysis. Caltech, CERN, Hewlett Packard, others Particle physicists are engaged in large international projects to address a massive data challenge, with special emphasis on distributed data access. http://pcbunn.cithep.caltech.edu

41. Scientific ApplicationsCERN MONARC Project LHC experiments have envisaged Computing Models (CM) involving hundreds of physicists doing analysis at institutions around the world. Regional Centers are intended to facilitate access to the data; with more efficient and cost-effective data delivery to the groups in each world region, using high-speed national networks. This project intends to study network-distributed computing architectures, data access and data management systems that are major components of the CM, and the ways in which the components interact across networks. MONARC (Models of Networked Analysis at Regional Centers) will be created for data analysis from the Large Hadron Collider LHC experiments http://www.cern.ch/MONARC/

42. Scientific ApplicationsCERN @ iGrid 2000 Distributed Particle Physics Research • California Institute of Technology, USA, USA • CERN This application demonstrates remote viewing and analysis of particle physics events. The application is the front end to an engineered object-oriented global system that incorporates grid middleware for authentication and resource discovery, a distributed object database containing several terabytes of simulated events, and a component that enables queries issued by the front-end application to be matched to available computing resources in the system (matchmaking service). http://pcbunn.cacr.caltech.edu http://iguana.web.cern.ch/iguana/ http://vrvs.cern.ch http://cmsdoc.cern.ch/orca

43. Scientific ApplicationsIsrael Interactive Simulation in the Field of Plant Nutrition This US-Israel Bi-national Agricultural Research and Development (BARD) Foundation project involves hypotheses testing and result evaluation, using an interactive graphic model. SimRoot, a 3D model developed at Penn State, graphically describes the deployment of plant root systems in soil – and predicts the performance of plants under various environmental conditions, depending on their physiological characteristics. Tel Aviv University and Penn State University

44. Scientific ApplicationsIsrael Visualization of Acetylcholinesterase: Nature's Vacuum Cleaner Acetylcholinesterase (AcChoEase) is an enzyme that plays a key role in the human nervous system. In vertebrates, nerve impulses travel from cell to cell by means of chemical messenger. When an electrical impulse reaches the end of one cell, messenger molecules – acetylcholine (AcCho), in this case – are released to diffuse though the fluid-filled, intercellular, synaptic gap. Upon reaching the destination cell, the AcCho molecules dock into special receptors triggering a new electrical impulse. Much like a vacuum cleaner, the enzyme AcChoEase is constantly sweeping up and hydrolyzing AcCho during this process, so that the whole cycle can begin again. Chemicals that inhibit the action of AcChoEase are being used in the treatment of glaucoma, myasthenia gravis and, experimentally, Alzheimer's disease. In spite of the ability to exploit the enzyme, its precise mechanism of operation is still a mystery. Cornell University, USA; Weizmann Institute of Science, Israel

45. Scientific ApplicationsIsrael Visualization of Acetylcholinesterase: Nature's Vacuum Cleaner Acetylcholinesterase (AcChoEase) is an enzyme that plays a key role in the human nervous system. In vertebrates, nerve impulses travel from cell to cell by means of chemical messenger. When an electrical impulse reaches the end of one cell, messenger molecules – acetylcholine (AcCho), in this case – are released to diffuse though the fluid-filled, intercellular, synaptic gap. Upon reaching the destination cell, the AcCho molecules dock into special receptors triggering a new electrical impulse. Much like a vacuum cleaner, the enzyme AcChoEase is constantly sweeping up and hydrolyzing AcCho during this process, so that the whole cycle can begin again. Chemicals that inhibit the action of AcChoEase are being used in the treatment of glaucoma, myasthenia gravis and, experimentally, Alzheimer's disease. In spite of the ability to exploit the enzyme, its precise mechanism of operation is still a mystery. Cornell University, USA; Weizmann Institute of Science, Israel

46. Scientific ApplicationsNordic Countries European Incoherent SCATter (EISCAT) EISCAT studies the interaction between the Sun and the Earth as revealed by disturbances in the magnetosphere and the ionized parts of the atmosphere (these interactions also give rise to the spectacular aurora, or Northern Lights). The Incoherent Scatter Radar technique requires sophisticated technology and EISCAT engineers are constantly involved in upgrading the systems. The EISCAT Scientific Association operates radars and receivers in several Nordic cities. Several Incoherent Scatter facilities are distributed about the world, such as Millstone Hill Observatory (MHO), in Westford, Massachusetts. http://www.eiscat.uit.no/

47. Scientific ApplicationsSweden @ iGrid 2000 Steering and Visualization of aFinite-Difference Code on a Computational Grid • Royal Institute of Technology, Sweden • University of Houston, USA This application enables computational steering of electromagnetic simulations across distributed resources using interactive visualization in a virtual-reality environment. www.nada.kth.se/~erike/progress

48. Scientific ApplicationsFrance The DØ Experiment is a worldwide collaboration of scientists conducting research on the fundamental nature of matter. The experiment is located at the world's premier high-energy accelerator, the Tevatron Collider, at the Fermi National Accelerator Laboratory. Worldwide collaborations include Fermilab, Brookhaven National Lab; CERN; Cornell University; DESY, Germany; KEK, Japan; Lawrence Berkeley Lab and Stanford Linear Accelerator Center; several French institutions (DAPNIA/SPP, Centre de Physique des Particules de Marseille, Institut des Sciences Nucleaires de Grenoble, LPNHE, Universites Paris VI and VII, and Laboratoire de L’Accelerateur Lineaire. http://www-d0.fnal.gov http://www-dapnia.cea.fr

49. Scientific ApplicationsFrance iMAGIS—Models, Algorithms, Geometry for Graphics and Image Synthesis The project develops new visualization techniques to enable the interactive manipulation of urban data. To achieve this goal, efficient image caching and interpolation techniques are being combined with traditional 3D techniques. This is important for applications such as project review, civil and military simulators, virtual tourism, and education, climate and environmental studies. Participants: INRIA (Grenoble), MIT http://www.inria.fr/Equipes/IMAGIS-fra.html

50. Scientific ApplicationsFrance Sloan Digital Sky Survey The SDSS enables the automatic, systematic study and exchange of data of stars, galaxies, nebula, and large-scale structure. Participants: Institut d’ Astrophysique de Paris, Johns Hopkins University, CFHT Corp. (Hawaii); University of Hawaii Institute for Astronomy, Honolulu. http://www.sdss.org/sdss.html