1 / 20

GNET-1:Gigabit Ethernet Network Testbed

GNET-1:Gigabit Ethernet Network Testbed. Y. Kodama, T. Kudoh, R. Takano, H. Sato, O. Tatebe , S. Sekiguchi Grid Technology Research Center National Institute of Advanced Industrial Science and Technology (AIST). Outline. About GNET-1 Aims of GNET-1 Hardware components of GNET-1

clemens
Download Presentation

GNET-1:Gigabit Ethernet Network Testbed

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. GNET-1:Gigabit EthernetNetwork Testbed Y. Kodama, T. Kudoh, R. Takano, H. Sato, O. Tatebe, S. Sekiguchi Grid Technology Research Center National Institute of Advanced Industrial Science and Technology (AIST)

  2. Outline • About GNET-1 • Aims of GNET-1 • Hardware components of GNET-1 • Usages of GNET-1 • Comparison with NIST Net • Emulation of a network with bit error • Measurement of precise one-way delay/jitter • Smooth traffic shaping • Conclusion and Future Plans CLUSTER 2004

  3. Aims of GNET-1 • A network emulator is required for developing grid middleware. • Reproducible environment to verify the performance • Changing parameters • Latency, bandwidth, bit error rate, buffer size, buffer control … • More accuracy and performance • Software-based emulators are not enough. • Flexibility for adding functions with keeping the performance • Required functions are depend on the situations GNET-1: a hardware emulator based on a FPGA CLUSTER 2004

  4. The Look of GNET-1 GNET-1 GNET-1 Control SNMP Agent Width:19inch, Height:1U(1.7inch) GBIC: 4 ports USB CLUSTER 2004

  5. Block Diagram of GNET-1 via GBIC I/F CLUSTER 2004

  6. ＧＮＥＴ－１ ＧＮＥＴ－１ ＧＮＥＴ－１ ＧＮＥＴ－１ ＧＮＥＴ－１ Usage of GNET-1 • Emulation • Changing a delay, bit error rate, output bandwidth, buffer size, buffer control, etc. • Measurement • Precise network statistics • input/output bandwidth in every 100 microsecond. • Synchronize the local clock using GPS. • New Protocol prototyping • Proposing protocol in feasibility study. Internet CLUSTER 2004

  7. Outline • About GNET-1 • Aims of GNET-1 • Hardware components of GNET-1 • Usages of GNET-1 • Comparison with NIST Net • Emulation of a network with bit error • Measurement of precise one-way delay/jitter • Smooth traffic shaping • Conclusion and Future Plans CLUSTER 2004

  8. Comparison with NIST Net --- latency --- • NIST Net: average differences and variances were almost 100 us. • In GNET-1, they were almost zero. NIST Net version 2.0.11 using 2-way SMP of Xeon 2.4 GHz with three INTEL/PRO 1000 NICs on Red Hat 9.0 CLUSTER 2004

  9. Comparison with NIST NET --- throughput --- NIST Net: throughputs with delays were about 100Mbps decreased from throughput with no delay. GNET-1: throughputs in all cases were the wire-rate speed. These results show that GNET-1 can emulate networks with accurate latency and high throughput. CLUSTER 2004

  10. Emulation of a network with bit error ＧＮＥＴ－１ • Insert delay (50ms), • Generate random bit error (1.0x10-10), • Measurement bandwidth(100ms) GNET-1 is usefull for new protocol development and evaluations. CLUSTER 2004

  11. 1. Clock synchronized with GPS 2. Send packets with send time (MTU:1500) 1 1 3. Receive packets and forward them with receive time (MTU:64) 3 2 4 4. Capture packet, then calculate latency and jitter offline. Measurement of precise one-way latency (experiment environment) GPS Internet ＧＮＥＴ－１ ＧＮＥＴ－１ Sending time Sending time and Receiving time 40Mbps Capture for 1Gbps stream CLUSTER 2004

  12. Measurement of precise one-way latency (measured network) SC03(PHOENIX) GNET-1 SuperSINET(via NewYork) 1G 1G APAN/TransPAC(via LA) GNET-1 AIST(JAPAN) CLUSTER 2004

  13. Measurement of precise one-way latency (result) Measured jitter of latency will be introduced in GNET-1. CLUSTER 2004

  14. Peak 1Gbps RTT RTT RTT > 2.4 Gbps Smooth traffic shaping (problem) • Why traffic on Long Fat Pipe is not stable ? But sometimes packets are lost ! 500Mbps Stream A 500Mbps Stream B 1.5Gbps < 2.4Gbps 500Mbps Stream C LongFatPipe 2.4Gbps TCP has software pacing by self clocking of ACK packet, but it is not always effective. CLUSTER 2004

  15. Smooth traffic shaping (function) • GNET-1 has hardware pacing by adjusting IFG (Inter Frame Gap) • GNET-1 can set IFG by the value adapted to the frame length, as well as it can set it to a fixed value. 1Gbps 500Mbps GNET-1 0Mbps IFG = Frame Len. CLUSTER 2004

  16. Peak 1Gbps RTT RTT RTT Smooth traffic shaping (will be solved) • Traffic on Long Fat Pipe become stable. GNET-1 500Mbps Stream A < 2.4Gbps GNET-1 500Mbps Stream B 1.5Gbps GNET-1 500Mbps Stream C LongFatPipe CLUSTER 2004

  17. Smooth traffic shaping (experiment) Bandwidth Challenge in SC'03 Trans-Pacific Gfarm Datafarm testbed 147 nodes 16 TBytes 4 GB/s SuperSINET Indiana Univ Titech Trans-Pacific thoretical peak 3.9 Gbps Gfarm disk capacity 70 TBytes disk read/write 13 GB/sec SuperSINET NII 2.4G 10 nodes 1 TBytes 0.3 GB/s Abilene Univ Tsukuba NY 2.4G(1G) SC2003 Phoenix KEK 7 nodes 4 TBytes 0.2 GB/s OC-12 ATM 32 nodes 23 TBytes 2 GB/s 500M Chicago Tsukuba WAN APAN Tokyo XP Maffin 16 nodes 12 TBytes 1 GB/s AIST LA 2.4G 16 nodes 12 TBytes 1 GB/s APAN/TransPAC SDSC CLUSTER 2004

  18. Smooth traffic shaping (results of BWC03) 950 Mbps in NY (+20) 500 Mbps in Chicago 800 Mbps in LA3 750 Mbps in LA2 780 Mbps in LA1 (-20) 930 Mbps in NY 500 Mbps in Chicago 800 Mbps in LA3 750 Mbps in LA2 800 Mbps in LA1 • Achieved stable 3.78Gbps Disk to Disk data transfer on 3.9 Gbps,144ms long-fat network. • Currently the shaping bandwidth is defined by user, we will make automatic tuning facility. CLUSTER 2004

  19. Conclusion and Future Plan • GNET-1 is a useful tool for developing network-aware software. • Other functions • SNMP agent for GNET-1 • Emulation • tail-drop, RED, credit-base bandwidth control • Frame capture, etc. • Refer to http://www.gtrc.aist.go.jp/gnet/ about details of GNET-1. • Developing a new tool for 10GbE CLUSTER 2004

  20. Photograph of GNET-10 19 inch rack mountable 2U height FPGA:XC2VP75 x 2 Memory: 1GByte x 2 10GbE: LR 2 ports 1GbE: GBIC 2ports CLUSTER 2004

More Related