network connectivity and projects a perspective from the uk richard hughes jones ppncg
Download
Skip this Video
Download Presentation
Network Connectivity and Projects – a Perspective from the UK Richard Hughes-Jones PPNCG

Loading in 2 Seconds...

play fullscreen
1 / 30

Network Connectivity and Projects – a Perspective from the UK Richard Hughes-Jones PPNCG - PowerPoint PPT Presentation


  • 79 Views
  • Uploaded on

Network Connectivity and Projects – a Perspective from the UK Richard Hughes-Jones PPNCG. SuperJANET4 Status Connectivity to Europe Connectivity to the US Grid Networking Projects. SuperJANET4: Backbone and Access links. Worldcom supplied the transmission UKERNA layer the IP service

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Network Connectivity and Projects – a Perspective from the UK Richard Hughes-Jones PPNCG' - yair


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
network connectivity and projects a perspective from the uk richard hughes jones ppncg

Network Connectivity and Projects – a Perspective from the UKRichard Hughes-Jones PPNCG

SuperJANET4 Status

Connectivity to Europe

Connectivity to the US

Grid Networking Projects

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

superjanet4 backbone and access links
SuperJANET4: Backbone and Access links
  • Worldcom supplied the transmission
  • UKERNA layer the IP service
    • Core PoP IP router at Worldcom
    • Backbone Access Router at MANs
  • Access Links:
    • Large MAN 2.5 Gbit -> 10-20 Gbit
    • Medium MAN 622 Mbit -> 2.5 Gbit
  • 4 node DWDM development net
  • Deployment Status:
    • Backbone Oct 00 Routers Nov 00
    • All sites Mar 01
    • Proved to be Stable
    • Constant growth of traffic

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

slide3

SuperJANET4: ping rtt Core routers

Jun 01

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

slide4

SuperJANET4: ping rtt Core routers

Glasgow

Lancaster

MAN / LAN Issues

Bristol

Cambridge

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

slide5

London MAN Upgrade

UDP Packet loss

%

UDPmon Tests

Manchester – London

MAN was 155 Mbit ATM

UDP Throughput

Mbit/s

1st Oct Time interval in Weeks

Richard HJ

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

slide6

Connectivity to Europe – Access links (1)

ICFAMON Plot from RAL to CERN for 19th Oct to 1st Nov 2001

  • UK Access link 155 Mbit ATM
  • Sustained rate 130 Mbit
  • Contract to end of Nov 01
  • Bad news for users !

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

slide7

Connectivity to Europe – Access links (2)

Traceping Oxford to CERN for 31st October 2001

loss around

ten155-gw.ja.net router

J. Macallister

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

slide8

Connectivity to Europe : Geant

  • Start mid November 2001
  • UKERNA switched off TEN-155 3 Dec 2001
  • Monitoring – see later

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

slide9

Connectivity to US

  • 6 * 155 Mbit links
  • US link about to go to 2.5 G bit
  • IP commodity attached in London
  • Research traffic over 2.5G bit
  • Peer in Hudson St.
  • 622 Mbit to Esnet
  • 622 Mbit to Abilene.

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

monitoring us traffic
Monitoring: US Traffic

UKERNA Traffic data Kbit/s. Blue Traffic from US; Maroon Traffic to US

17 Jul 2000 (300kbit/s) 7 Dec 2001 (900kbit/s)

peak is 88% of total BW 930 Mbit

10 minute averages10 minute averages

Last 7 days 1 hour averagesLast 7 days1 hour averages

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

monitoring us traffic trends jan 99 nov 02
Monitoring: US Traffic - TrendsJan 99 – Nov 02

UKERNA – US Traffic Daily totals Mbytes

Peak load ~88 %

Weekday

Weekend

J. Macallister

Xmas 99

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

Xmas 01

grid network projects
Grid Network Projects
  • DataGrid
  • GridPP
    • Extending DataGrid to BaBar, D0, CDF,… in UK
  • DataTAG
    • Foci: Network resarch, Grid inter-operability
  • MB-NG
    • UK funded 2.5Gbit Development Network
  • Optical Switching

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

network monitoring
NetworkMonitoring
  • Several tools in test – plugged into a coherent structure:
    • PingER, RIPE one way times,iperf, UDPmon, rTPL, GridFTP, and NWS prediction engine
  • continuous tests for last few months to selected sites:
    • DL Man RL UCL CERN Lyon Bologna SARA NBI SLAC …
  • The aims of monitoring for the Grid:
    • to inform Grid applications, via the middleware, of the current status of the network – input for resource broker and scheduling
    • to identifyfault conditions in the operation of the Grid
    • to understand the instantaneous, day-to-day, and month-by-month behaviour of the network – provide advice on configuration etc.
  • Report written on LDAP scheme for publishing the network information
  • Will be used by UK e-science sites and non HEP WPs

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

udpmon measuring throughput with udp

Zero stats

OK done

Send data frames at

regular intervals

Inter-packet time

●●●

●●●

Time to receive

Time to send

Get remote statistics

Send statistics

UDPmon Measuring Throughput with UDP
  • Send a burst of UDP frames spaced at regular intervals
  • Vary the frame size and the frame transmit spacing
  • Record
    • The time to send and the time to receive the frames
    • The number received, the number lost, number out of order
    • The received inter-packet spacing

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

slide15

Network Monitoring Architecture

LDAP

Schema

Grid Apps

GridFTP

Backend LDAP script to fetch metrics

Monitor process to push metrics

PingER

(RIPE TTB)

IperfER

UDPmon

rTPL

NWS

etc

Local Network

Monitoring

Store & Analysis

of Data (Access)

local

LDAP

Server

Grid Application access via

LDAP Schema to

- monitoring metrics;

- location of monitoring data.

Access to current and historic data

and metrics via the Web, i.e. WP7

NM Pages, access to metric forecasts

Robin Tasker

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

slide16

LDAP

LDAP

LDAP

Table

Table

Table

plot

plot

plot

raw

raw

raw

Network Monitoring Components

Clients

WEB Display

Predictions

Grid Broker

Analysis

LDAP

LDAP

Web I/f

raw

raw

Scheduler

control

control

Cron

script

Cron

script

Cron

script

Tool

Ping

Netmon

UDPmon

iPerf

Ripe

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

ping udp throughput man ral from 20 oct 01
Ping & UDP throughput MAN-RAL From 20 Oct 01

PingER rtt (ms)

dl – RAL

1000 byte packet

Forecast

UDPmon Zero packet loss!

UDPmon throughput Mbit/s

man – RAL

300 * 1400 byte frames

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

ping udp throughput man cern from 20 oct 01
Ping & UDP throughput MAN-CERNFrom 20 Oct 01

PingER rtt (ms)

dl – cern

1000 byte packet

Forecast

UDPmon throughput Mbit/s

man – cern

300 * 1400 byte frames

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

iperf udp throughput man cern from 20 oct 01
iperf & UDP throughput MAN-CERN From 20 Oct 01

Iperf throughput

ucl – cern

262144 byte buffer

Forecast

UDPmon throughput Mbit/s

man – cern

300 * 1400 byte frames

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

iperf udp throughput man sara from 20 oct 01
iperf & UDP throughput MAN-SARA From 20 Oct 01

Iperf throughput

ucl – sara

262144 byte buffer

Forecast

UDPmon throughput Mbit/s

man – sara

300 * 1400 byte frames

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

iperf pinger uk bologna from 20 oct 01
iperf & Pinger UK-Bologna From 20 Oct 01

Iperf throughput

ucl – Bologna

262144 byte buffer

Forecast in green

PingER rtt (ms)

dl – Bologna

1000 byte packet

Forecast

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

iperf throughput ucl sara from 1 nov 01 geant operational
iperf throughput UCL-SARA From 1 Nov 01 – Geant Operational

Iperf throughput

ucl – sara

262144 byte buffer

Geant Enabled

Routing Stable

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

brief outline of work plan
Brief outline of work plan
  • High Performance High Throughput:
    • Understanding the end system HW,
    • best way to monitor traffic and protocol packets,
    • Type and effect of background traffic,
    • Throughput vs rtt, throughput vs window-size,
    • Throughput using multiple TCP streams, and effect on the Network
    • GridFTP and BBftp at Gigabit,
    • Effect of different TCP stacks,
    • Use of non-TCP protocols, and effect on the Network
    • Show and tell demos
  • Bandwidth Reservation and QoS
    • Identification of traffic classes and middleware components requiring QoS
    • Study of traffic differentiation and traffic engineering techniques
    • demonstration of QoS & Bandwith Reservation

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

the eu datatag project
The EU DataTAG project
  • EU Transatlantic Gigabit project.
  • Status: approved for 4 M ECU start on 1 Dec 2001
  • Partners: CERN/PPARC/INFN/UvA. IN2P3 sub-contractor
  • The main foci are:
  • Grid Network Research including:
    • Provisioning (CERN)
    • Investigations of high performance data transport (PPARC)
    • End-to-end inter-domain QoS + BW / network resource reservation
    • Bulk data transfer and monitoring (UvA)
  • Interoperability between Grids in Europe and the US
    • PPDG, GriPhyN, DTF, iVDGL (USA)

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

slide25

UK

SuperJANET4

GEANT

2.5 Gbit lambda between CERN and Starlight

POS 2nd half 2002 – WDM later

DataTAG project

NL

SURFnet

MREN

STAR-LIGHT

STAR-TAP

CERN

ESNET

NewYork

IT

GARR-B

Abilene

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

Olivier Martin

slide26

GSR

GSR

GSR

GSR

GSR

Optical Switching - DataTAG

2.5 Gbps SDH “Lambda”

100/1000 Mbps Ethernet

UK

Iwire

Abilene

ESnet

Amsterdam

StarLight

Italy

Application

7600

λ Broker

CERN

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

mb ng superjanet testbed

MCC

Manc

MB - NG

UCL

ULCC

MB – NG SuperJANET Testbed

Leeds

SJ4 Dev

C-PoP

Warrington

SuperJANET4

Production

Network

Gigabit Ethernet

2.5 Gbit POS

10 Gbit POS

SJ4 Dev

C-PoP

Reading

SJ4 Dev

C-PoP

London

RAL /

UKERNA

RAL /

UKERNA

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

e science core project

MB - NG

E-science core project
  • Project to investigate and pilot:
    • end-to-end traffic engineering and management over multiple administrative domains – MPLS in core diffserv at the edges.
    • Managed bandwidth and Quality-of-Service provision. (Robin Tasker)
    • High performance high bandwidth data transfers. (Richard HJ)
    • Demonstrate end-to-end network services to CERN using Dante EU-DataGrid and the US DataTAG.
  • Status: approved with requested funds start on 1 Dec 2001
  • Partners:CISCO, CLRC, Manchester, UCL, UKERNA plus Lancaster and Southampton (IPv6)
  • A technical meeting held – draft spec. of the HW required
  • Would like to use real Grid traffic – as demonstrator:
    • CDF UCL-RAL
    • BaBar Man-RAL

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

and finally in case it helps
And Finally in case it helps:
  • GridPP and DataGrid have been working on packaging Globus v2 as a .rpm kit.
  • Makes installation simpler.
  • Available from DataGrid WP6 web:
  • marianne.in2p3.fr/datagrid/testbed1/globus

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

conclusion status
Conclusion & Status
  • SuperJANET4 stable working well
  • Access links to Campus becoming very inportant
  • Network Links and peering to US good overall
  • US-UK bandwidth upgrade overdue
  • Geant access to Europe OK (at the moment !)
  • Considerable UK interest in the Internet2 tests
  • Grid: Lots of interesting work to do …

ICFA SCIC Meeting CERN Dec 01

R. Hughes-Jones Manchester

ad