June 1999 canarie canet3

1. “Canada’s National Optical Internet” June 1999 www.canarie.ca www.canet3.net Bernard Turcotte Director Special projects TURCOTTE@canarie.ca

2. Background: Yesterday • Telcos: What is the Internet anyway? • If you want a real network use X.25! • You will never need anything faster that DS3! • Commercial institutions will NEVER use the Internet because it can NEVER be secure. • Home users will NEVER be able to understand IP

3. Background: Today • World’s largest bookstore is Amazon.com • Most major banks offer Internet based services • Major retailers all offer Internet based shopping • Transmission speed limitations are starting to fade • Basic Internet usage is thought in grade school • Telework is becoming a reality

4. Background: Tomorrow • IP telephony will be common and will fundamentally alter the business model for carriers • MP3 is becoming a defacto standard for music and will fundamentally alter the business model for recording and distribution houses. • MPEG2 is the standard for digital video and will fundamentally alter the business model for the film, video, television, cable and satellite industries • Telework, telelearning and telehealth will become commonplace.

5. CANARIE Inc • Mission: To facilitate the development of Canada’s communications infrastructure and stimulate next generation products, applications and services • Canadian equivalent to Internet 2 and NGI • private-sector led, not-for-profit consortium • consortium formed 1993 • federal funding of $104.5 M (1993-99) • total project costs estimated over $500 M • currently over 140 members; 21 Board members • Phase III funding to be announced 1998-2001 • $55 million announced for Optical Internet -March 1998

6. CA*net 2 Network CA*net II 2xOC3 GigaPOP RAN WURCnet MRnet SRnet ACORN OC12 DS3 OC3 St. John’s Calgary Regina Winnipeg RISQ Charlottetown BCnet OC48 Fredericton ONet Montreal DS3 OC3 Ottawa Vancouver Halifax OC3 to Europe OC12 - OC3 Toronto T3 + OC3 to US Windsor

7. ARDNOC • to provide traditional NOC as well as advanced network services support to the CA*net II/3 user (R&E) community. • to facilitate and coordinate development, testing and deployment of next generation Internet networks, applications and services between CA*net II users as well as international R&E users • to explore, modify, test and deploy new services, tools, and techniques that could be required in future commercial NOCs • to document and disseminate knowledge

8. The Year in Review • 13 GigaPOPs up and running • over 30 universities and research institutes connected • Over 20 Demos of advanced applications • about half between Europe and North America • Several “persistent” high performance applications e.g. • NRC BioInformatics • Callisto video server • ARDNOC up and running with 8 staff • Qbone about to start in 5 sites

9. The Year in Review • Still some problems with ATM switches and SVCs • MBGP multicast now working • Native IPv6 network up and running • Hierarchical Cache now working with 5 GigaPOPs & 12 universities • Stats & Measurements - Surveryor and OC3mon working • Peering with 5 international next gen Internets - 12 more expected next year • Close collaboration with Internet 2, NSF and NGI

10. CA*net 3 Objectives • In partnership with industry, universities and research community carry out R&D in optical Internet technologies, services and applications • To showcase different Canadian technologies, applications and services - Cambrian, PMC Sierra, Newbridge, etc • To facilitate a partnership between industry, carriers, RAN’s and R&E community in order to accelerate the deployment of next generation Internet products and services; and • To catalyze the building of a sustainable virtual high performance R&E network

11. 1999 Program • Network to be fully deployed 1st quarter • 2 x OC-48 wavelengths with POS - 5 Gbps • Layer 3 restoral & route diversity provided by CA*net 2 (IP over ATM) running in parallel • Fast restoral and explicit routing with MPLS • Optical Internet Exchange - 3rd quarter • Gigabit Ethernet over WDM in metro - 1st quarter • 10xGbE on additional wavelengths- 3rd quarter • Cut through wavelengths - 4th quarter • Use of both sides of fiber ring with layer 3 restoral - 4th quarter • Several Schoolnet Caching Pilots underway - 2nd quarter • High Speed Video Delivery - 3rd quarter • Advanced route diversity - 1st qtr 2000

12. CA*net 3 National Optical Network CA*net 3 GigaPOP RAN SRnet WURCnet MRnet OC3 OC12 DS3 ACORN BCnet St. John’s Calgary OC3 Regina RISQ Winnipeg Charlottetown ONet OC48 Fredericton OC12 Teleglobe Montreal Vancouver Halifax Ottawa Seattle STAR TAP Toronto Chicago New York

13. - CANARIE Drop Site CANARIE OC-48 Route National IP/WDM Network Edmonton Possible 10xGbE over DWDM Saskatoon Winnipeg Ottawa Calgary Regina Montreal Charlettown Vancouver St. John’s Seattle Fredericton Teleglobe Toronto Chicago Halifax New York 16 Wavelengths per route 8 for CANARIE 8 reserved for traditional SONET 4/BLSR by carrier CANARIE OC-192 Route

14. Exciting Developments in 10xGbE • Several companies have announced long haul 10xGbE CWDM with transceivers at 50km spacing • Costs are less than $12K US per node (or transceiver) for OC-192 data rates • Future versions will allow rate adaptive clocking for use with “gopher bait” fiber, auto discovery, CPE self manage • Excellent jitter specification • Most network management and signaling done at IP layer • Anybody with LAN experience can build a long haul WAN – all you need is dark fiber • Maybe the beginning of the end of managed bandwidth • Interesting parallel with time share computing of the 60s & 70s

15. Third Generation Router • Terabit routing - 32 x OC 192 - “Tiny Tera” • Juniper, Pluris, Nortel Avici, CISCO, Argonne, Ironbridge, Torrent, Nexabit, Terabit Corp, Netcore • 5 Tiny Tera = all existing switch capacity in North America • Routing on a chip with no caching • wire speed routing with HPCC techniques • BGP+, CBQ and MPLS Only • “let it smoke” packets • Integrated OADM with SONET path/link protection services and Fast IP framing • Advanced routing functions like multicast, interior routing be handled by GigaPOP or CPE router

16. National Film Board of CanadaVOD Project • Joint project between NFB, CANARIE and RISQ • 800 documentary films on-line on CA*Net 2 and soon on CA*Net 3. • 100 simultaneous connections • Currently looking at: • Creating an international VOD exchange site • IP owners workshop • MPEG2 version • Integration the Canadian Broadcasting Corporation (CBC)

17. Connectedness • Canada has highest penetration of telephone and cable • Highest ranking of G7 countries on technology potential • World leader in optical networking technology • Major government initiative on connecting all schools • Major government initiative on community access • World first high speed optical Internet backbone • Connectedness seems to be a unique Canadian strength • So, maybe our next grand challenge is…..

18. Gigabit Internet to Every Canadian School, Library & eventually Home? • Building on CA*net 3, a new research initiative in partnership with industry, R&E, federal government provinces to explore and develop the technology that can be used deliver extreme high speed Internet to every school and library in Canada, and eventually to every home

19. Why should we do this?? • Many school boards and provinces are deploying T1 and DSL services to the schools • But is this fast enough? • Particularly if want to connect every class room • And each class room is downloading their own video stream • Soon we will need 10/100/1000 Mbps each school • Schools and universities are in many ways early adopters of information technology • By leveraging our research in optical Internets this might enable early deployment of high speed Internet to the school and then eventually an architecture for high speed Internet to the home

20. Promote Canadian Content • One of the big costs of Internet delivery is not the network, but buying Internet access from a US service provider • But a Gigabit Network to every school could be used to promote development of Canadian high speed multimedia content • Canadian content would be fast, immediate and exciting and very low cost • Foreign content would be slow and expensive

21. Early examples of GITS • Palo Alto has built a municipal owned regional network to deliver 100 Mbps Internet to every home and school • Cost $40 per month • MFS has proposed building a new sewer system for Palo Alto so it can pull fiber into the home • Bell South has a 10/100 Mbps Internet service trial • no telephone, no video - just the Internet • Washington State is deploying Gigabit Ethernet to every school • approx $100 month • Sweden has deployed Gigabit Internet to major universities • $3500 per month including Internet access

22. Possible GITS program • CANARIE, industry and government establish a research program to investigate the technologies and develop a possible framework for GITS • Build on the lessons and technology that we are developing with CA*net 3 and the regional optical Internets • Many research issues in scalability, management, low cost DWDM, layer 3 optical Internet services, IPv6, etc • Leading to early field trials and pilots across Canada • Actual deployment will be done by private sector • Competitive equal access at all levels essential • competition not technology that drives innovation and reduced pricing

23. Possible GITS Concepts • A third commercial network running in parallel to telephone and cable • Avoids regulatory and technical issues of 911, number portability, etc • Encourages SMEs and entrepreneurs to build the infrastructure • Deliver high speed Internet only • IP telephony and IP video maybe can be added at a later date • Build on the infrastructure we are putting in place for CA*net 3 with optical RANs, GigaPOPs, etc

24. Possible GITS Concepts • Federal and Provincial government encourages deployment by funding schools as first customer and early adopter • But governments specify an architecture that guarantees competitive access that can lead to deployment to every home • Electric utility companies, municipal governments, CLECs, and traditional telco and cableco can participate equally

25. Preliminary Analysis • Early Fiber to the Home was too expensive because it assumed fiber from every home to a CO • expensive terminal equipment required to provide voice and video • but voice traffic is going wireless • and broadcast is going by satellite • GITS requires no CPE, only 10/100/1000 NIC card • With low cost DWDM, PON, new architectures that feature competitive equal access ... • GITS may be marginally more expensive than xDSL or cable modems • and with 1000 times the bandwidth!!!

26. OADM OADM OADM OADM OADM OADM OADM OADM Local WDM Fiber Ring Provided by Cable Company, Telco or CLEC OADM Possible GITS Architecture CA*net 3 GigaPOP Commercial Internet ISPC ISP A POS ATM GigaBit Ethernet Optical RAN ring in partnership with cableco, telco, or CLEC OADM OADM Local WDM Fiber Ring Provided by Cable Company, Telco or CLEC OADM OADM Major University

27. OADM Gigabit to the Home ISPC Internet Connection ISPA Internet Connection POM Multi carrier ring provided by competitive access provider with separate wavelengths or fiber assigned to each ISP Single carrier ring with individual fibers using POM OADM ISP B ISP C Competitive Access Pedestal OADM POM ISP A Routing Puck POM ISP B 10 Base T Copper Pair 100 Base T 2 wavelengths 2 Fibers House Dual Homed

28. Opportunity for Canada • World leadership in optical Internet technologies • PMC Sierra, QNX, Cambrian, Nortel, Newbridge, CISCO, etc • Opportunity to quickly incorporate and act on lessons learned from CA*net 3 and ORANs • Opportunity to promote and encourage Canadian high bandwidth multimedia content for schools and libraries • Canada has the highest penetration and lowest cost first residential network • Canada was the first country to build the second residential network - cable TV • Canada can be the first country to build a “third” residential network - high speed Internet- and continue to be the most connected nation in the world