MONET ( MObile NEtwork Tester )

1. MONET (MObileNEtwork Tester) Telecom Italia experience Telecom Italia LAB / T.TG.TL.AP SERAZIO Luca

2. Index • Testing Lab and Telecom Italia’s Test Plant • Testing areasand objectives • Testing automation • Testing Methodology • The MoNeTsolution • Test Scenarios • A test scenario • Monet history • System framework • Economics • Nextsteps Telecom Italia LAB / T.TG.TL.AP SERAZIO Luca

3. Telecom Italia Group • Telecom Italia offers technological infrastructures and platforms in which voice and data are converted into advanced telecommunications services - as well as the latest ICT and Media solutions. These tools cater for the Group's as well as the country's growth. • Our presence and role in the Italian market • Key numbers - First Half 2011 • » 31.3 million mobile lines • » 9.1 million broadband accesses, of which 1.9 million wholesale customers • » 15 million retail network connections to the fixed network in Italy, of which 7.2 million retail broadband accesses • » 3.65% daily average audience share by La7 • » 49.3 page views and 4.1 million single visitors to Virgilio (at March 31, 2011) SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

4. Telecom Italia in the world • Telecom Italia in the world • Italy, Brazil and Argentina are the strategic markets where the Telecom Italia Group operates. • The leadership of our Group at national level originates from an exhaustive offer aimed at transforming traditional communication into digital communication: activities carried out through companies operating on the domestic market range from land to mobile telephony, internet, research and development, office products and services, television and entertainment, media and ICT. • The Group is present in Brazil with TIM Brazil, one of the most important players because of the quantity of mobile lines. In Argentina the Group operates through Telecom Argentina in the sectors of land and mobile lines, internet and data transmission. Telecom Argentina also offers mobile telephony services in Paraguay. • The Telecom Italia Group is also active in other parts of Europe, North America, Africa and Asia through Sparkle, Lan Nautilus and Med Nautilus, Telecom Italia’s local operational companies. • The Group can be accessed throughout the world by contacting Telecom Italia and Telecom Italia Sparkle’s representative offices. • Our presence and role in Latin America • Abroad Group's focus is on Latin America.
It operates in Argentina and Paraguay, providing fixed and mobile telephony services and internet through Telecom Argentina group.
In Brazil, TIM Brasil remains one of the major players. • Key numbers - First Half 2011 • Brazil
» 55.5 million mobile lines
» 25.5% of market share • Argentina • » 4.1 million fixed lines
» 1.5 million broaband accesses
» 17.4 million  mobile customers • Paraguay • » 2 million mobile lines SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

5. Testing Lab • Testing Lab is responsible of the maintenance and the management of test laboratories such as the Mobile Network Lab used for the validation of mobile network platforms and architectures, terminals and services. • Services development phases are paired with testing in order to reduce the impact and the probability of faults in older phases of the process. SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

6. Telecom Italia’s test plant: an overview SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

7. Telecom Italia’s test plant: the numbers of the core network • 2 HLRs • 5 MSCs • 5 MGWs • 3 SGSNs • 3 GGSNs • Several service nodes in continuousconfiguration and adaptaion to services (SMSC, TGDS, INS, IVR, …) • Interconnecting IP backbone SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

8. Testing areas and objectives • Verification and validation of: • New releases, patches and data • New network elements and new hardware • New network architectures • Regression testing • Network analysis under traffic conditions • Toll Ticketing validation • Test plant chains control using an end-to-end approach oriented to the final user • Testing remotization SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

9. Testing automation • Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions. Commonly, test automation involves automating a manual process already in place that uses a formalized testing process. • Automation benefits • Reduction of time and costs for test execution and verdict evaluation • Avoiding repetitive manual activity which is prone to error • Saving costs related to human experts and test bed occupation • Reduction of time to market for services, products and network architectures SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

10. Testing Methodology • The testing methodology applied is End-to-End testing with protocol conformance checks at the main SUT interfaces which is aimed to ensure the delivery of service to the final user with the correct communication between network elements. SUT USER A EUT A EUT B USER B Interface conformance checks E2E functionality SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

11. The MoNeTsolution • MoNeT (MObileNEtwork Tester) is an automatictool for the testing of the Mobile CS Core Network • The toolisconnecteddirectly to the mobile core Network by network interfaces: A interface for GSM and Iu-CS interface for UMTS and acts over theseinterface with the samesignallinggenerated by an end user over the radio interface • The platformoffers, from a web based remote GUI: • A tool for the automaticexecution of test lists and test scenarios • A virtual mobile terminal with allitsfunctionalities SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

12. The MoNeTsolution: test plantdeployment SUT . MONET 2G MONET 3G MONET SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

13. Test Scenarios • Basic call • Supplementary Services • CFB Call Forwarding on Busy • CFU Call Forwarding Unconditional • CFNRy, Call Forwarding no Reply • CFNRc, Call Forwarding no Reachable • CW Call Waiting • CH Call Holding • MPTY Multi Party Service • CLIP Calling Line Identification Presentation • CLIR Calling Line Identification Restriction • COLP Connected Line Identification Presentation • COLR Connected Line Identification Restriction • Call Barring • Emergency call • Narrow Band and Wide Band call • SMS • Unsuccesful scenarios • Multi toll ticketing • Intelligent Network Services (TIM custom VAS services: TCA, TIT, RIF, I&B, 2in1, PN, Premium rate, PagoIO, SOS PayForMe), • Hand over (3G-2G, 3G-3G, 2G-3G, 2G-2G) SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

14. A test scenario: Call Forwarding on Busy - qualitative User A User D Mobile Core Network User B User C CFB activation, destination USER D Preamble Auxiliary call from B to A to establish busy state Active call Call from C to A forwarded to D Active call Test End calls CFB deactivation Postamble SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

15. A test scenario: Basic call - signalling • MONET emulates the behaviour of the usersat the mobile core network interfaces (A or Iu-CS) enabling for eachuser to: • Performprotocolprocedures (includingsettimg of test pre-conditions) • set the value of eachfield of sentsignallingmessagesat Call Control level (e.g. BearerCapability, CdPN, …) • check (or ignore) eachfield of receivedsignallingmessagesat call control level (e.g. Release cause,receivedBearerCapability, CgPN, …) • ThesefeaturesenableMoNeT to: • Verify the correctness of the service and of the signallingprocedures • Produce the logs, the traces and the verdict of each test User A Mobile Call Network User B REGISTER (Deactivate SS - CF and CW) RELEASE COMPLETE Preâmbulo REGISTER (Deactivate SS - CF and CW) RELEASE COMPLETE SETUP (Speech, CdPN = B) CALL PROCEEDING SETUP CALL CONFIRM ALERTING ALERTING CONNECT CONNECT ACKNOWLEDGE CONNECT Test CONNECT ACKNOWLEDGE Active call DISCONNECT RELEASE REL COMP DISCONNECT RELEASE REL COMP SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

16. Monet history • 2001: feasibility study • 2002: platform development and integration with scenarios from Eurescom P613 project (TTCN-2) • 2003: debugging of call scenarios • 2004-5: continuous extension of call scenarios with TIM custom serveces • 2006-2008: project frozen for the realization of Mobile Network Labs in Turin • 2009: extension of call scenarios • 2010: extension of call scenarios with Hand-over procedures • 2011: feasibility study for migration to TTCN-3 • 2012: migration to TTCN-3 SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

17. System hardware framework PSTN • The MoNeT is composed of: • Linux server with: • web server for remote control • signalling board for interconnection with 2G network (A interface) • PSTN modem for calls involving PSTN lines • Ixia Catapult for interconnection with 3G network (Iu-CS interface) • A generic web client MONET Control Unit PSTN Intef. WEB Server IP CS 2G/3G Core Network A Interfaces SS7 Interf IP WEB Client Scheda STM1 Iu-CS Interfaces Ixia DCT2000 SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

18. Interfaccia TestList TestList User Interface utente Report Report Test Manager Test Manager Database Database Tests (ETS) VirtualTerminal Terminale Terminale VirtualTerminal Virtuale Virtuale PSTN Interface Manager PSTN Interface Manager IU Interface IU Interface Manager Manager GSM GSM - - A Interface Manager A Interface Manager PSTN Interface Driver PSTN Interface Driver IU IU Interface Interface Driver Driver (ddriver) (ddriver) GSM GSM - - A Interface Driver A Interface Driver GSM GSM - - A A Interface Interface s PSTN Interface PSTN Interface IU IU Interface Interface s System software framework Test Script Language Control Plane User Plane TTCN Test Suites Linux Based PC TTCN tool GUI WEB Server Simulated Protocol layers (CC/SS/SMS, MM) Adaptation and custom functions STM-1 Board Emulated Protocol layers (RANAP, SCCP) Emulated Protocol layers (ALCAP, STC) Emulated Protocol layers (Iu-UP, AAL2, ATM) Emulated Protocol layers (MTP3b, SSCF, SSCOP, AAL5, ATM) Physical Layer Iu-CS Interface SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

19. Migration from TTCN-2 to TTCN-3 SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

20. TTCN-2 Source Code Translation and Functionality Migration • Extern Functionality • TSOs • TSOPs • Translated to • TTCN-3 Predefined functions • TTCN-3 Functions • External functions that have to implemented in the platform adapter • Automated translation of • test types • test data • test behavior • Because of a good quality (TTCN-2 standard compliance) of the TTCN-2 • nearly no manual efforts SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

21. Test adapter implementation (I)Communication Implementation • Point of Control and Observation / PCO • Repackaging • Coordination Point / CP • No need for implementation. Provided by TTCN-3 tools • Cleary separated at runtime Repackaging SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

22. Test Adapter Implementation (II) Codec Implementation • ASN.1 Based Codecs • No effort as TTCN-3 tool support all of the ASN.1 requirements and encoding rules, built-in • Non-ASN.1 Based Codecs • Decision is to reimplement the non-ASN.1 codecs • Codec generation approach suitable • Low-efforts, high-performance • Low-risk • Only component that really has to be fully touched! SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

23. TTCN-3 based MoNet Architecture Test System User GUI Test System User WEB Server CMD Interface CMD Interface CMD Interface CMD Interface CMD Interface CMD Line Interface TM / TL CMD Line TE TE TE TE TE TE TE CH CH CH CH CH CH CD CD CD CD CD CD CH CD SAPlugins SAPlugins SAPlugins SAPlugins SAPlugins SAPlugins SAPlugins SAPlugins SAPlugins SAPlugins SAPlugins SAPlugins SAPlugins SAPlugins SAPlugins SAPlugins SAPlugins SAPlugins PAPlugins PAPlugins PAPlugins PAPlugins PAPlugins PAPlugins SAPlugins SAPlugins SAPlugins PAPlugins SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

24. Economics: an application revenue • Context: • Regression test for FOA CNCS8.0 • Activity duration: 4 months • Test cases for each session: 470 • Rate of usage: several daily execution on each testing chain (6 testing chains combining 3 MSCs and 2 HLRs) after every new software installation or correction • Overall usage: over 200 session which means 200x6x470>550K tests (about 5000 tests/day) SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

25. Economics: the BEP between automated and manual testing The BEP (Break Even Point) isreached with a limitatednumber of executionsof the test list. SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

26. Economics:the effort required for automated and manual testing During the FOA CNCS8.0 activity, the numer of test executed to validate software and correctionsis so high thatitshouldn’t be possible to apply the methodology with a manualapproach. SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

27. Next steps • CS scenarios extension • PS scenarios • User plane handling and check • Interfaces migration over IP SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP

28. QUESTIONS? • THANK YOU FOR YOUR ATTENTION! SERAZIO Luca, Telecom Italia LAB / T.TG.TL.AP