SIP Performance Benchmarking draft-poretsky-sip-bench-term-03.txt draft-poretsky-bmwg-sip-bench-meth-01.txt BMWG, IETF-69 Chicago July 2007 Poretsky, Gurbani, Davids
Motivation • Problem Statement: • Service Providers are now deploying VoIP and Multimedia using the IETF developed Session Initiation Protocol (SIP). • Industry lacks common terminology for SIP performance benchmarks • SIP allows a wide range of configuration and operational conditions that can influence performance benchmark measurements. • Goals: • Service Providers use the benchmarks to compare performance of RFC 3261 network devices • Vendors and others can use benchmarks to ensure performance claims are based on common terminology and methodology. • Benchmark metrics can be applied to make device deployment decisions for IETF SIP and 3GPP IMS networks
Scope SIP Signaling SIP Server (DUT) SUT Tester (Emulated Agents) SIP ALG /NAT • Benchmark SIP Signaling Performance (not Associated Media). • Terminology defines Performance benchmark metrics for black-box measurements of SIP networking devices • Methodology describes how to measure the metrics for a DUT or SUT
Benchmarks • Maximum Session Establishment Rate • Maximum Registration Rate • Maximum IM Rate • Session Capacity • Session attempt performance • Session setup delay • Session disconnect delay • Standing sessions
Revision Changes • draft-poretsky-sip-bench-term-03.txt • Describe a session as a 3-dimensional vector • Sess.sig • Sess.med • Sess.medc • Identifies session states - in words and diagram • draft-poretsky-bmwg-sip-bench-meth-01.txt • Incorporates terminology changes
Complements Proposed SIPPING or OPS - apm Work • draft-malas-performance-metrics-05 • This draft relates to end-to-end performance metrics • To be discussed in OPS BoF on application performance metrics • The BMWG drafts define metrics whose values contribute to end-to-end delay budgets and total capacity • The metrics in the current draft are consistent with a subset of the metrics defined in the malas draft.
Next Steps • Incorporate comments from meeting and mailing list • Consider for BMWG work item?