270 likes | 385 Views
This document discusses the creation of resource-efficient Voice over IP (VoIP) applications optimized for low-MHz mobile processors. With a focus on addressing the challenges of mobile VoIP regarding quality and performance, it highlights the importance of being IMS-ready and the integration of essential features such as video communication. It covers various aspects, including network operational smoothness, voice processing challenges, and the necessity for robust hardware accelerators to enhance mobile VoIP applications to meet the growing demands for audio and video quality.
E N D
Creating Resource-Efficient V2oIP Applications for Low-MHz Mobile Processors Fred Wydler VP VoIP Products SPIRIT DSP
About SPIRIT Acknowledged Communications Expert • 10 years in global embedded voice software business • 200+ first-class customers, including largest OEMs and software vendors • 140 people, 70 engineers, 15 PhDs • 100+millionsembedded (HW) voicechannelspowered • Multiple international “Product of the year” awards: Selected SPIRIT Customers: …and 200+ more
Agenda • VoIP on mobile: new rules of the game • To be IMS ready is the goal • Video communication – must-have functionality • Mobile VoIP. Quality wins. Wideband coming • Where the troubles come from
Agenda • VoIP on mobile: new rules of the game • To be IMS ready is the goal • Video communication – must-have functionality • Mobile VoIP. Quality wins. Wideband coming • Where the troubles come from
Mobile VoIP: Start of a New Era WiFi phones Game Consoles Mobile phones VoIP Set-top boxes Wireless residential gateways Portable players
Demands of Today and Tomorrow Requirements grow higher and deeper Basic layer – traditional requirements
Agenda • VoIP on mobile: new rules of the game • To be IMS ready is the goal • Video communication – must-have functionality • Mobile VoIP. Quality wins. Wideband coming • Where the troubles come from
Each Service over Each Access Network IMS idea goes to the real life fast
VoIP Evolution Are you 100% sure of your Voice Engine supplier?
Agenda • VoIP on mobile: new rules of the game • To be IMS ready is the goal • Video communication – must-have functionality • Mobile VoIP. Quality wins. Wideband coming • Where the troubles come from
voice, audio, video Video Means See not Guess • Video performance in terms of resource limitations of mobileplatforms • Regular RISC processor inside offers up to 15fps on a PDA display • Adding HW accelerator significantly improves frame rate • Video packet loss - Video PLC • Packets’ delivery conditions do not allow smooth playback • Automatic adaptation to the channel bandwidth (ARS) • Intelligent CPU load control/playback rate control • Audio/Video synchronization
Hardware Accelerators Welcome Integrating hardware accelerators into a complete solution • Standard integration (OpenMAX™) • Custom integration Already deployed by:
Agenda • VoIP on mobile: new rules of the game • To be IMS ready is the goal • Video communication – must-have functionality • Mobile VoIP. Quality wins. Wideband coming • Where the troubles come from
Quality as Competitive Advantage Customer satisfaction is the goal • Mobile VoIP is a commodity (lots of providers offer VoIP services) • Zero switching costs while changing VoIP provider (caused by poor user experience: voice breaks, delays, echo) • To tie up the customer VoIP providers need to pursue voice quality vs. 3.9MOS 4.32MOS Voice quality delivered by TeamSpirit® for VoIP calls over WiFi Average real conversation voice quality delivered by typical VoIP service providers nowadays
Wideband Voice Engine Customer’s demand – wideband communication • Wideband AEC • Wideband speech codec • Wideband adapted algorithms
Agenda • VoIP on mobile: new rules of the game • To be IMS ready is the goal • Video communication – must-have functionality • Mobile VoIP. Quality wins. Wideband coming • Where the troubles come from
Where the Troubles Come From • Network challenges • Voice processing challenges • Device challenges • Integration challenges
Why Engine, not Codec? Network challenges • Smooth operation in IP networks originally not suited to real-time voice transmission • Network jitter elimination • Packet loss concealment (standard speech codecs) • Delay reduction • Packets re-ordering • Robustness to WiFi-specific network impairments • Applying new WiFi standard revisions • Advanced algorithms handling packet bulk scenario
Seamless Network Access Network challenges • Handover • Apply VoIP to different access networks (WiFi, 3G) • Network evolution to the all-IP network and mobility • Service provider has to be involved • Active and automatic handover • WiFi roaming
PSTN Experience to Achieve with VoIP Voice processing challenges • Quality issues • Voice packet loss robustness • Efficient echo cancellation • Round-trip delay minimization • Clock drift adaptation • Regular telephony services • Call mute • Call hold/resume • N-way conferencing • Call transfer • Advanced telephony services • 4x dialing • Voice mail • Caller ID
Mobile Form Factor to Survivewith Device challenges • Hardware acoustic differences • Earpiece mode support • Microphone and speaker AGC • Filtering • Intelligent non-linear processing • Battery life • Minimal MHz requirements • The least number of threads in a system and the lowest memory footprint • Effective usage of DTXmode to minimize Tx and Rx power consumption for the WiFi interface • Highly-optimized speech and video codecs • Careful optimization to specific processor architecture
VoIP Encapsulation Integration challenges • VoIP is a commodity – not everyone is an expert in VoIP • Integration is the key • Minimum number of threads • CPU load control • Time for debugging • Cross-platform code (ARM9/9E/11, TI DaVinci, TI C64x, Renesas, XScale, TI OMAP) • Support for Windows/Linux OS families • HW accelerators support • High-level API – application enabler required • Signalling (H.324M, H.323, SIP, Skype, XMPP, any proprietary protocol) • IMS application compliance
Integration is the Key What’s wrong with components? • Single components work good, but the complete solution does not • Single componentsare optimized, but the complete solution is not • Integration is difficult to manage vs.
Real Life Requirements Beyond standard specifications • Interoperability with IMS infrastructure vendors • Firewall overcoming • Testing with major operators in USA, Asia, Europe
Thank you! Voice and Video Enable your Application! Request TeamSpirit® Mobile evaluation SDK with free SIP Voice&Video phone application in it running on starting from200MHz WinMobile devices www.SpiritDSP.com request@spiritdsp.com