1 / 27

A Survey Report on Most Common Mobile Application Bugs

A Survey Report on Most Common Mobile Application Bugs. Gürsoy DURMUŞ Software Eng ./ Havelsan Inc. gdurmus @havelsan.com.t r. Çağrı TEMİZYÜREK Software Test Eng./ Havelsan Inc. ctemizyurek@havelsan.com.t r. Outline. About Havelsan Inc. Mobile application market

kassia
Download Presentation

A Survey Report on Most Common Mobile Application Bugs

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A Survey Report on Most Common Mobile Application Bugs GürsoyDURMUŞ Software Eng./ Havelsan Inc. gdurmus@havelsan.com.tr ÇağrıTEMİZYÜREK Software Test Eng./ Havelsan Inc. ctemizyurek@havelsan.com.tr

  2. Outline • About Havelsan Inc. • Mobile application market • Impact of mobile application bugs • Complexitiesof mobile application testing • Research methodology • Classification of mobile application bugs • Survey questions and results • Analysis of most common mobile application bugs

  3. About Havelsan Inc. • HAVELSANInc. is a Turkish Armed Forces Foundation company • Some of HAVELSAN’s systems and solutions • Reconnaissance Surveillance & Intelligence Systems • Peace Eagle (PE) - Turkish Airborne Early Warning & Control Sys. • Maritime Patrol Aircraft (MELTEM), etc. • Command & Control Systems • Military Enterprise Information System • MILGEM (Turkish National Warship) etc. • Simulation & Training Systems • Weapon Systems and Flight Trainers • Full Flight & Mission Simulators (FFS & FMS), etc. • e-Government Systems • National Judiciary Information System (UYAP) • Land Registry and Cadastral Information System (TAKBİS) • TCDD (Turkish State Railways) Resource Management System, etc. • For more information please visit www.havelsan.com.tr

  4. Mobile application market • The number of smartphones, tablets, touch and connected devices increase • The market for mobile applications is also growing • The number of mobile application download doubled in 2012 (60.1 billion) up from 29.5 billion in 2011. • 108 billion mobile application download is expected by 2017 • What about bugs? BERG INSIGHT, The Mobile Application Market, February 2013

  5. Impact of mobile application bugs • Users have a very low tolerance for a buggy mobile application* • %79 report that they retry an applicationonce or twice if it failed to work the first time. • Impact of mobile application bugs are • Poor user experience • Decrease in application store rating • Move to competitor applications • Loss of reputation and credibility • Sales loss * www.compuware.com # of bugs

  6. Complexities of mobile application testing • a lot of kind of devices • various mobile operating systems • adapting to frequent OS changes • Environment • Device • Network • Usability

  7. Complexities of mobile application testing • touch and non-touch • limited memory capacity • battery drainage • Environment • Device • Network • Usability

  8. Complexities of mobile application testing • different network and carriers • Wi-Fi, Bluetooth, NFC • Edge, 2G, 3G, 4G • application behavior in poor or no network • offline support • Environment • Device • Network • Usability

  9. Complexities of mobile application testing • device specific usability features • orientation, • touching, multi-touching, • zooming, • paging and navigation limitations • various interruptions • incoming SMS/MMS, • incoming calls, • alarm clocks, • low battery alerts etc. • Environment • Device • Network • Usability

  10. Research methodology • First study on analysis of «most common mobile application bugs» • Identification of mobile application bugs • Classification of the bugs • Preparation and delivery of the survey • Analyzing the results

  11. Identification of mobile application bugs The most observed 20 bugs are determined with • authors’ mobile testing experience • comprehensive literature research Identified20 generic mobile application bugs as: • Functional bugs • Usability bugs • Security bugs • Localization bugs • Other kind of bugs

  12. Classification of mobile application bugs • Crashes • Login / Logout • Input validation • Error / warning messages • Mobile interruptions • Connection • Functional bugs • Usability bugs • Security bugs • Localization bugs • Other kind of bugs

  13. Classification of mobile application bugs • Layout and readability • Orientation • Navigation and paging • Zooming and multitouching • Functional bugs • Usability bugs • Security bugs • Localization bugs • Other kind of bugs waste of display area

  14. Classification of mobile application bugs • Weak password validation • Cookies • Functional bugs • Usability bugs • Security bugs • Localization bugs • Other kind of bugs try with 8 space characters «________»

  15. Classification of mobile application bugs • Grammar errors • Misspelled words • Punctuation errors • Functional bugs • Usability bugs • Security bugs • Localization bugs • Other kind of bugs

  16. Classification of mobile application bugs • Installation / uninstallation • Configuration • Upgrades • Background tasking • Battery and memory usage • Functional bugs • Usability bugs • Security bugs • Localization bugs • Other kind of bugs

  17. Survey responses 1- Profiles of the survey takers • The targeted attendees: • Mobile App. Developers • Mobile App. Testers • The survey published in Mobile App. Development & Testing related professional/social groups • More than 100 attendees from 20 different countries • Most of survey takers in «Other» group have software development & testing skills. Other 17% Tester 44% Developer 39%

  18. Survey responses 2- Experiences in «Software testing», «Software development»and «Other»areas. 10% 38% 52%

  19. Survey responses 3- Experiences in «Android», «iOS», «Blackberry OS», «WinPhone/8»and «Other» Mobile Operating Systems 7% 6% 4% 41% 42%

  20. Survey responses 4- Importance of software quality metrics: «Functionality», «Usability», «Reliability», «Security»and «Other» 2% 17% 36% 26% 19%

  21. Survey responses 5- Testing experiences in «Functional», «Usability», «Security», «Localization» and «Other» test types. 3% 13% 11% 49% 24%

  22. Survey responses 6- Experiences in «Enterprise & Business», «Communication & Social», «E-Commerce», «Game & Entertainment», «Travel & Local» and «Other» application categories 7% 10% 30% 19% 23% 11%

  23. Survey responses 7- Rank of defined bugs types in order of your observations: (1: most observed, 20: least observed)

  24. Analysis of most common mobile application bugs • Most common mobile application bugs • are determined according to user profile of the survey takers. • differ when the user profile is considered. • Crashes and error/warning messages are the mostly observed • Localization related bugs are less observed by developers • Other types of bugs (installation, configuration, etc.) are observed mainly by developers [L]Misspelled words [F]Mobile interruptions other [O]Bat. & mem. usage tester developer

  25. Analysis of most common mobile application bugs • Functional bugs take first place on the list! • Security related bugs are less observed… • mobile applications are harder to test for security • security testing needs additional skills Quality metrics Testing experience

  26. What should be done? • Considering the most common mobile application bugs; • development team should • clarify the reasons, • find a common way to solve each of them • test team should • prepare test scenarios which may produce these common bugs, • run these scenarios with more attention • consider security issues • use test automation tools as possible as to test these issues • Increase the quality of the application and user’s satisfaction.

  27. Thank you… Survey link: http://tinyurl.com/TestIstanbul

More Related