STX project and software testing

1. STX project and software testing • Ossi Taipale • 2012 • Lappeenranta University of Tech.

2. STX among the other software testing research projects • Top down approach in the research projects: ANTI-project: Basic research of SW testing, 2004 - 2007 MASTO-project: Reference model of SW testing, 2008 - 2011 STX-project: Intended quality, 2011 - 2014 Cloud Testing Laboratory 2014 - ISO/IEC 29119: SW testing standard SW testing in the cloud ISO/IEC 29119, 33063, 25000 series

3. Software testing research • ANTI-project (2004 – 2007) : Factors affecting software testing , for example: • Product orientation, explicit knowledge, documented information, SPL, product variants, outsourcing, repetitive testing , reuse, testing automation. • Service orientation, tacit knowledge, domain knowledge, new delivery models, adaptive testing, explorative and manual testing. • MASTO-project (2008 – 2011): • Reference model of software testing (ISO/IEC 29119) • Assessment model of software testing (ISO/IEC 33063) • Software testing in the cloud • Mapping between software product attributes and software testing (ISO/IEC 25010)

4. Software testing and development for intended quality, STX (2011-2014)

5. Research Problem Intended Software Quality Software Development • Software Products • ISO/IEC 12207 • ISO/IEC 33000 series • New Services, • Cloud computing ISO/IEC 25000 series, Software Quality Software Testing ISO/IEC 29119, 33063, IEEE Std 1012, cloud testing OU’s are evaluated through an assessment framework

6. Objective To show how software development, software testing and intended quality depend on one another. Traditional software development and service models Emerging XaaS (Everything as a Service) architectures, technologies and service models. The project results help the participating companies in improving the efficiency of their quality management and software testing and hence the efficiency of their software development as a whole. Testing techniques Testing as a service

7. Testing of Quality Characteristics Software testing standard 29119 Part 4 contains information on how to map Quality Characteristics to Test Design Techniques and how to map Quality Characteristics to Types of Testing. This is used as reference in this study.

8. Software Testing in the Cloud • Cloud based testing offers a new delivery, operation and maintenance model that is enabled by the internet. • It affects the actual testing work and the way testing services are delivered. It also engages the management in paying attention to aspects such as pricing and security. • Objective: This is an empirical study aimed at understanding how organizations can successfully use the cloud for testing and how cloud based testing facilitates or hinders in reaching for quality requirements or quality attributes.

9. Software Testing in the Cloud • Testing in the cloud affects: • Acquisition (cloud based testing emphasizes services) • Business (cloud based testing emphasizes pay per use instead of license fees) • Access (services are accessed over internet) • Technical models of testing e.g. scalability

10. Publications from the STX project (2011-2014) Peer-reviewed articles 1. Riungu-Kalliosaari L., Taipale O., and Smolander K., "Testing in the Cloud: Exploring the Practice", Preprint for Special Issue on Software Engineering for Cloud Computing, IEEE Software (March/April 2012). 2. Pesonen, T., and Smolander, K., "Observations on eBusiness Implementation Capabilities in Heterogeneous Business Networks", IFIP International Federation for Information Processing, pp. 212-226, 2011. 3. Riungu L.M., Taipale O., and Smolander K., "Research Issues for Software Testing in the Cloud" IEEE Second International Conference on Cloud Computing Technology and Science (CloudCom), pp.557-564, Nov-Dec 2010. 4. Riungu L.M., Taipale O,, and Smolander K., "Software Testing as an Online Service: Observations from Practice", 3rd International Conference on Software Testing, Verification, and Validation Workshops (ICSTW), pp.418-423, April 2010.

11. Publications from the STX project (2011-2014) • Theses • M.Sc. • Aoke L., "Use of Standards in Software Development, Testing and Quality Assurance: Special Focus on China", M.Sc Thesis, April 2012. • 2. Timilsina U., "Security Issues on Testing of Public Cloud Applications", M.Sc Thesis, February 2012.

12. Publications from the STX project (2011-2014) In Review 1. Riungu-Kalliosaari L., Taipale O., and Smolander K., "Software Testing as a Service: Perceptions from Practice", Book chapter in review for Software Testing in the Cloud: Perspectives on an Emerging Discipline, IGI Global (2012). 2. Timilsina U., Riungu-Kalliosaari L., Taipale O., Smolander K., "Security Issues on Testing of Public Cloud Applications", Submitted to a Chinese journal, May 2012. 3. Seth F.P., Mustonen-Ollila E., Taipale O., and Smolander K., "Software Quality Construction: Empirical Study on the Role of Requirements, Stakeholders and Resources", Submitted to the 19th Asia-Pacific Software Engineering Conference (APSEC 2012), June 2012. 4. Riungu-Kalliosaari L., Taipale O., Smolander K., and Richardson I., "A Framework and Strategy for Cloud-based Testing in Practice", on-going 2012. .

13. Cloud testing laboratory 2014… Cloud-toimitusmalli edustaa uutta ohjelmistojen toimitusmallia (delivery model). Tutkimusyhtiö Gartner arvioi cloud-toimitusmallin mullistavan ohjelmistotuotannon rakenteen seuraavan kymmenen vuoden aikana. Tämä muutos vaikuttaa sekä olemassa olevaan ohjelmistotuotantoon että avaa uusia mahdollisuuksia suomalaisille yrityksille pääsyyn maailman markkinoille. Muutoksen on arvioitu sisältävän esimerkiksi ohjelmiston hankintamallin muuttumisen ostomallista palvelumalliksi ja liiketoimintamalli muuttumisen lisenssimaksupohjaisesta käytön perusteella veloitettavaksi. Lisäksi ohjelmistoa käytetään ilman asennusta omalle työasemalle Internetin yli ja cloud-toteutuksen tekninen malli tukee esimerkiksi laajennettavuutta, uudelleen käyttöä, ylläpidettävyyttä, ja pääsyä globaaleille markkinoille.