250 likes | 374 Views
In the presentation by Martin Lugan, a Test Engineer at Haufe-Lexware, the significance of structured Performance, Load, and Stress (PLS) testing in application lifecycle management is explored. Key topics include the types of tests, requirements for structured testing, planning, execution, assessment of results, and validation of test reports. The presentation emphasizes best practices, challenges faced in resource management, and the importance of accurate configuration and monitoring to ensure realistic outcomes.
E N D
Structured Load Tests for Web Applications Martin Lugan QC Engineering Team Status: 20.06.2013
Speaker • Martin Lugan is a Test Engineer in the Quality Control domain at Haufe-Lexware in Freiburg • He is responsible for topics such as PLS tests, test environment virtualisation and test data anonymisation . • Contact information: • Martin Lugan • Haufe-Lexware GmbH & Co. KG • Munzinger Str. 9 • 79111 Freiburg • Telephone +49 761 898-5209 • E-Mail Martin.Lugan@haufe-lexware.com • Web http://www.haufe-lexware.com/
Agenda • Why do we carry out structured Performance, Load and Stress tests (PLS) • The Test Types for PLS Tests • Requirements for Structured Performance and Load Tests • Test Planning: Mandatory information and risks • Test Execution • Result Assessment • Test Reports and Validation • Appendix
Why do we carry out structured Performance, Load and Stress tests?
Performance Management in Application Lifecycle Management (ALM) Test types and test environment design Definition of non-functional requirements (Performance) Lab and module test Performance (End2End) Monitoring Performance, Load and Stress test according to demand
Overload • Stability • Elasticity Typical response time wave
Results Assessment - Successful test run • Even for an ever-increasing load generated by an increasing number of virtual users, the response times will only grow marginally. • However, the individual transactions with strongly differing response times are not satisfactory.
Results Assessment - Typical resource problem from the server side • The increasing number of vUsers means longer response times.
Results assessment - further errors In this test, the load was raised in the first hour. Afterwards, the load remained the same. After 1:30, we can see a significant drop in the load times. The cause was an incorrectly configured caching of database accesses.
Results Assessment - further errors • In this test run, the DB connections were not closed by the application (see monitoring graph above - test run starting at 12:30). The result is, that after reaching the configured maximum DB connections, the server had to be restarted twice.
Validation • In order to check if the tests have delivered realistic and meaningful results, a validation of results should be done. • e.g. by comparing the resource load on the test and live system. • Do we encounter load or performance problems in the live system that we did not encounter in the test execution? <- CPU Load Test system <- CPU Load Test system on a normal Monday morning
Appendix • References: • The slides 6, 17 were taken from „PLS-Roadshow” – Markus Lobreyer & Pandora Project • Translation into English: Victor Giurgiu