Reducing
This presentation is the property of its rightful owner.
Sponsored Links
1 / 31

Reducing False Positives In Automated Testing PowerPoint PPT Presentation


In conjunction with Sauce Labs, QASource presented a webinar, "Reducing False Positives With Automated In Automated Testing". This slide deck summarizes the key points of the presentation. To view the complete webinar, visit: https://youtu.be/bi8hDBoZMPY Subscribe to the QASource YouTube channel for future webinars and other engaging video content!

Download Presentation

Reducing False Positives In Automated Testing

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Reducing false positives in automated testing

Reducing

False Positives

in

Automated

Testing


Reducing false positives in automated testing

FALSE POSITIVES ARE “FAILED”

TESTS THAT SHOULD HAVE PASSED,

aka FALSE ALARMS.


Reducing false positives in automated testing

WHY DO THEY OCCUR?


Reducing false positives in automated testing

WHY DO THEY OCCUR?

• AUTOMATION APPROACH


Reducing false positives in automated testing

WHY DO THEY OCCUR?

• AUTOMATION APPROACH

• IMPLEMENTED FRAMEWORK


Reducing false positives in automated testing

WHY DO THEY OCCUR?

• AUTOMATION APPROACH

• IMPLEMENTED FRAMEWORK

• THE WRITTEN TEST ITSELF


Reducing false positives in automated testing

THERE ARE SEVERAL POTENTIAL

CAUSES FOR FALSE POSITIVES IN

AUTOMATED TESTING:


Reducing false positives in automated testing

Cause #1:

RELYING

ON UI


Reducing false positives in automated testing

Small changes

in UI can cause

test breakage


Reducing false positives in automated testing

Cause #2:

CHANGE IN

UI ELEMENT

PROPERTIES


Reducing false positives in automated testing

Any change to:

ID


Reducing false positives in automated testing

Any change to:

ID

CSS


Reducing false positives in automated testing

Any change to:

ID

CSS

CLASS NAME


Reducing false positives in automated testing

Can result in

test breakage


Reducing false positives in automated testing

Cause #3:

SHARED

ENVIRONMENTS


Reducing false positives in automated testing

Functional &

automated testing

require separate

environments


Reducing false positives in automated testing

Cause #4:

REFERENCE

DATA CHANGE


Reducing false positives in automated testing

Scripts may change

configuration data

required by a test


Reducing false positives in automated testing

Cause #5:

SLOW

PERFORMANCE


Reducing false positives in automated testing

Slow performance =

Slow test execution

& test failure


Reducing false positives in automated testing

Cause #6:

MANUAL

INTERVENTION


Reducing false positives in automated testing

Some data must be

cleared manually

before/after

test execution


Reducing false positives in automated testing

Cause #7:

RELYING ON

SEQUENCE OF

EXECUTION


Reducing false positives in automated testing

Any failure in

test sequence

impacts the entire

test suite


Reducing false positives in automated testing

KEYS TO

REDUCING

FALSE POSITIVES


Reducing false positives in automated testing

USE OPTIMAL CONFIGURATIONS


Reducing false positives in automated testing

USE OPTIMAL CONFIGURATIONS

CONTROLLED AUTOMATION ENVIRONMENT


Reducing false positives in automated testing

USE OPTIMAL CONFIGURATIONS

CONTROLLED AUTOMATION ENVIRONMENT

KEEP TESTS SHORT


Reducing false positives in automated testing

USE OPTIMAL CONFIGURATIONS

CONTROLLED AUTOMATION ENVIRONMENT

KEEP TESTS SHORT

KEEP TESTS INDEPENDENT


Reducing false positives in automated testing

USE OPTIMAL CONFIGURATIONS

CONTROLLED AUTOMATION ENVIRONMENT

KEEP TESTS SHORT

KEEP TESTS INDEPENDENT

USE RIGHT LOCATORS

FOR OBJECT IDENTIFICATION


Reducing false positives in automated testing

VIEW THE ENTIRE

QASOURCE

WEBINAR

AND READ THE COMPLETE Q & A:

Pre and Post Webinar Questions Answered: Reducing

False Positives in Automated Testing

QUESTIONS ABOUT FINANCIAL TESTING?

VISIT US AT QASOURCE.COM


  • Login