340 likes | 555 Views
E N D
2. 2.
3. Velocity Performance Testing Program
Strategic Planning
Testing
Production Monitoring (BAC)
HP Tool Sales and Implementation
Test Automation
VIP Quality Management Solutions 3.
4. Why the Presentation? The Big Directive
The Big Question 4
5. Why the Presentation? (Cont.) Lack of Good Comparison Studies
Evidence Can Be Found to Support any Theory 5
6. 6 Comparison Process Typical Proof of Concept Process
Define steps in PoC test
Define comparison criteria
Select tools for comparison
Execute tests independently
Compare results
Draw conclusions
7. 7 Proof of Concept Test Steps Launch Browser
Validate Logo
Login and Input Data
Navigate Within Site
Validate Text
Playback Test as Recorded
Parameterize and Data Drive
Cause and Detect Failure
View and Interpret Test Results
Edit/Enhance Script and Re-run
8. 8 Comparison Criteria Ability to Execute Proof of Concept Steps
Ease of Test Automation
Installation and configuration
Record/playback, custom coding
Results
Versatility
Support for emerging technologies
Integration with other tools
Resources
Availability of experienced professionals
Help, documentation, published materials
Technical support, tool maintenance, training
Hard/Soft Costs
9. 9 Tool Selection: Why Selenium? Free & Open Source & Free of Charge
Functional Test Automation Tool
Supports web testing
Supports record/playback and adv. scripting
Recent Releases Available for Download
Active Community of Users
Peer Recommendations
Popular Topic
10. 10 Tool Selection: Why QTP? Market Leader in Test Automation
Supports Largest Array of Technologies
Graphical, Keyword-Driven Test Development
Personal Experiences With it
Peer Recommendations
Part of HPs Functional Test Suite
11. 11. Selenium Components Basic Recording
Firefox
Selenium IDE
Custom Coding
Firebug
Java
Eclipse IDE
JUnit libraries
Selenium libraries
Playback
Selenium Remote Control
12. 12. Installing and Configuring Selenium
13. 13. Configuring Selenium for Testing
14. Configuring Selenium for Testing 14.
15. Installing and Configuring QTP
16. 16. Comparison: Install and Configure Selenium
Firefox
Selenium IDE
Selenium RC
Firebug
Java
Eclipse
Configure Eclipse QTP
QTP
Configure QTP
None required
17. Automating with Selenium vs. QTP 17.
18. Comparison: Test Automation Process Selenium
Launch Firefox
Invoke Selenium
Record Script
Convert to Java
Launch Eclipse
Copy/Paste Script
Fix Errors
Custom Code to Parameterize
Custom Code to Data-Drive
Run Test
View Results QTP
Launch QTP
Record Script
Parameterize
Data-Drive
Run Test
View Results
19. 19 Comparison: PoC Results
20. Comparison: Versatility Selenium
Web Testing Only
Must Record in Firefox, Playback in Many OS, Browser
No Built-In Object or Data Management Concepts
Some Emerging Technologies Supported by Community
Can Be Integrated With Many Development Tools QTP
Automates Many Technologies
Must Record in IE*, Playback in Many Windows Browsers
Facilitates Best Practices via Object Repository, Data Table, Parameterization
Native Support for Emerging Technologies + Extensibility
Tight Integration With Other HP Tools
21. Comparison: Resources Selenium
Resources Must Have Significant Development Skills
Unofficial Training Only
Support is Community Driven or Pay for Commercial Support for Multiple Tools
Documentation for Complete Selenium Solution Does Not Exist
QTP
Development Skills Not Required
Official Training Available
Professional Support Included Plus a Very Large Community of Users
Documentation is Mature and Complete
22. 22 The Total Cost of Ownership Hard Costs
Licensing
Support and maintenance
Staffing
Hidden Costs
Staffing
Time
Complexity
Internal desktop policies
Legal policies
Lost opportunity
23. 23.
24. Comparison: Hard Costs (Cont.) Selenium
QTP
25. 25
26. 26
27. 27 TCO: Hidden Costs of Selenium Staffing
Selenium career path vs. QTP career path
Finding Selenium resources is more difficult
Selenium detour creates higher turnover
Time
Longer learning curve
Time spent getting Selenium to work = less time testing
Complexity
Solutions take longer to build, maintain
Requires integration of many components
New challenges will require more components and more custom development
28. 28. TCO: Hidden Costs of Selenium Internal Desktop and Legal Policies
Many components for IT to support
Open-source may not be permitted
Firefox may not be permitted
Lost Opportunity
Only supports web, does not solve other automation challenges
Organizational challenges around reuse, standardization, centralization, visibility will be harder to accomplish
29. 29 Conclusions Free Does Not Mean Free
Free doesnt even mean cheaper
Cost of the tool is just one small factor
Understand Your Expectations
From the software producer, from the tool itself
Examine How the Software Will Be Used
Who will use, support and maintain it
What will it be used for in the near and long term
Our Conclusions:
Selenium may be right for some specific situations
QTP can be the right choice for a much larger array of situations
30. 30 Questions?
31. 31 References The True Cost of Software:
http://www.computerworld.com/s/article/81590/The_True_Costs_of_Software
Total Cost of Ownership:
http://www.netc.org/openoptions/pros_cons/tco.html
The Free Software Definition:
http://www.gnu.org/philosophy/free-sw.html
Why Open Source Software:
http://www.dwheeler.com/oss_fs_why.html
Repository of Open Source Tools Including Some Reviews:
http://opensourcetesting.org/
Eclipse: http://www.eclipse.org
Selenium HQ: http://seleniumhq.org/
Salary Ranges: http://salary.com
32. 32 Appendix A: QTP and Web 2.0 Adobe Flex/Flash
Microsoft Silverlight
AJAX in Various Forms
Dojo Toolkit
Yahoo! User Interface (YUI)
ASP.NET AJAX
Google Web Toolkit (GWT)
Web 2.0 Extensibility
Build your own custom add-in
33. 33 Appendix B: QTP Add-Ins QTP Add-Ins Included With Purchase
ActiveX
VisualBasic
Web
Delphi
Java
.NET
Oracle
PeopleSoft
PowerBuilder
SAP
Siebel
Stingray
Terminal Emulator
Extensibility
QTP Tool Integrations
HP Quality Center
HP LoadRunner
HP Business Process Testing (BPT)
Many BPT Accelerators
34. 34 Appendix C: Other Questions Operating Systems
Selenium: supports multiple OS
QTP: supports only Microsoft
Distribution of Large Automation Suites
Selenium: runtime license = $0
QTP runtime license = full price
Hardware requirements
Selenium: multiple instances on one machine
QTP: one instance per machine