1 / 22

What is New in Visual Studio 11 for Testers

GSJGD. What is New in Visual Studio 11 for Testers. Charles Sterling Senior Program Manager Microsoft Corporation http://blogs.msdn.com/visualstudioalm. Agenda. Review of what we delivered in Visual Studio 2010 + enhancements for Visual Studio 11 Paradigm Shift to Exploratory Testing

step
Download Presentation

What is New in Visual Studio 11 for Testers

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. GSJGD What is New in Visual Studio 11 for Testers Charles Sterling Senior Program Manager Microsoft Corporation http://blogs.msdn.com/visualstudioalm

  2. Agenda • Review of what we delivered in Visual Studio 2010 + enhancements for Visual Studio 11 • Paradigm Shift to Exploratory Testing • Enhancements in Lab Management

  3. Microsoft Test Manager enhancements for Visual Studio 11 • Huge Performance improvements • Multi Line Test Cases • Rich Text Test Cases • Test Data Reduction • Suite Copying • Test Case access from the Test Runner • Mark Test Case Status directly in MTM (no need to launch the runner) • Testing Metro Applications • EXPLORATORY TESTING!!!!!!!!!!

  4. Demo

  5. Agenda • Review of what we delivered in Visual Studio 2010 + enhancements for Visual Studio 11 • Paradigm Shift to Exploratory Testing • Enhancements in Lab Management

  6. The Agile Workflow

  7. Why - Exploratory testing • Enables focusing customer value rather than spec compliance • Free Testers from up front planning and find bugs fast and early without overhead • Focuses on working software!

  8. Exploratory testing – myths • Exploratory testing is ad-hoc, random testing • There is no way to measure exploratory testing • Bugs found through exploratory testing are hard to repro

  9. Using “Testing Tours” to put a method to the madness • Guidebook tour • Back alley tour • Supermodel tour • You can make up your own… Dogfood IDC NAR

  10. Sample tours – how we did it • The Reflex tour – tests responsiveness of the IDE • The Idiot tour – tests F1 inline help on each element • The Palatial tour – tests our multi monitors experience • The Footprint tour – tests virtual memory usage • The Budget tour – tests experience on a low end machine Dogfood IDC NAR

  11. Measuring exploratory testing • Right metrics are like a fingerprint of your team: no silver bullet • Distinguish between app quality metrics and metrics that direct exploratory testing

  12. Metrics – how we did it • Code coverage across tours • Story complexity to bugs ratio • Session duration for stories • Session roll up per tour

  13. Heat maps – how we did it

  14. Finding reproducible bugs

  15. A couple of puzzles • How many software testers does it take to change a light bulb? • None. Testers just noticed that the room was dark. Testers don't FIX bugs, they just find them. • How many developers does it take to change a light bulb? • “What's the problem? The bulb at MY desk works fine!”

  16. Rich bugs – how we did it • Automatic repro steps • Screenshots • Desktop recording • System information • Intellitrace logs

  17. Demo

  18. Test documentation – how we did it • Test cases automatically created while doing exploratory testing • Can save artifacts from exploration like expected image • With each sprint, regression suites are automatically ready

  19. Demo of Exploratory Testing

  20. Agenda • Review of what we delivered in Visual Studio 2010 + enhancements for Visual Studio 11 • Paradigm Shift to Exploratory Testing • Enhancements in Lab Management

  21. Lab Management Enhancements for Visual Studio 11 • Use physical infrastructure • Zero Configuration • Support for clustered Hyper-V hosts • Scale to 1000’s of VMs • Scale by cloning VMs via Network Isolation • New Environment viewer Deploy using deployment scripts • Full support SCVMM 2012

  22. Q&A http://blogs.msdn.com/anutthara http://twitter.com/anutthara Please fill the feedback forms!

More Related