Neev QA Offerings
E N D
Presentation Transcript
About Neev Key Company Highlights Web Mobile Cloud Magento eCommerceSaaS Applications Video Streaming Portals Rich Internet Apps Custom Development AWS Consulting Partner Rackspace Joyent Heroku Google App Engine iPhone Android Windows Phone 7 HTML5 Apps 250+ team with experience in managing offshore, distributed development.Neev Technologies established in Jan ‘05 VC Funding in 2009 By Basil Partners Member of NASSCOM & ESCDevelopment Centers in Bangalore and Pune. Offices at Bangalore, USA, Delhi, Pune, Singapore and Stockholm. User Interface Design and User Experience Design Performance Consulting Practices Quality Assurance & Testing Outsourced Product Development
Project Methodology Tools Project Management Tools Redmine Jira/Trac Deployment Tools Jenkins Emma/Cobertura QA Tools Selenium Jmock Knowledge Capture Tools Neev Hub Process QA to Staging to Production environments Daily Stand-ups
The Neev Edge • End-to-end consultative approach for software solutions through needs assessment, process consulting and strategic advice • Internal QMS are ISO 9001-2008 certified and CMM level 3 compliant. • Continuous process and service level improvements through deployment of best-of-breed processes and technologies • International Standards and best practices on Project Management including PMI, ISO and Prince-2 • Proven EDC Model of delivery to provide predictable results • Scrum based Agile development methodology
Our QA Experience Full product-life cycle experience including QA and Testing Experience providing QA as an extension of our development services or as an independent project Extensive experience in performing QA/Testing on a variety of architectures – Web-based, Client-server, Rich-client and Mobile systems, Java, .Net, packaged software Experience with different types of testing – functional, regression, performance, stress, usability, smoke, SDK, component – using manual and automated approaches Expert in Agile testing using Agile Testing tools processes Well-defined QA processes for different development methodologies – RUP, Agile, Waterfall, etc Deep experience on deploying a “tool-centric” approach to QA using off-the-shelf tools for test management, performance/stress/intrusion testing, build management and testing automation We have built “custom” tools/frameworks for test data generation, unit testing, API/SDK testing, test metrics collection, etc.
Agile Testing Process Update Product Backlog Release Planning Write user Stories Sprint Planning Create Spring Backlog Spring Review Regression Testing Performance Testing Update Product Backlog Developer Tester Discuss & elaborate Acceptance Tests Technical & Data Model Design Write Acceptance Tests Development & Unit Testing Create Acceptance Test Data Integrate Acceptance Tests Execute Acceptance Tests Development & Bug Fixes Manual Testing Integration Testing
Progressive Regression Product Development Regression Suit Progressive Development Regression suite development cycle will always be 1 step behind the product development cycle and it will ensure that existing product features are not impacted by the current development.
Sample of QA Environment QA Sandbox Pre-production environment Production Regression & Load Test Development Manual testing of • Features • Bug fixes • Patches • Hotfixes • Unit Testing Regression test • Features • Components • Functionalities Detailed Load Test Security Test Regression test with • Existing configuration • Existing data Minimal Load Test
Selenium Automation Experience • Actively deployed Selenium as automation tool of choice across 75% of our EDCs • Strong Java/J2EE based test automation experience • Developed our own Selenium-based automation framework using Selenium, TestNG, jUnit, ANT integrating all best practices. • Java Developer resources assigned to Selenium development with experience in OOAD, Agile development, etc • Integrated Selenium into: • Continuous Integration servers • Build, QA and Release processes. • Daily email alerts and notification system.
Selenium + TestNG Based Automation Key Highlights • Modularized Test Suites and Test Scripts with automated test bed set up. • Backed by Selenium RC Server for Test scripting in standard languages like Java, Python, Ruby. • Integrated with TestNG, JUnit and for easy grouping of test suites and test scripts. • Integration for automated build of the entire Test Automation Project • Automated generation and mailing of the HTML reports. Release Candidate
Case Study – WellZio EDC Test Automation in an Agile Product Development • WellZio EDC was set up for one of our current customers from the healthcare domain. • Focused on end-to-end lifecycle of Product development and production support. Responsible for Engineering, Architecture and Design, QA Testing (Manual and Automation) and Server (Cloud) operations management • Agile Team comprising of 6 Developers; 2 Automation Test Engineers; 2 Manual Test Engineers; 1 Project Manager; 1 Server Support Engineer; • Engineering followed a complete Agile Development and Testing Methodology. • 1200 test cases in total covering 18 key modules of the application; over 50 build releases; 60%+ Code coverage achieved • Automated Scripts are integrated with the weekly build processes. Every week, the entire suite of automated cases are run, bugs identified, and an alert is sent to the product management team.
WellZio EDC Team Structure Offshore Onsite CEO - Neev CEO - WellZio Head – FINANCE & Control Account Manager Head – Product Development Head – Business Development Project Manager Engineering Manager DEV Lead QA Lead Dev 1 Dev 2 Dev 3 QA 1 (Manual) QA 3 (Selenium) Dev 5 Dev 6 QA 2 (Manual) QA 4 (Selenium) Dev 4
WellZio EDC – Key Highlights and Challenges • Long Product Roadmap • Product developed over a 2 year long roadmap, with fairly complex feature sets. • Resulted in a progressively increasing time per regression pass. • Dedicated test automation engineering team set up • Test Automation Team has delivered a comprehensive and up-to-date test suite. • Test Suite continuously updated with each sprint. • Continuous Refinement and Constantly Changing GUI • Frequent releases and market validation resulting in dynamic feature refinements. • Unit Test Automation with Continuous Integration formed the bed rock of stability in an otherwise high-flux environment. • Large and Growing Test Automation Suite • Product team’s commitment to minimize manual testing, resulted in most of the features being automated. • Resulted in large test suites. Large tests were split into many small test scripts. • Reusable components were identified and a Common Utilslibrary was created. • Preserved maintainability and flexibility of the automation suite.
Case Study – AppDynamics EDC An Application Performance Management Product • AppDynamics is an application performance measurement tool, monitoring JVM's(Java) and CLRs(.NET) in production. • Supports applications across a wide range of technologies and platforms. • The solution helps to reduce mean-time-to-resolution by up to 90%. • Started in 2008 in California, AppDynamicsis a funded start-up. • As of Nov 1st 2011, there have been more than 50K user downloads for the Lite version.
The Solution … (1) Neev created a suite of applications that are used to test the performance of the new build and the results are then bench marked and published.
The Solution …. (2) Neev created test applications using a combination of technologies. These applications are employed on a daily basis to perform a rigorous test on the product features. For instance, an application to test Java Messaging Service, which would run on JBoss .
The Solution …. (3) A section of Neev’s team is focused on building a framework, which would facilitate the automation of test cases. This brought down the regression testing period significantly.
The Solution …. (4) Neev develops an application specific to a potential customer. The idea is to simulate the production environment of the customer, and then demonstrate the product's prowess and capabilities in that environment.
A typical day for the Neev team POCs as & when required
Case Study – eMids Selenium Automation Intervention • eMids was looking for QA partner to automate Regression Tests for an application which they were developing for a reputed health-care organization. • Constraints – Cost, Improve Coverage, Reduce turn around time, Predictable build quality, Scalable framework, Reliable regression test runs. • Neev deployed its Selenium framework with Java / TestNG for automation which was completely Open Source compared to other solutions which were License based. • Neev covered all the 7 modules of the application by automating more than 300 test cases. • In the process of automation Neev uncovered more than 30 new bugs. • The process improved the turn around time of QA and in return improved the productivity by 60%.
eMids EDC Team Structure Onsite Offshore Project Manager Project Sponsor (Client) Onsite Project Coordinator QA Lead QA 1 (Selenium) QA 3 (Selenium) QA 2 (Selenium) QA 4 (Selenium)
Case Study – eMids Key Challenges • Short Term Intervention Program • Focused Short Term Regression Test Automation intervention program • Application was in production. No major feature changes were expected. Customer wanted to reduce the periodic regression test cycle time by at least 50%. • 7 key modules were identified. Close to 300 test cases were automated within a short period of time • No documentation • Detailed Documentation of the application feature description was not available. • For the 7 modules identified as candidates for automation, the team performed a thorough analysis and documented all key test cases. The test cases and scenarios were signed off by the customer. • Zero Prior Automation • As there were no automated cases, the team started by developing an Automation Framework using Selenium and jUnit, that can be flexible, extensible and maintainable. • Test Cases were organized into a comprehensive suite which can be triggered using an ANT target during build time. Thus, every time a new build was generated, the entire automation suite was executed and the results were recorded and analyzed.
sales@neevtech.com Neev Information Technologies Pvt. Ltd. Sweden Singapore India - Bangalore India- Pune USA Neev AB, BirgerJarlsgatan 53, 6tr, 11145, Stockholm Phone: +46723250723 #13 L’Square, 3rd Floor PariharChowk, Aundh, Pune – 411007. Phone : +91-64103338 The Estate, # 121,6th Floor, Dickenson Road Bangalore-560042 Phone :+91 80 25594416 #08-03 SGX Centre 2, 4 Shenton Way, Singapore 068807 Phone: +65 6435 1961 1121 Boyce Rd Ste 1400,Pittsburgh PA 15241 Phone : +1 888-979-7860
