1 / 12

WP 4 : Testing Tools and Methodologies

This report details the staffing, resources, deliverables, and major tasks regarding testing tools integration and validation in the ETICS environment. It covers the implementation of plugins, testing of installation modules, system testing, and remote regression testing. The report also discusses the development of various test and metrics plugins, issues related to plugin implementation, and plans for future work. Key topics include distributed testing, Condor/Metronome functionality, and the validation of plugins for production use.

carvajal
Download Presentation

WP 4 : Testing Tools and Methodologies

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. WP4: Testing Tools and Methodologies Status Report ETICS All-Hands – 21November 2007 Éva Takács (4D SOFT)

  2. Staffing and Resources • István Forgács • Tasks: • Coordination Etics, Diligent • Eva Takács – full time Etics Tasks: • Implementation of plugins • Implementation and testing of installation modules • Diligent system testing – modelling in ETICS • Andor Dirner – 30% Etics, 60% Diligent, 10% system administration • Tasks: • Implementation and testing of installation modules • Diligent testing ETICS 3rd All-Hands Meeting - University of Wisconsin, Madison - 23-25/05/2007

  3. Deliverables Status • ETICS-D4.3-Distributed_testing updated version of the draft sent to EU in M18 • Content: • Distributed testing in ETICS („co-scheduling” functionality) • A chapter about Condor/Metronome, how it works, how it is used inside ETICS to submit test jobs and so on • Test and metrics plugin framework • Test and metrics plugins • Metrics and their tools support in ETICS • Case study: Diligent system testing using ETICS • Installation modules • Status: • Internal review version sent on 14 November • Waiting for the contribution about Condor/Metronome ETICS 3rd All-Hands Meeting - University of Wisconsin, Madison - 23-25/05/2007

  4. Major Tasks Performed • Implementation of new and customisation of existing test and metrics plugins • Integrating the plugins better in ETICS by using properties, creating summaries in ETICS reports • Implementation of the installation modules (tomcat, mysql) • Modelling and ETICS environment for Diligent system testing

  5. Test and Metrics plugins • JCnnPlugin.py (javaccn) • JUnitPlugin.py (junit) • JUnitreportsPlugin.py • JUnitemmaPlugin.py (emma coverage for junit) • JCoberturaPlugin.py (cobertura coverage for junit) • JDependPlugin.py (jdepend – dependency analyser) • JPmdPlugin.py (pmd – source code quality) • JFindbugsPlugin.py (findbugs – bug pattern analysis) • JRat.py (java profiler) • CFlawfinderPlugin.py (flawfinder - static analyser for C/C++) • CPyPHPRatsPlugin.py (Rats – static analyser for C/C++, Perl, python, php) ETICS 3rd All-Hands Meeting - University of Wisconsin, Madison - 23-25/05/2007

  6. Installation modules • Redesigning, reimplementing and modelling a testing environment for the tomcat installation module • Modelling a testing environment and implementing the mysql install module

  7. Modelling an ETICS environment for Diligent system testing • Remote regression testing using the Diligent system testing environment as a private resource • Applying of plugins for core Diligent services grouped in org.diligentproject.*.*.*SERVICEARCHIVE components. Applied plugins: JFindbugsPlugin, JDependPlugin in production JPmdPlugin, JccnPlugin soon in production

  8. Issues • Plugins: • Putting them in production is still pending • Validating them through Diligent testing – four plugins have been validated, customised, used intensively • Validating the plugins for remote builds is pending. This task can be done when the plugins will be part of the client • Implementation of new plugins after reviewing what we have • Valgrind – a C profiler is under examination • PushToTest’s TestMaker a webservice testing tool is under examination

  9. Issues • Installation modules • Putting them in „production” • Registering them in a dedicated project or somewhere in ETICS??? • Registering in the externals and being set up as dependency for individual modules

  10. Workplan for the next quarter • Supporting Diligent system testing using, improve the modelled environment if it is the case • Validation of plugins (remote builds validation is missing) and installation modules • Implementation of the required new modules after having a look what we have ETICS 3rd All-Hands Meeting - University of Wisconsin, Madison - 23-25/05/2007

  11. Metrics • Nr of plugins: 11 • Nr of installation modules: 2 ETICS 3rd All-Hands Meeting - University of Wisconsin, Madison - 23-25/05/2007

  12. Conclusion Important issues: • Putting tthe plugins in production • If it is the case improve Diligent-ETICS integration • (Strong requirements for the review)

More Related