1 / 20

Platform Support for Developing Analysis and Testing Plugins

This talk presents an overview of Integrated Development Environment (IDE) features that facilitate the development of plugins aimed at program analysis and software testing. Focusing on the BERT (Behavioral Regression Testing) project, we will discuss traditional regression testing approaches and the innovative use of plugins to enhance testing processes. Key topics include test case generation, behavioral comparison, and differential behavior analysis. We will also explore API documentation, GUI support for plugin functionality, and provide insights into the practical implementation of these concepts in IDEs.

ban
Download Presentation

Platform Support for Developing Analysis and Testing Plugins

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Platform Support for Developing Analysis and Testing Plugins Shauvik Roy Choudhary with Jeremy Duvall, Wei Jin, Dan Zhao, Alessandro Orso School of Computer Science – College of Computing Georgia Institute of Technology

  2. Development Environment

  3. IDE features IDE Plug-in Source Code Editor Plug-in Views SCM Plug-in Runtime Builders Testing Debugger … … … Note: Plug-ins are called as Add-ins in Visual Studio

  4. IDE features IDE Plug-in Focus of this talk: IDE Features for developing plug-ins that support “Program Analysis and Software Testing” Source Code Editor Plug-in Views SCM Case Study: BERT (BEhavioral Regression Testing) [WODA’08][ICST’10][FSE-demo’10] Plug-in Runtime Builders Testing Debugger … … … Note: Plug-ins are called as Add-ins in Visual Studio

  5. Regression TestingProcess and Issues ?

  6. Regression Testing Process and Issues

  7. Traditional Regression Testing • Existing test suites typically target a small subset of the program behavior • Tests focus on core functionality • Oracles often approximated

  8. BERT Traditional Regression Testing

  9. BERT Phase I: Generation of test cases for changed code

  10. BERT Phase II: Behavioral comparison

  11. BERT Phase III: Differential behavior analysis and reporting

  12. BERT Traditional Regression Testing

  13. Our Experience • Programming language Java C# • Intercepting save and build events ✔✔ • Triggering and checking build process ✔✔ • Computing program differences ✔ ✖ (custom) • Generating test cases ✔ (Randoop, JPF)✔(PEX, Randoop.NET) • Instrumenting code ✔ (Javassist)✔ (CCI) • Running test cases and code ✔ ✔ • Visualizing information for user ✔ ✔

  14. IDE Support for Program Analysis and Testing Plug-ins Project Artifacts and Events Static Information Dynamic Information Plug-in Development Support Graphical Features

  15. 1. Project Artifacts and Events

  16. 2. Static Information • Intermediate representations • Program differencing • Instrumentation • Build parameters AST

  17. 3. Dynamic Information • Test Execution • Runtime Metrics • Debugging information Test Run

  18. 4. Graphical Features • Provide GUI hooks to access plug-in functionality • Obtain user input or tool preferences • Present data to user and allow them to interact with it

  19. 5. Plug-in Development Support • Development • API Documentation • Sample Code and Informal Documentation • Testing, Debugging, and Maintenance • Launch and monitor IDE instance

  20. Summary

More Related