1 / 11

Conformance Testing

Conformance Testing. Lynne S. Rosenthal Software Diagnostic and Conformance Testing Division (301)975-3353 lynne.rosenthal@nist.gov. Outline. Software Standards and Testing Conformity assessment Conformance Testing what is it why bother how it works. Software Standards.

dani
Download Presentation

Conformance Testing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Conformance Testing Lynne S. Rosenthal Software Diagnostic and Conformance Testing Division (301)975-3353 lynne.rosenthal@nist.gov

  2. Outline • Software Standards and Testing • Conformity assessment • Conformance Testing • what is it • why bother • how it works

  3. Software Standards • Promoteportability & interoperability • Success depends on: • Efficiency of standard development process • Quality of resulting standard • Ability to ensure implementations conform to the standard

  4. Software Testing • Testing - process of trying to find errors by means of experimentation • Testing of realistic system not exhaustive • can show presence of errors not their absence • Testing is either • structural testing (white box) • functional testing (black box) • conformance testing

  5. Conformance Testing • Determines which areas of the specification* are implemented correctly. • tests capture the technical description of the specification • testing is bound in scope by the specification • internal structure of product-under-test not accessible *publicly available standard

  6. Why: conformity assessment • ISO Guide 2:“any activity concerned with determining directly or indirectly that relevant requirements are fulfilled.” • communication between buyer and seller • buyers increased confidence • sellers substantiate claims

  7. Why: • Improves quality of software • Objective method for evaluating products • ensures presence of required characteristics • Promote portability and interoperability

  8. How:building tests • Falsification Testing • find errors by means of experimentation • show presence of errors not their absence • prove non-conformance • Tests based on: • required functionality • logical errors by misunderstanding requirements • errors from boundary conditions and divergence • common programming errors

  9. Requirements Software Conformance Tests Test programs

  10. When: • Develop in parallel with specification • feedback to specification for clarification, correction, etc. • Develop in partnership with product developers

  11. Summary: Conformance tests • Determine if a product has required characteristics • Increases product confidence • Communication between buyer and seller • Improve quality of software

More Related