Applying model based testing in different contexts
This presentation is the property of its rightful owner.
Sponsored Links
1 / 21

Applying Model Based Testing in Different Contexts PowerPoint PPT Presentation


  • 47 Views
  • Uploaded on
  • Presentation posted in: General

Applying Model Based Testing in Different Contexts. Alexander Petrenko Victor Kuliamin ISP RAS, Moscow. Introduction. MBT application success depends on the context of the project Staff Organization Development culture, paradigms, and stereotypes

Download Presentation

Applying Model Based Testing in Different Contexts

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Applying model based testing in different contexts

Applying Model Based Testing inDifferent Contexts

Alexander Petrenko

Victor Kuliamin

ISP RAS, Moscow


Introduction

Introduction

  • MBT application success depends on the context of the project

    • Staff

    • Organization

    • Development culture, paradigms, and stereotypes

  • Can we modify technical aspects of MBT method used to fit the context more?

Yes! (at least sometimes…)


Outline

Outline

  • Introduction

  • Examples

    • Software component testing – UniTesK

    • Formal language processor testing – OTK


The origin

The Origin

  • 1994 – 1996ISP RAS – Nortel Networks project onfunctional test suite development for Switch Operating System kernel

    • A lot of bugs found in the OS kernel, which had been in use for 10 yearsSeveral of them cause cold restart

    • About 600K lines of code tested by 2000


Proposed solutions

Proposed Solutions

  • Software contract specifications for functionality Pre- and postconditions of operationsInvariants of data types

  • Test adequacy criteria basedon coverage of specifications

  • Transformation of pre- and postconditions into (IO)FSM, traversal of which guarantees the required coverage level

  • On-the-fly test generation – construction of a transition tour of the (IO)FSM or other paths


Ch@se tool

[email protected] Tool


The whole picture

The Whole Picture

Testing Model

Behavior Model

System under Test

Coverage Model

Single Input Checking

Test Input Generation


Tools

Tools

  • [email protected] (with C++ Link)Java (C++) / NetBeans, Eclipse

  • CTesKC / Visual Studio 6.0, gcc

  • [email protected]# / Visual Studio .NET 7.1


Applications

Applications

  • IPv6 implementations - 2001-2003

    • Microsoft Research

    • Mobile IPv6 (in Windows CE 4.1)

    • Oktet

  • Web-based banking client management system

  • Enterprise application development framework

  • Billing system

  • Components of TinyOS

    http://www.unitesk.com


Application success prerequisites

SUT

Application Success Prerequisites

  • Knowledge source on actual functionality

    • Documents

    • Domain experts

    • Developers, architects

  • Direct access to the interface under test

Tester


Outline1

Outline

  • Introduction

  • Examples

    • Software component testing – UniTesK

    • Formal language processor testing – OTK


The origin1

The Origin

  • 2001 – 2003ISP RAS – Intel project ontesting correctness of set of optimizers

    • Several dozens of bugs found


Restrictions

SUT

Restrictions

  • No access to actual functionality – only general processing algorithm descriptions

  • No access to unit interface –only external compiler interface

Tester


Proposed solutions1

Proposed Solutions

  • Program structure (abstracted of irrelevant elements) considered as test data model

  • Structured set of data generators

  • Checking optimizer correctness by comparison with nonoptimized program

  • Coverage goals

    • Processing algorithm is taken into account by model

    • Heuristics


Example simple expressions

BinaryExpr

Variable

Constant

value : int

op : {+,-,*,/}

id : string

Example: Simple Expressions

Test

stmts

1..*

Statement

xi = Expr

expr

1

var 1

Expression

left 1

right 1

xi

17

Expr1 + Expr2


Otk tool

OTK Tool


Test data generation

Test Data Generation

Processing Algorithm

Basic Blocks and Connectors

Combination Iterator

Language

Basic Blocks Mapping

if(…)…else …

for(…;…;…)

Test Data (Programs)


Optimizer correctness checking

Optimizer Correctness Checking

Test Program

Compiler

Compiler

Optimizer

Co-Testing

?

==


Further work

Further Work

  • The whole compiler testing

    • Syntax checker

    • Static semantics checker

    • Back-end

      • Formal semantics description needed

  • Tools integration

In work

?


References

References

  • V. Kuliamin, A. Petrenko, I. Bourdonov, and A. Kossatchev. UniTesK Test Suite Architecture. Proc. of FME 2002. LNCS 2391, pp. 77-88, Springer-Verlag, 2002.

  • V. Kuliamin, A. Petrenko, N. Pakoulin, I. Bourdonov, and A. Kossatchev. Integration of Functional and Timed Testing of Real-time and Concurrent Systems. Proc. of PSI 2003. LNCS 2890, pp. 450-461, Springer-Verlag, 2003.

  • A. Kossatchev, A. Petrenko, S. Zelenov, S. Zelenova. Using Model-Based Approach for Automated Testing of Optimizing Compilers. Proc. Intl. Workshop on Program Undestanding, Gorno-Altaisk, 2003.

  • V. Kuliamin, A. Petrenko, A. Kossatchev, and I. Burdonov. The UniTesK Approach to Designing Test Suites. Programming and Computer Software, Vol. 29, No. 6 , 2003, pp. 310-322. (Translation from Russian)

  • S. Zelenov, S. Zelenova, A. Kossatchev, A. Petrenko. Test Generation for Compilers and Other Formal Text Processors. Programming and Computer Software, Vol. 29, No. 2 , 2003, pp. 104-111. (Translation from Russian)


Contacts

Contacts

Alexander K. Petrenko Victor V. Kuliamin

[email protected] [email protected]

109004, B. Kommunisticheskaya, 25

Moscow, Russia

Web: http://www.ispras.ru/groups/rv/rv.html

Phone: +7-095-9125317

Fax: +7-095-9121524


  • Login