project overview
Download
Skip this Video
Download Presentation
Project Overview

Loading in 2 Seconds...

play fullscreen
1 / 15

Project Overview - PowerPoint PPT Presentation


  • 114 Views
  • Uploaded on

Project Overview. Wolfgang Herzner Smart Systems Division. Objectives. To significantly enhance testing and verification of dependable embedded systems by means of automated generation of efficient test cases

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Project Overview' - deana


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
project overview

Project Overview

Wolfgang Herzner

Smart Systems Division

objectives
Objectives
  • To significantly enhance testing and verification of dependable embedded systems
    • by means of automated generation of efficient test cases
    • relying on development of new approaches as well as innovative integration of state-of-the-art techniques

Goal: reduce testing effort by at least 20%

  • To address both testing of
    • non-functional issues like reliability, e.g. by system stress or overload tests
    • and functional safety tests
  • To apply these technologies in large industrial systems,
    • simultaneously enabling application domain experts (with rather little knowledge and experience in usage of formal methods) to use them with minimal learning effort
approach
Approach
  • Define common modelling languages and semantics for domain specific requirements and (partial) models of the demonstrators
  • Define test theory that defines
    • conformance relation between the model and implementation
    • notion of success and failure of a test case
  • Define fault models
    • and extend the modelling languages to allow the integration of the representation of faults into the (application) models
  • Define new coverage criteria, and use existing TCG techniques to generate efficient test cases that achieve this coverage
  • Use model-based fault injection (MBFI) to extend models for automatically calculating minimal cut sets
  • Validate the defined fault models (and thus the generated test cases) with physical fault injection
  • Use (bounded) model checking techniques to generate stress test scenarios
  • Provide a framework for semantics-aware transformations from system models to inputs of specific tools, e.g. to enable interaction of generated models with existing simulation environments for allowing evaluation of model coverage
key figures
Key Figures
  • Duration:
    • 36 months (Jan.2008 – Dec. 2010)
  • Costs:
    • 4,4 M€ Total
    • 3,1 M€ Funding
  • Efforts:
    • 400,5 PM RTD
    • 48,5 Demo
    • 12,0 Mgmt
consortium
Consortium

Research organisation

University

Tool developer

End user (industrial demonstrator)

wp 1 requirements and state of the art
WP 1 – Requirements and State of the Art
  • Tasks

T1.1 Definition of Scope (select requirements relevant for modelling and TCG)

T1.2 Preparation of Requirements and Support to Partners

T1.3 Requirements Analysis and Features Identification

T1.4 State of the Art Survey (know-how of all partners)

T1.5 Demonstrators Background (including outline of first specification of the final demonstrators)

  • Deliverables

D1.1a (M 6) Requirements and Needed Model Elements for Tests and the Industrial Demonstrators (report)

      • including information about existing demonstrator (component)s, as well as an high-level spec. of demonstrators (WP6/7)

D1.2 (M 6) Survey on Test Case Generation Techniques (report)

D1.1b (M 18) Updated version of D1.1a (report)

wp 2 framework
WP 2 - Framework
  • Tasks

T1.1 Tool Interoperability: model transformations

      • from core modelling languages to analysis and TCG tools
      • between tools selected or newly developed in WP3 and WP4
      • to achieve
        • semantics preservation
        • requirements traceability
        • seamless integration into existing development processes

T1.2 Interfaces to Existing Development and Testing Environments, e.g.

      • TRSS\'s ELEKTRA HMI (to visualise and operate the created models)
      • PROL\'s ELPULT or FFA\'s AVS (to apply generated test cases)

T1.3 Framework Implementation (of model transformations)

      • (select environment, e.g. VIATRA, Eclipse?)
  • Deliverables

D2.1 (M 12) Framework Specification (report)

D2.2a (M 18) First Framework Implementation (software, user guide, report)

D2.2b (M 24) Pre-final Framework Implementation (software, user guide, report)

D2.2c (M 36) Updated Framework Implementation (software, user guide, report)

wp 3 modelling and testing theory
WP 3 - Modelling and Testing Theory
  • Tasks

T3.1 Modelling Languages

      • considering MDA (PIM  PSM)

T3.2 Formal Verification of Application Specific Models (considering ontologies)

T3.3 Fault Models, considering

      • Systematic insertion of faults into the model
      • Fault meta-modelling
      • Abstraction

T3.4 Testing Theory

T3.5 Test Coverage Criteria

  • Deliverables

D3.1a/b (M 12/24) Fault Models (report)

D3.2a/b (M 18/30) Modelling Languages (report, software)

D3.3a/b (M 18/30) Ontology-Based Model Verification (report, software)

D3.4a/b (M 18/30) Testing Theories and Coverage Criteria (report)

wp 4 algorithms tools and fault injection
WP 4 - Algorithms, Tools, and Fault Injection
  • Tasks

T4.1 Fault-based Methods for Test Case Generation

      • investigate whether fault effects produced with formal verification methods (e.g. model checking) can be used when generating test suites

T4.2 Minimal Cut Sets Based Fault Injection (MCSBFI)

T4.3 Combined Approach using Fault Injection and Formal Methods

      • using T4.1 and T4.2 results, e.g. mutation-based testing

T4.4 Model-based Fault Injection Mechanisms

      • develop FI methods on model elements (signals and operators)

T4.5 Development of Tools

  • Deliverables

D4.1 (M 12) Fault-based Test-Case Generation Methods (report)

D4.2 (M 18) Minimal Cut Sets Based Fault Injection (report, software)

D4.3 (M 18) Mutation Testing Based Test Case Generation (report, software)

D4.4 (M 24) Integrated Testing Methods and Techniques (report)

D4.5 (M 30) Test Case Generators and Fault Injection Tools (report, software)

wp 5 test case generation and assessment
WP 5 - Test-Case Generation and Assessment
  • Tasks

T5.1 Simulating Hardware Related Faults at Model Level

      • investigate whether results derived with physical fault injection could be derived already at the modelling phase

T5.2 Modelling and TCG of Rail Signalling Control Systems (TRSS)

T5.3 Modelling and applying TCG Techniques for State Decoders of Railway Interlocking Systems (PROL)

T5.4 Applying TCG tools for ISOBUS-testing in Off-Highway Machines (RELAB)

T5.5 Applying TCG for In-the-Loop Testing of In-Car Systems (FFA)

  • Deliverables

D5.1 (M 30) Simulating Hardware Related Faults at Model Level (report, test vectors)

D5.2a/b (M 24/33) TCG for Functional and Stress Tests of Rail Signalling Interlocking Systems (report, test cases)

D5.3a/b, D5.4a/b, D5.5a/b … analogue for T5.3, T5.4 T5.5

D5.6 (M36) Assessment report

wp 6 railway demonstrators

TRSS

PROL

WP 6 – Railway Demonstrators
  • Tasks

T6.1 Setup of Railway Interlocking Demonstrator

T6.2 Execution and Evaluation of Generated (Stress) Tests

T6.3 Setup of Railway Objects State Decoder and Simulator Demonstrator

T6.4 Execution and Evaluation of Test Cases Generated for State Decoder and Simulator

  • Deliverables

D6.1 (M 30) Setup of Railway Interlocking Demonstrator. (HW/SW)

D6.2 (M 30) Setup of Railway State Decoder Demonstrator. (HW/SW)

D6.3 (M 36) Test Results and Final Methods Evaluation of Railway Interlocking Demonstrator (report)

D6.4 (M 36) Test Results and Final Methods Evaluation of Railway State Decoder Demonstrator (report)

wp 7 automotive demonstrators

FFA

PROL

WP 7 – Automotive Demonstrators
  • Tasks

T6.1 Setup of the Automotive Demonstrator

T6.2 Evaluation of Test cases Generated for the Automotive Demonstrator

T6.3 Setup of the ISOBUS Off-Highway Demonstrator

T6.4 Evaluation of the TCG (for the ISOBUS Off-Highway Demonstrator)

  • Deliverables

D7.1 (M 30) Setup of Automotive Demonstrator. (HW/SW)

D7.2 (M 30) Setup of Off-Highway Demonstrator. (HW/SW)

D7.3 (M 36) Test Results and Final Methods Evaluation of Automotive Demonstrator (report)

D7.4 (M 36) Test Results and Final Methods Evaluation of Off-Highway Demonstrator (report)

wp 8 dissemination and exploitation
WP 8 - Dissemination and Exploitation
  • Tasks

T8.1 Dissemination

      • website
      • publications, workshop participation, …

T8.2 Exploitation

      • mainly by industrial partners

T8.3 Standardisation

      • input about result usability to functional safety stds.

T8.4 IPR Management

  • Deliverables

D8.1 (M 3) Project website installed and operative

D8.2a/b/c (M 12/24/36) Dissemination report

D8.3 (M 24) Public Workshop presenting MOGENTES Intermediate Results and panel discussion for stakeholders feed back

schedule

c

c

f

c

6

5

4

3

3

4

4

2

.

2

3

.

.

.

6

.

.

.

.

.

.

5

8

6

6

7

7

3

2

8

0

8

D

D

D

D

D

D

D

D

D

D

5

3

4

3

b

b

b

b

2

4

5

3

.

.

.

.

3

5

5

5

5

3

D

D

D

D

2

3

1

3

b

b

b

e

1

2

1

2

5

.

.

2

3

4

4

.

.

.

0

7

7

.

.

.

.

6

6

4

3

3

3

3

8

D

D

D

D

D

D

D

D

D

9

2

8

2

7

2

6

2

5

2

b

b

b

b

d

1

4

3

3

2

1

2

4

.

.

.

.

.

.

.

.

4

4

5

8

0

2

3

8

8

2

D

D

D

D

D

D

D

D

3

2

2

2

1

2

0

2

9

1

a

a

a

a

a

a

a

a

c

b

2

3

2

2

3

4

2

3

4

5

.

.

1

4

.

.

.

.

.

.

.

.

.

8

.

4

4

2

3

3

3

5

5

5

5

1

1

8

D

D

D

D

D

D

D

D

D

D

D

D

7

1

6

1

5

1

4

1

3

1

a

b

a

a

1

1

2

4

3

1

.

.

.

.

2

.

.

2

4

8

8

1

3

0

D

D

D

D

D

D

1

1

0

1

9

8

7

a

a

2

4

1

.

.

.

6

1

8

1

D

D

D

5

4

1

1

2

.

.

.

8

0

0

3

D

D

D

2

1

.

n

.

s

o

e

t

.

n

l

G

n

m

p

o

.

k

e

o

i

e

r

x

e

t

o

m

a

E

D

s

I

m

w

F

a

n

e

.

e

&

y

r

i

e

,

C

r

m

d

i

D

u

s

.

r

o

m

t

l

o

s

o

q

l

e

o

i

s

t

a

s

a

u

o

e

h

o

e

r

i

A

R

C

R

D

F

T

T

T

:

:

:

:

:

:

:

:

:

6

7

8

0

1

2

3

4

5

P

P

P

P

P

P

P

P

P

W

W

W

W

W

W

W

W

W

Schedule
ad