Test cases
This presentation is the property of its rightful owner.
Sponsored Links
1 / 110

การออกแบบงานวิจัย และการสร้าง Test Cases ในการทดสอบ PowerPoint PPT Presentation


  • 60 Views
  • Uploaded on
  • Presentation posted in: General

การออกแบบงานวิจัย และการสร้าง Test Cases ในการทดสอบ. อาจารย์ ดร. ชลทิพย์ ยาวุธ อาจารย์ ดร. ผุสดี บุญรอด. Reading Unit in Information Technology Faculty of Information Technology King Mongkut's University of Technology North Bangkok. การออกแบบงานวิจัย ( Research Design ).

Download Presentation

การออกแบบงานวิจัย และการสร้าง Test Cases ในการทดสอบ

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Test cases

Test Cases

.

.

Reading Unit in Information TechnologyFaculty of Information TechnologyKing Mongkut's University of Technology North Bangkok


Research design

(Research Design)

(Plan) (Design)

..


Test cases


Test cases


Test cases


Test cases


Test cases

  • E-R Diagram (ERD)

  • Data Dictionary : DD

  • Data Flow Diagram

  • Unified Modeling Language (UML)


E r diagram erd

E-R Diagram (ERD)

  • Conceptual Level

  • ERD (Entity Relationship Diagram)


Examples

Examples

GPA

Regist_no

Stu_lname

Major_no

Fac_name_t

Stu_name

Fac_no

Fac_name_e

Fac_name_a

Stu_no

Level_no

Fac_no

Student

n

1

Faculty

1

n

1

have

Regist_no

1

1

regist

Stu_no

study

have

have

Major_no

1

Subject_no

Registration

1

n

Maor_name_e

n

Semester

have

1

Level

Major

Major_name_t

Fac_no

Year

Major_name_a

Level_Desc

Level_no

Level_name

Fac_no


Test cases

  • (Data Dictionary : DD)


Users

Users


Data flow diagram dfd

Data Flow Diagram (DFD)

  • A graphic tool used to portray the flow of data through a system.

  • For documenting the old system as well as beginning to create the new one.

  • Shows a highly useful partitioning of the system into tasks (activities, functions) and subtasks.


Context diagram

Context Diagram


Dfd level 0

DFD Level 0


Dfd level 1 process 1

DFD Level 1 Process 1


Dfd level 1 process 2

DFD Level 1 Process 2


Dfd level 1 process 3

DFD Level 1 Process 3


Dfd level 1 process 4

DFD Level 1 Process 4


Dfd level 1 process 5

DFD Level 1 Process 5


Unified modeling language uml

Unified Modeling Language (UML)

  • UML (Standard Modeling Language)

  • UML (Diagram) ,


Use case diagram

Use Case Diagram

Use Case


Activity diagram

Activity Diagram

  • Activity Diagram use case ( Sequence Diagram Collaboration Diagram) Flowchart

  • Activity Diagram Swimlane Object Swimlane Object


Activity diagram1

Activity Diagram

Activity Diagram ATM


Class diagram

Class Diagram

  • Class Diagram Class Class (Problem Domain) Class , , , ,


Class diagram1

Name

Attributes

Methods

Class Diagram

  • Class

    • Class Name Class

    • Attributes Class

    • Operations Methods Object


Class diagram2

Class Diagram

Class Diagram


Sequence diagram

Sequence Diagram

  • Sequence Diagram Use Case (Message) Object

  • Sequence Diagram 2 (Lifeline) (Message) Object Class


Sequence diagram1

Sequence Diagram

Sequence Diagram ATM


Collaboration diagram

Collaboration Diagram

  • Collaboration Diagram Sequence Diagram Sequence Diagram Collaboration Diagram Object


Collaboration diagram1

Collaboration Diagram

Collaboration Diagram ATM


Statechart diagram

Statechart Diagram

  • Sequence Diagram Class

Statechart Diagram


Component diagram

Component Diagram

  • Component Diagram (Components) Software Source Code, Executable Program, Binary Text User Interface


Component diagram1

Component Diagram

Component Diagram


Deployment diagram

Deployment Diagram

  • Deployment Diagram Hardware Software


Test cases


Test cases

()


Test cases

()


Test cases

[12] 2-1

(TC)= (2-1)

Equation Copy


Test cases

1


Test cases

2


Story board

Story Board

........

XXXXXXXXXXXXXXXXXXXX


Diagram

Diagram

  • Diagram

  • Balance

  • Diagram

  • Normalization


Test cases

  • Performance comparison

  • Implement

  • New Approach

  • Improvement

  • Analysis

  • Study

  • Trend

  • Survey


Performance comparison

Performance comparison

  • Joomla 1.5 & Drupal 6.1Performance Comparison

  • Performance Comparison of Major Web Browsers

  • Performance comparision CakePHP and symfony

  • Performance Comparison of Mobile Ad-hoc Network Routing Protocol

  • Ad-hoc and Hybrid Networks Performance Comparison of MANET Routing Protocols in Ad-hoc and Hybrid Networks

  • A Performance Comparison of Wireless Ad Hoc Network Routing Protocols under Security Attack


Implement

Implement

  • How to Implement DHTs (Distributed Hash Tables) in Mobile Ad Hoc Networks?

  • Physical Implementation and Evaluation Ad Hoc Network Routing Protocols Unmodied Simulation Models

  • Design and Implementation of Ad-hoc Communication and Application on Mobile Phone Terminals

  • Grid Computing Implementation in Ad Hoc Networks

  • Automated Position System Implementation over Vehicular Ad Hoc Networks in 2-Dimension Space


New approach

New Approach

  • A New Approach to Service Discovery in Wireless Mobile Ad Hoc Networks

  • A New Approach to Channel Access Scheduling for Ad Hoc Networks

  • A REINFORCEMENT LEARNING APPROACH FOR SECURE ROUTING IN MOBILE AD HOC NETWORKS

  • A New Approach to Adaptive Multi-routing Protocol for Mobile Ad Hoc Network


Improvement

Improvement

  • Link Failure Detection Improvement for Wireless Ad Hoc Networks

  • Active Packets Improve Dynamic Source Routing for Ad-hoc Networks

  • On the Capacity Improvement of Ad Hoc Wireless Networks Using Directional Antennas

  • Performance Improvement of Ad-Hoc Networks by Using a Behavior-Based Architecture

  • Improvement of TCP Performance in Ad Hoc Networks Using Cross Layer Approach


Analysis

Analysis

  • Ad Hoc Wireless Networks : Analysis, Protocols, Architecture and Towards Convergence

  • Throughput-Delay Analysis of Mobile Ad-hoc Networks with a Multi-Copy Relaying Strategy

  • Performance Analysis of Mobile Ad-hoc Network Using AODV Protocol

  • Scenario based Performance Analysis of AODV and OLSR in Mobile Ad hoc Networks

  • Performance Analysis of Ad hoc Routing Protocols in Mobile WiMAX Environment

  • Centrality Analysis in Vehicular Ad Hoc Networks


Study

Study

  • Ad Hoc Networks: Study of Protocol Behaviour

  • Study of Connectivity in Wireless Ad-hoc Networks with an Improved Radio Model

  • Study on Address Allocation in Ad-Hoc Networks

  • Wi-Fi in Ad Hoc Mode: A Measurement Study

  • Study of connectivity in vehicular ad hoc networks


Trend

Trend

  • Trends in Middleware for Mobile Ad Hoc Networks

  • Current Trends in Vehicular Ad Hoc Networks

  • Ultra Wide Band (UWB) Ad-hoc Networks: Review and Trends

  • Current Trends in Vehicular Ad Hoc Networks

  • Applications and Future Trends in Mobile Ad Hoc Networks

  • Future Trends on Ad-hoc and Sensor Networks (FT-ASN)

  • A Study of Recent Research Trends and Experimental Guidelines in Mobile Ad-hoc Networks


Survey

Survey

  • A Survey of Mobile Ad Hoc network Routing Protocols

  • A Survey on Wireless Ad Hoc Networks

  • A survey of clustering schemes for mobile ad hoc networks

  • Mobility Models for Vehicular Ad Hoc Networks: A Survey and Taxonomy

  • SURVEY AND TAXONOMY OF UNICAST ROUTING PROTOCOLS FOR MOBILE AD HOC

  • Security Issues in Mobile Ad Hoc Networks - A Survey

  • A survey of mobility models for ad hoc

  • Mobility Models for Systems Evaluation A Survey


Test methodology

Test Methodology

52


Agenda

Test Process

Role and Responsibility

V Model

Test Technique

Test Type

Test Flow

Documents

Test Tool

AGENDA

53


Test process

Test

Test User Business Requirement (Error) User

"

Test

Error Phase Application requirement analysis, design and build Error Test (Quality) (Risk) Error (bug) % error = 0%

% error 0% priority Case Case error error Priority Case Critical Case

TEST PROCESS

54


Test process cont

(Limitation of testing)

>> Knowledge

>> Time

>> Resource (Human, Software, Hardware)

>> UnlimitedChange Requirement (not good)

(when to stop testing)

>> Meet Objective Plan

>> Exit Criteria exit criteria

TEST PROCESS (CONT)

55


Test cases

Programmer Tester (View)

Test

TEST PROCESS (CONT)

56


Test process cont1

Test Process (cont)

Test Creation

Test

Planning

NO

Cover all

requirements?

Create Test

Scenario

Create Test

Case

Review Test

Case

Requirement

Analysis

Create test

coverage

matrix

YES

Test Execution

Test Preparation

Record Defect

Log

Analyze Defect

Execute

PASS?

Run Test Case

Test

Environment

Set up

NO

Record Test

Result

Create .

Summary

Test Report

Create

Test data

YES

  • Test Planning

  • Test strategy Application

  • Test schedule Task

  • Test Resource Resource Human , S/W, H/W Time

57


Test cases

ROLE AND RESPONSIBILITY

58


Test cases

V MODEL

59


Test cases

V Model Methodology Stage

Test validate & verify Requirement phase

Left side V activity Analysis Requirement and Design Design Build

Right side V Testing activity Build focus individual component focus Functional , non-functional Business Requirement

Verification and Validation

Verification

is the process confirming that something meets its specification

Do we build the system right?

Validation

is the process confirming that it meets the users requirements

Do we build the right software?

V MODEL (CONT)

60


Test cases

Software quality triangle

Software

Gap

Gap

User Requirement

Requirement Specification

Gap

Software

User requirement, software , Requirements Specification

61


Test cases

Software quality triangle (cont)

1. User requirements Requirements specification Gap

Developer Requirement User

  • Misunderstood requirements

  • Ignored requirements

  • Missing requirements

  • Outdated requirements

  • Unneeded requirements

    2. Requirements specification - Software Gap

    Software Requirement specification

  • Requirement not identified in the specification

  • Changes to requirements identified after development commenced

  • Wrong interpretation of requirement due to vagueness and ambiguity in the specification

  • Features added by the developers to exploit technical opportunities

  • Features removed by the developers because they were too difficult to implement

62


Test cases

Software quality triangle (cont)

Software

  • SA Poor understanding of user requirements

  • Corrected during software development

  • Software meets user requirements

  • (software Developer software )

3. Software User requirements Gap

Software Requirement User

re-work software user

  • Shapes of Software Quality Triangles

    3 Quality Triangle

63


Test cases

Software quality triangle (cont)

  • SA,DEV Poor understanding of user requirements

  • Good software development

  • Software does not meets user requirements

  • (Developer Software Requirement Spec. Software User)

Software

  • SA Good understanding of user requirements

  • Poor software development

  • Software does not meets user requirements

  • (Developer Requirement Software Requirement)

Better alignment

  • Poor understanding of user requirements

  • Poor software development

  • Software does not meets user requirements

  • ( )

64


Test cases

Test Technique

Software

White Box

Internal Quality

External Quality

Black Box

User Requirement

Requirement Specification

65


Test cases

Black Box Testing

>> Code

>> Function output

Technique Black box testing

Equivalence partitioning

1 Apply

ATM 100 500

TEST TECHNIQUE

66


Test cases

Black Box Testing

50 ( < 100 )

200 ( 100 - 500 )

1000 ( > 500 )

data 3

Boundary value analysis

input data ATM 100 500

99

100

101

499

500

501

TEST TECHNIQUE (CONT)

67


Test cases

White Box Testing

>>

>> Programming

Technique white box testing

Statement Coverage

Unit Test

Statement exception error

Test Technique

Branch Coverage

case case

statement testing

or and

TEST TECHNIQUE

68


Test cases

Program 2

Functional Test

Technique Test Black box

Functional Test Tester

What a system does

Non-Functional Test

How well the system works

verify capacity, reliability H/W S/W Performance Test, Reliability Test

Non-function Test

Performance Test

Reliability

Usability

Load Test

Stress Test

TEST TYPE

69


Level of testing cont

Level Test Planning Test Strategy

Test Program Requirement user

Level of Testing

Unit test(white box & black box testing technique)

Integration Test (For small size)

System Test

Functional

Non-Functional Test

Performance Test

Load Test

Stress Test

Security Test

Reliability / Availability Test

Disaster & Recovery Test (data backup & data recovery Test)

Horizontal Scalable

System Integration Test (SIT For large size)

End to End Test (E2E)

Regression Test

User Acceptance Test (UAT)

Alpha (in-house test)

Beta

LEVEL OF TESTING(cont)

70


Level of testing cont1

Performance Testing Requirement

objectives of performance testing

problems in performance testing

Understand measurement in performance test

Able to select types of performance test appropriately

LEVEL OF TESTING(cont)

71


Test cases

Unit Test

module

design

Response by : Programmer

Skill:Programming skill, Internal program design

Test technique:Black box and White box

Test environment:Develop environment

Integration Test

Function Integrate unit /

module Interface

Client/Server distributed system

Response by : Programmer, Tester or QA

Skill:Programming skill, Testing skill

Test technique:Black box and White box

Test environment:Develop environment and Test environment

LEVEL OF TESTING (cont)

72


Test cases

System Test

Verify Requirement

Functional Non-Functional Test

Requirement User

Response by : Tester or QA

Skill:Testing skill

Test technique:Black box

Test environment:Test environment

System Integration Test

Verify

Requirement verify Network integration Product integration

Infrastructure Operating system, file system, hardware,

middleware, network configuration

Response by : Tester or QA

Skill:Testing skill

Test technique:Black box

Test environment:Test environment

LEVEL OF TESTING (cont)

73


Test cases

Regression Test

(change)

Regression test

Test Case Test verify Function

Function function

Upgrade software oracle8i oracle10g Application verify upgrade oracle application

Response by : Tester / QA

Skill:Testing skill

Test technique:Black box

Test environment:Test environment

** Requirement

LEVEL OF TESTING (cont)

74


Test cases

User Acceptance Test

Confirm business requirement User Verify Validate

Requirement

environment (production)

ALPHA : on developer site

in-house User Tester/ QA

BETA : on customer site

User environment software Error Developer

Response by : User

Skill:Testing skill

Test technique:Black box

Test environment:Test environment (Realistic & Representative)

LEVEL OF TESTING (cont)

75


Test cases

Load Test

performance Time

Transaction Response time Business

Requirement User 2

- Response time : The end to end response time associated with a specific user- system interaction

- Throughput :The ability of the business system to execute a given number of businesses or system related processes within a given unit of time

Response by : Tester / QA

Skill:Testing skill specify performance testing

Test technique:Black box

Test environment:Test environment (Realistic & Representative)

Test tool:

>> Load Runner ( Web application or windows application) RequestTime Interval load load Memory

>> Script unix shell script ( Process)

LEVEL OF TESTING (cont)

76


Test cases

Stress Test

Capacity limitation

down

Response by : Tester / QA / Developer

Skill:Testing skill specify performance testing

Test technique:Black box

Test environment:Test environment (same as production environment)

LEVEL OF TESTING (cont)

77


Test cases

Security Test (Non-functional)

hack

Password rules (Single sign on, LDAP)

Access rights (user roles, file system security)

Set time outs

Response by : Tester / QA / Developer

Skill:Testing skill, network security, programming skill

Test technique:Black box

Test environment:Test environment (Realistic & Representative)

LEVEL OF TESTING (cont)

78


Test cases

Availability & Reliability test

down

2

Disaster & Recovery Test (data backup & data recovery Test)

Data Backup

To perform regular and ad-hoc back-ups as part of normal operational life-cycle and perform backups of data prior to, or during batch processing.

Data Recovery

Backed up data can be re-loaded and the system fully restored to the back-up point without loss or corruption of data.

Recovery data at each commit point within an on-line transaction process without corruption of existing data.

To verify maximum recovery time (SLA)

Rollback data entry or batch process without corruption or loss of data

** requirement

LEVEL OF TESTING (cont)

79


Test cases

Availability & Reliability test (cont)

Horizontal Scalable

request response time upgraderequest 2CPURam (Load Balance)

spec hardware CPU RAM

Response by : Developer / DBA

Skill:Technical skill

Test technique:Black box

Test environment:Test environment (same as production environment)

** requirement

LEVEL OF TESTING (cont)

80


Test flow

Test FLOW

P

R

O

D

U

C

T

I

O

N

* SIT

* Regression Test

Unit Test

Integration Test

System Test

UAT

* Performance Test

* Security Test

* Disaster & Recovery Test

* Horizontal Scalable Test

* Means optional testing stage

81


Documents cont

Documents (cont)

Test Planning

Test Specification / Test Design

Test Specification / Test Design

Test Specification / Test Design

Test Case/ Test Script

Test Case/ Test Script

Test Case/ Test Script

Requirement traceability

matrix

Requirement traceability

matrix

Requirement traceability

matrix

Test Result

Test Result

Test Result

Defect Log

Defect Log

Defect Log

Test Summary Report

Test Summary Report

Test Summary Report

Integration Test

System Test

System Integration Test

82


Documents

Documents

Input Document

Requirement ( Project Proposal, High Level Architecture Design etc.)

Program Specification ( Software Requirement Specification, Program Specification, Functional Specification etc.)

Work flow process

Output Document (deliverable document)

Test Plan

Test Specification / Test Design*

Test Scenario

Test Case / Test Script

Requirement traceability matrix

Test Summary Report *

Defect Log

Test Result

*Optional document

83


Documents cont1

Documents (cont)

Requirement Document

84


Documents cont2

Documents (cont)

Program specification Document

85


Documents cont3

Documents (cont)

Work Flow Process

86


Documents cont4

Documents(cont)

Output (Deliverable Document)

Test Phase Requirement Analysis

Build

Test Planning

High Level

objective , Test strategy , Role &

Responsibility Test Plan

Test strategy Application

>> A Interface Unit test -> Integration Test ( module ) -> System Test -> UAT

>> B Interface Transaction Unit test -> Integration Test ( module ) -> System Test -> System Integration Test (SIT) ->Regression Test -> UAT

Non-Functional Performance Test, Security Test, Disaster& Recovery Test , Scalable Test Test Business Requirement

Test schedule Task

Test Resource Resource Human , S/W, H/W Time

87


Documents cont5

Documents (cont)

Test Plan Element

S[Scope] : What to test (In scope), what not to test (Out scope)

P[People] : Training, Responsibility, Schedule

A[Approach] : To testing

C[Criteria] : Entry / Exit Criteria

E[Environment] : Environment needs

D[Deliverables] : Deliverables as part of test process

I[Incidentals] : Introduction, Identification

R[Risks] : Risks and Contingencies

T[Tasks] : Tasks involves in testing

88


Documents cont6

Documents (cont)

Test Planning Document

Test Scheduling

Test Strategy

89


Documents cont7

Documents (cont)

Test Planning Document

Entry Criteria & Exit Criteria Test Level

90


Documents cont8

Documents (cont)

Test Design / Test specification

Test condition Run Test

Input data

Input data Test Case

Test Design/ Test specification Test phase

Test Plan phase Test

91


Documents cont9

Documents (cont)

Test Scenario

flow

storyboard Test Case

1

Test Scenario

92


Documents cont10

Documents (cont)

Environment Set up Test Check list

Check list Set up / config

environment List

Environment Set up Test Check list

93


Documents cont11

Documents (cont)

Environment Set up Test Check list

Environment Set up Test Check list

94


Documents cont12

Documents (cont)

Test Case / Test Script

Test Case

Business Requirement

Step / procedure Set up Run Test Test Case

Test Case

Negative Case / Invalid Case

Positive Case / Valid Case

Test Case

Test Case login

Case Test

Expected Result ( Requirement)

Input Case

Step

Actual Result ( Program)

Test Result Test case PASS FAIL

95


Documents cont13

Documents (cont)

Test Case

96


Documents cont14

Documents (cont)

Test Coverage Matrix

Business requirement Test case control

Requirement

Test Coverage Matrix

Test Coverage Matrix

97


Documents cont15

Documents (cont)

  • Test Result

    Test

    Result Test Case

    Test Result

98


Documents cont16

Documents (cont)

Defect Log

Error (bug) Test Case

SA/ Developer analyze fix bug

Defect severity ( Error)

Project Error

99


Test cases

Defect Log

Documents (cont)

Defect Log Defect Analysis

100


Documents cont17

Documents (cont)

  • Test Summary Report

    Phase Test

    Test case Case Case Test Environment

    Error severity Case

    Summary Test Report

101


Documents cont18

Documents (cont)

  • Test Summary Report

    Test Summary Report (cont)

102


Documents cont19

Documents (cont)

Test Planning

Test Specification / Test Design

Test Specification / Test Design

Test Specification / Test Design

Test Case/ Test Script

Test Case/ Test Script

Test Case/ Test Script

Requirement traceability

matrix

Requirement traceability

matrix

Requirement traceability

matrix

Test Result

Test Result

Test Result

Defect Log

Defect Log

Defect Log

Test Summary Report

Test Summary Report

Test Summary Report

Integration Test

System Test

System Integration Test

Level of Documents

Level

103


Test tool

Test Tool

Quick Test

Automate test tool Functional Test Regression Test Tester run test case Tool capture flow tool Tool

Resource/effort

Load Runner

Automate test tool Performance Test Load Test Capacity , Response time, throughput, bottleneck etc. bottleneck tuning performance

HP Quality Center (QC)

Quality Tool Module Test Requirements, Test Plan, Test Lab Defect Manager Requirement Test Case Test case Defect QC

QC alert mail defect defect re-test close defect Tool Track Status Test Case Requirement

104


Test cases

Software Application Agile process

Agile Test Process Develop Application

Agile Real Time

Software

SA, Programmer, Business Analyze, Tester, manager Concept QA agile

support Developer Software Tester

Software Test

Developer Program

Agile Tester

Test Case Test Check List

Test Case

business requirement

Concept Agile Developer 1

. Developer demo program develop Tester

Test Developer

deploy program Tester

Error

AGILE Testing

105


Test cases

System Integration Test (SIT/E2E) Developer

Demo Tester Program Check List

Code

Code Agile

Develop Program

Error

Developer

AGILE Testing (cont)

106


Test cases

Agile development

Software IID (Iterative and Incremental Development) Extreme Programming (XP), Scrum, Crystal, Feature Driven Development (FDD)

Crystal Process

107


Test case

TEST CASE

  • Simulation Tools The ns-3 network simulator, QNAP2, OPNET, GloMoSim, NetSim

  • Test bed


Parameters

Parameters

  • Node Density

  • Mobility Model

  • Performance metrics

  • Node velocity

  • Pause time

  • Traffic Type

  • Layer

  • Topology

  • Bandwidth


Test cases

4

  • 4


  • Login