Test cases
Sponsored Links
This presentation is the property of its rightful owner.
1 / 110

การออกแบบงานวิจัย และการสร้าง Test Cases ในการทดสอบ PowerPoint PPT Presentation


  • 75 Views
  • Uploaded on
  • Presentation posted in: General

การออกแบบงานวิจัย และการสร้าง Test Cases ในการทดสอบ. อาจารย์ ดร. ชลทิพย์ ยาวุธ อาจารย์ ดร. ผุสดี บุญรอด. Reading Unit in Information Technology Faculty of Information Technology King Mongkut's University of Technology North Bangkok. การออกแบบงานวิจัย ( Research Design ).

Download Presentation

การออกแบบงานวิจัย และการสร้าง Test Cases ในการทดสอบ

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Test Cases

.

.

Reading Unit in Information TechnologyFaculty of Information TechnologyKing Mongkut's University of Technology North Bangkok


(Research Design)

(Plan) (Design)

..






  • E-R Diagram (ERD)

  • Data Dictionary : DD

  • Data Flow Diagram

  • Unified Modeling Language (UML)


E-R Diagram (ERD)

  • Conceptual Level

  • ERD (Entity Relationship Diagram)


Examples

GPA

Regist_no

Stu_lname

Major_no

Fac_name_t

Stu_name

Fac_no

Fac_name_e

Fac_name_a

Stu_no

Level_no

Fac_no

Student

n

1

Faculty

1

n

1

have

Regist_no

1

1

regist

Stu_no

study

have

have

Major_no

1

Subject_no

Registration

1

n

Maor_name_e

n

Semester

have

1

Level

Major

Major_name_t

Fac_no

Year

Major_name_a

Level_Desc

Level_no

Level_name

Fac_no


  • (Data Dictionary : DD)


Users


Data Flow Diagram (DFD)

  • A graphic tool used to portray the flow of data through a system.

  • For documenting the old system as well as beginning to create the new one.

  • Shows a highly useful partitioning of the system into tasks (activities, functions) and subtasks.


Context Diagram


DFD Level 0


DFD Level 1 Process 1


DFD Level 1 Process 2


DFD Level 1 Process 3


DFD Level 1 Process 4


DFD Level 1 Process 5


Unified Modeling Language (UML)

  • UML (Standard Modeling Language)

  • UML (Diagram) ,


Use Case Diagram

Use Case


Activity Diagram

  • Activity Diagram use case ( Sequence Diagram Collaboration Diagram) Flowchart

  • Activity Diagram Swimlane Object Swimlane Object


Activity Diagram

Activity Diagram ATM


Class Diagram

  • Class Diagram Class Class (Problem Domain) Class , , , ,


Name

Attributes

Methods

Class Diagram

  • Class

    • Class Name Class

    • Attributes Class

    • Operations Methods Object


Class Diagram

Class Diagram


Sequence Diagram

  • Sequence Diagram Use Case (Message) Object

  • Sequence Diagram 2 (Lifeline) (Message) Object Class


Sequence Diagram

Sequence Diagram ATM


Collaboration Diagram

  • Collaboration Diagram Sequence Diagram Sequence Diagram Collaboration Diagram Object


Collaboration Diagram

Collaboration Diagram ATM


Statechart Diagram

  • Sequence Diagram Class

Statechart Diagram


Component Diagram

  • Component Diagram (Components) Software Source Code, Executable Program, Binary Text User Interface


Component Diagram

Component Diagram


Deployment Diagram

  • Deployment Diagram Hardware Software



()


()


[12] 2-1

(TC)= (2-1)

Equation Copy


1


2


Story Board

........

XXXXXXXXXXXXXXXXXXXX


Diagram

  • Diagram

  • Balance

  • Diagram

  • Normalization


  • Performance comparison

  • Implement

  • New Approach

  • Improvement

  • Analysis

  • Study

  • Trend

  • Survey


Performance comparison

  • Joomla 1.5 & Drupal 6.1Performance Comparison

  • Performance Comparison of Major Web Browsers

  • Performance comparision CakePHP and symfony

  • Performance Comparison of Mobile Ad-hoc Network Routing Protocol

  • Ad-hoc and Hybrid Networks Performance Comparison of MANET Routing Protocols in Ad-hoc and Hybrid Networks

  • A Performance Comparison of Wireless Ad Hoc Network Routing Protocols under Security Attack


Implement

  • How to Implement DHTs (Distributed Hash Tables) in Mobile Ad Hoc Networks?

  • Physical Implementation and Evaluation Ad Hoc Network Routing Protocols Unmodied Simulation Models

  • Design and Implementation of Ad-hoc Communication and Application on Mobile Phone Terminals

  • Grid Computing Implementation in Ad Hoc Networks

  • Automated Position System Implementation over Vehicular Ad Hoc Networks in 2-Dimension Space


New Approach

  • A New Approach to Service Discovery in Wireless Mobile Ad Hoc Networks

  • A New Approach to Channel Access Scheduling for Ad Hoc Networks

  • A REINFORCEMENT LEARNING APPROACH FOR SECURE ROUTING IN MOBILE AD HOC NETWORKS

  • A New Approach to Adaptive Multi-routing Protocol for Mobile Ad Hoc Network


Improvement

  • Link Failure Detection Improvement for Wireless Ad Hoc Networks

  • Active Packets Improve Dynamic Source Routing for Ad-hoc Networks

  • On the Capacity Improvement of Ad Hoc Wireless Networks Using Directional Antennas

  • Performance Improvement of Ad-Hoc Networks by Using a Behavior-Based Architecture

  • Improvement of TCP Performance in Ad Hoc Networks Using Cross Layer Approach


Analysis

  • Ad Hoc Wireless Networks : Analysis, Protocols, Architecture and Towards Convergence

  • Throughput-Delay Analysis of Mobile Ad-hoc Networks with a Multi-Copy Relaying Strategy

  • Performance Analysis of Mobile Ad-hoc Network Using AODV Protocol

  • Scenario based Performance Analysis of AODV and OLSR in Mobile Ad hoc Networks

  • Performance Analysis of Ad hoc Routing Protocols in Mobile WiMAX Environment

  • Centrality Analysis in Vehicular Ad Hoc Networks


Study

  • Ad Hoc Networks: Study of Protocol Behaviour

  • Study of Connectivity in Wireless Ad-hoc Networks with an Improved Radio Model

  • Study on Address Allocation in Ad-Hoc Networks

  • Wi-Fi in Ad Hoc Mode: A Measurement Study

  • Study of connectivity in vehicular ad hoc networks


Trend

  • Trends in Middleware for Mobile Ad Hoc Networks

  • Current Trends in Vehicular Ad Hoc Networks

  • Ultra Wide Band (UWB) Ad-hoc Networks: Review and Trends

  • Current Trends in Vehicular Ad Hoc Networks

  • Applications and Future Trends in Mobile Ad Hoc Networks

  • Future Trends on Ad-hoc and Sensor Networks (FT-ASN)

  • A Study of Recent Research Trends and Experimental Guidelines in Mobile Ad-hoc Networks


Survey

  • A Survey of Mobile Ad Hoc network Routing Protocols

  • A Survey on Wireless Ad Hoc Networks

  • A survey of clustering schemes for mobile ad hoc networks

  • Mobility Models for Vehicular Ad Hoc Networks: A Survey and Taxonomy

  • SURVEY AND TAXONOMY OF UNICAST ROUTING PROTOCOLS FOR MOBILE AD HOC

  • Security Issues in Mobile Ad Hoc Networks - A Survey

  • A survey of mobility models for ad hoc

  • Mobility Models for Systems Evaluation A Survey


Test Methodology

52


Test Process

Role and Responsibility

V Model

Test Technique

Test Type

Test Flow

Documents

Test Tool

AGENDA

53


Test

Test User Business Requirement (Error) User

"

Test

Error Phase Application requirement analysis, design and build Error Test (Quality) (Risk) Error (bug) % error = 0%

% error 0% priority Case Case error error Priority Case Critical Case

TEST PROCESS

54


(Limitation of testing)

>> Knowledge

>> Time

>> Resource (Human, Software, Hardware)

>> UnlimitedChange Requirement (not good)

(when to stop testing)

>> Meet Objective Plan

>> Exit Criteria exit criteria

TEST PROCESS (CONT)

55


Programmer Tester (View)

Test

TEST PROCESS (CONT)

56


Test Process (cont)

Test Creation

Test

Planning

NO

Cover all

requirements?

Create Test

Scenario

Create Test

Case

Review Test

Case

Requirement

Analysis

Create test

coverage

matrix

YES

Test Execution

Test Preparation

Record Defect

Log

Analyze Defect

Execute

PASS?

Run Test Case

Test

Environment

Set up

NO

Record Test

Result

Create .

Summary

Test Report

Create

Test data

YES

  • Test Planning

  • Test strategy Application

  • Test schedule Task

  • Test Resource Resource Human , S/W, H/W Time

57


ROLE AND RESPONSIBILITY

58


V MODEL

59


V Model Methodology Stage

Test validate & verify Requirement phase

Left side V activity Analysis Requirement and Design Design Build

Right side V Testing activity Build focus individual component focus Functional , non-functional Business Requirement

Verification and Validation

Verification

is the process confirming that something meets its specification

Do we build the system right?

Validation

is the process confirming that it meets the users requirements

Do we build the right software?

V MODEL (CONT)

60


Software quality triangle

Software

Gap

Gap

User Requirement

Requirement Specification

Gap

Software

User requirement, software , Requirements Specification

61


Software quality triangle (cont)

1. User requirements Requirements specification Gap

Developer Requirement User

  • Misunderstood requirements

  • Ignored requirements

  • Missing requirements

  • Outdated requirements

  • Unneeded requirements

    2. Requirements specification - Software Gap

    Software Requirement specification

  • Requirement not identified in the specification

  • Changes to requirements identified after development commenced

  • Wrong interpretation of requirement due to vagueness and ambiguity in the specification

  • Features added by the developers to exploit technical opportunities

  • Features removed by the developers because they were too difficult to implement

62


Software quality triangle (cont)

Software

  • SA Poor understanding of user requirements

  • Corrected during software development

  • Software meets user requirements

  • (software Developer software )

3. Software User requirements Gap

Software Requirement User

re-work software user

  • Shapes of Software Quality Triangles

    3 Quality Triangle

63


Software quality triangle (cont)

  • SA,DEV Poor understanding of user requirements

  • Good software development

  • Software does not meets user requirements

  • (Developer Software Requirement Spec. Software User)

Software

  • SA Good understanding of user requirements

  • Poor software development

  • Software does not meets user requirements

  • (Developer Requirement Software Requirement)

Better alignment

  • Poor understanding of user requirements

  • Poor software development

  • Software does not meets user requirements

  • ( )

64


Test Technique

Software

White Box

Internal Quality

External Quality

Black Box

User Requirement

Requirement Specification

65


Black Box Testing

>> Code

>> Function output

Technique Black box testing

Equivalence partitioning

1 Apply

ATM 100 500

TEST TECHNIQUE

66


Black Box Testing

50 ( < 100 )

200 ( 100 - 500 )

1000 ( > 500 )

data 3

Boundary value analysis

input data ATM 100 500

99

100

101

499

500

501

TEST TECHNIQUE (CONT)

67


White Box Testing

>>

>> Programming

Technique white box testing

Statement Coverage

Unit Test

Statement exception error

Test Technique

Branch Coverage

case case

statement testing

or and

TEST TECHNIQUE

68


Program 2

Functional Test

Technique Test Black box

Functional Test Tester

What a system does

Non-Functional Test

How well the system works

verify capacity, reliability H/W S/W Performance Test, Reliability Test

Non-function Test

Performance Test

Reliability

Usability

Load Test

Stress Test

TEST TYPE

69


Level Test Planning Test Strategy

Test Program Requirement user

Level of Testing

Unit test(white box & black box testing technique)

Integration Test (For small size)

System Test

Functional

Non-Functional Test

Performance Test

Load Test

Stress Test

Security Test

Reliability / Availability Test

Disaster & Recovery Test (data backup & data recovery Test)

Horizontal Scalable

System Integration Test (SIT For large size)

End to End Test (E2E)

Regression Test

User Acceptance Test (UAT)

Alpha (in-house test)

Beta

LEVEL OF TESTING(cont)

70


Performance Testing Requirement

objectives of performance testing

problems in performance testing

Understand measurement in performance test

Able to select types of performance test appropriately

LEVEL OF TESTING(cont)

71


Unit Test

module

design

Response by : Programmer

Skill:Programming skill, Internal program design

Test technique:Black box and White box

Test environment:Develop environment

Integration Test

Function Integrate unit /

module Interface

Client/Server distributed system

Response by : Programmer, Tester or QA

Skill:Programming skill, Testing skill

Test technique:Black box and White box

Test environment:Develop environment and Test environment

LEVEL OF TESTING (cont)

72


System Test

Verify Requirement

Functional Non-Functional Test

Requirement User

Response by : Tester or QA

Skill:Testing skill

Test technique:Black box

Test environment:Test environment

System Integration Test

Verify

Requirement verify Network integration Product integration

Infrastructure Operating system, file system, hardware,

middleware, network configuration

Response by : Tester or QA

Skill:Testing skill

Test technique:Black box

Test environment:Test environment

LEVEL OF TESTING (cont)

73


Regression Test

(change)

Regression test

Test Case Test verify Function

Function function

Upgrade software oracle8i oracle10g Application verify upgrade oracle application

Response by : Tester / QA

Skill:Testing skill

Test technique:Black box

Test environment:Test environment

** Requirement

LEVEL OF TESTING (cont)

74


User Acceptance Test

Confirm business requirement User Verify Validate

Requirement

environment (production)

ALPHA : on developer site

in-house User Tester/ QA

BETA : on customer site

User environment software Error Developer

Response by : User

Skill:Testing skill

Test technique:Black box

Test environment:Test environment (Realistic & Representative)

LEVEL OF TESTING (cont)

75


Load Test

performance Time

Transaction Response time Business

Requirement User 2

- Response time : The end to end response time associated with a specific user- system interaction

- Throughput :The ability of the business system to execute a given number of businesses or system related processes within a given unit of time

Response by : Tester / QA

Skill:Testing skill specify performance testing

Test technique:Black box

Test environment:Test environment (Realistic & Representative)

Test tool:

>> Load Runner ( Web application or windows application) RequestTime Interval load load Memory

>> Script unix shell script ( Process)

LEVEL OF TESTING (cont)

76


Stress Test

Capacity limitation

down

Response by : Tester / QA / Developer

Skill:Testing skill specify performance testing

Test technique:Black box

Test environment:Test environment (same as production environment)

LEVEL OF TESTING (cont)

77


Security Test (Non-functional)

hack

Password rules (Single sign on, LDAP)

Access rights (user roles, file system security)

Set time outs

Response by : Tester / QA / Developer

Skill:Testing skill, network security, programming skill

Test technique:Black box

Test environment:Test environment (Realistic & Representative)

LEVEL OF TESTING (cont)

78


Availability & Reliability test

down

2

Disaster & Recovery Test (data backup & data recovery Test)

Data Backup

To perform regular and ad-hoc back-ups as part of normal operational life-cycle and perform backups of data prior to, or during batch processing.

Data Recovery

Backed up data can be re-loaded and the system fully restored to the back-up point without loss or corruption of data.

Recovery data at each commit point within an on-line transaction process without corruption of existing data.

To verify maximum recovery time (SLA)

Rollback data entry or batch process without corruption or loss of data

** requirement

LEVEL OF TESTING (cont)

79


Availability & Reliability test (cont)

Horizontal Scalable

request response time upgraderequest 2CPURam (Load Balance)

spec hardware CPU RAM

Response by : Developer / DBA

Skill:Technical skill

Test technique:Black box

Test environment:Test environment (same as production environment)

** requirement

LEVEL OF TESTING (cont)

80


Test FLOW

P

R

O

D

U

C

T

I

O

N

* SIT

* Regression Test

Unit Test

Integration Test

System Test

UAT

* Performance Test

* Security Test

* Disaster & Recovery Test

* Horizontal Scalable Test

* Means optional testing stage

81


Documents (cont)

Test Planning

Test Specification / Test Design

Test Specification / Test Design

Test Specification / Test Design

Test Case/ Test Script

Test Case/ Test Script

Test Case/ Test Script

Requirement traceability

matrix

Requirement traceability

matrix

Requirement traceability

matrix

Test Result

Test Result

Test Result

Defect Log

Defect Log

Defect Log

Test Summary Report

Test Summary Report

Test Summary Report

Integration Test

System Test

System Integration Test

82


Documents

Input Document

Requirement ( Project Proposal, High Level Architecture Design etc.)

Program Specification ( Software Requirement Specification, Program Specification, Functional Specification etc.)

Work flow process

Output Document (deliverable document)

Test Plan

Test Specification / Test Design*

Test Scenario

Test Case / Test Script

Requirement traceability matrix

Test Summary Report *

Defect Log

Test Result

*Optional document

83


Documents (cont)

Requirement Document

84


Documents (cont)

Program specification Document

85


Documents (cont)

Work Flow Process

86


Documents(cont)

Output (Deliverable Document)

Test Phase Requirement Analysis

Build

Test Planning

High Level

objective , Test strategy , Role &

Responsibility Test Plan

Test strategy Application

>> A Interface Unit test -> Integration Test ( module ) -> System Test -> UAT

>> B Interface Transaction Unit test -> Integration Test ( module ) -> System Test -> System Integration Test (SIT) ->Regression Test -> UAT

Non-Functional Performance Test, Security Test, Disaster& Recovery Test , Scalable Test Test Business Requirement

Test schedule Task

Test Resource Resource Human , S/W, H/W Time

87


Documents (cont)

Test Plan Element

S[Scope] : What to test (In scope), what not to test (Out scope)

P[People] : Training, Responsibility, Schedule

A[Approach] : To testing

C[Criteria] : Entry / Exit Criteria

E[Environment] : Environment needs

D[Deliverables] : Deliverables as part of test process

I[Incidentals] : Introduction, Identification

R[Risks] : Risks and Contingencies

T[Tasks] : Tasks involves in testing

88


Documents (cont)

Test Planning Document

Test Scheduling

Test Strategy

89


Documents (cont)

Test Planning Document

Entry Criteria & Exit Criteria Test Level

90


Documents (cont)

Test Design / Test specification

Test condition Run Test

Input data

Input data Test Case

Test Design/ Test specification Test phase

Test Plan phase Test

91


Documents (cont)

Test Scenario

flow

storyboard Test Case

1

Test Scenario

92


Documents (cont)

Environment Set up Test Check list

Check list Set up / config

environment List

Environment Set up Test Check list

93


Documents (cont)

Environment Set up Test Check list

Environment Set up Test Check list

94


Documents (cont)

Test Case / Test Script

Test Case

Business Requirement

Step / procedure Set up Run Test Test Case

Test Case

Negative Case / Invalid Case

Positive Case / Valid Case

Test Case

Test Case login

Case Test

Expected Result ( Requirement)

Input Case

Step

Actual Result ( Program)

Test Result Test case PASS FAIL

95


Documents (cont)

Test Case

96


Documents (cont)

Test Coverage Matrix

Business requirement Test case control

Requirement

Test Coverage Matrix

Test Coverage Matrix

97


Documents (cont)

  • Test Result

    Test

    Result Test Case

    Test Result

98


Documents (cont)

Defect Log

Error (bug) Test Case

SA/ Developer analyze fix bug

Defect severity ( Error)

Project Error

99


Defect Log

Documents (cont)

Defect Log Defect Analysis

100


Documents (cont)

  • Test Summary Report

    Phase Test

    Test case Case Case Test Environment

    Error severity Case

    Summary Test Report

101


Documents (cont)

  • Test Summary Report

    Test Summary Report (cont)

102


Documents (cont)

Test Planning

Test Specification / Test Design

Test Specification / Test Design

Test Specification / Test Design

Test Case/ Test Script

Test Case/ Test Script

Test Case/ Test Script

Requirement traceability

matrix

Requirement traceability

matrix

Requirement traceability

matrix

Test Result

Test Result

Test Result

Defect Log

Defect Log

Defect Log

Test Summary Report

Test Summary Report

Test Summary Report

Integration Test

System Test

System Integration Test

Level of Documents

Level

103


Test Tool

Quick Test

Automate test tool Functional Test Regression Test Tester run test case Tool capture flow tool Tool

Resource/effort

Load Runner

Automate test tool Performance Test Load Test Capacity , Response time, throughput, bottleneck etc. bottleneck tuning performance

HP Quality Center (QC)

Quality Tool Module Test Requirements, Test Plan, Test Lab Defect Manager Requirement Test Case Test case Defect QC

QC alert mail defect defect re-test close defect Tool Track Status Test Case Requirement

104


Software Application Agile process

Agile Test Process Develop Application

Agile Real Time

Software

SA, Programmer, Business Analyze, Tester, manager Concept QA agile

support Developer Software Tester

Software Test

Developer Program

Agile Tester

Test Case Test Check List

Test Case

business requirement

Concept Agile Developer 1

. Developer demo program develop Tester

Test Developer

deploy program Tester

Error

AGILE Testing

105


System Integration Test (SIT/E2E) Developer

Demo Tester Program Check List

Code

Code Agile

Develop Program

Error

Developer

AGILE Testing (cont)

106


Agile development

Software IID (Iterative and Incremental Development) Extreme Programming (XP), Scrum, Crystal, Feature Driven Development (FDD)

Crystal Process

107


TEST CASE

  • Simulation Tools The ns-3 network simulator, QNAP2, OPNET, GloMoSim, NetSim

  • Test bed


Parameters

  • Node Density

  • Mobility Model

  • Performance metrics

  • Node velocity

  • Pause time

  • Traffic Type

  • Layer

  • Topology

  • Bandwidth


4

  • 4


  • Login