Evaluating Testing Methods by Delivered Reliability. Frankl, Hamlet, Littlewood, Strigini IEEE TOSE Aug98. 841fall06 exam1 question 1. (25 pts) Calculations – given the following table, estimate the E(Q) using the MFR est and the subdomain formula.
Frankl, Hamlet, Littlewood, Strigini
IEEE TOSE Aug98
2. (30 pts) Modeling
Assume that boundary testing randomly picks 2 test cases from
each subset that makes the two sides in a relational expression equal
(e.g. if the decision was “x < y”, the set would be those points where
the value of x was equal to the value of y.}
Boundary testing for the whole program will do this for
each relational expression.
Use Frankl’s formulas to estimate the E(Q) for this approach.
Consider the following program. Assume the operation profile is uniform and consists of all pairs of integers between 1 and 5.
E.g. (1,1) , (1,2), etc
cin >> a >> b;
out = “X”;
if (a > b + 1) out = “Y”;
if (a < 2*b ) out = “Z”;
Seed two faults:
Change “b+1” to “b+2”
Change “2*b” to “b”
4. (15 pts) Discussion
Suppose that your testing effort is restricted to n tests and you
have identified 2*n important subdomains in the product.
How do you decide which subdomains to test?
Can you use seeded faults to help select?
What faults would you seed?
TriangleDomain all combinations of integers 0 – 5Faults flt 1 - line 3: change a==b to a==a flt 2 – line 4: change “equilateral” to “isosceles” flt 3 – line 5: change a >= to a> flt 4 – line 5: change a+b to b+b
For Tues, Oct 9
Use your empirical tool to calculate E(theta) for subdomain testing of the triangle problem with the given faults shown in lecture 11 and 12.
Compare with Frankl’s formulas. Make the comparision as fair as possible. Choose the number of tests and subdomains carefully
Turn in hardcopy at start of class, Tues 10/9