Introduction to Design of Experiments

Introduction to Design of Experiments P0 - 1

Part 0 Student Introductions P0 - 2

Welcome ! – The Overall Plan • Administrative Details • Introductions • Instructor Bio • Around the room –introductions • Openers – characterize and predict the performance of a paper helicopter • Design of Experiments Class Lectures with “Seatwork” • Session 0: Student Introduction • Session 1: DOE Introduction • Session 2: Planning • Session 3: Hypothesis Testing • Session 4: Test Design and Execution • Section 5: Analysis • Session 6: Case Studies • In Class Experiment: DOE for Helicopter Characterization P0 - 3

Administrative Details • Please turn off cell phone audible ring – vibrate OK • Please sign the Daily Attendance/Safety Roster • Please display your name tag P0 - 4

DT&E: Science & Engineering are Vital to Success of our Tests • Take-away: we already have good science in our DT&E! • We understand sys-engineering, guidance, aero, mechanics, materials, physics, electromagnetics … • DOE introduces the Science of Test Bonus: Match faces to names – Ohm, Oppenheimer, Einstein, Maxwell, Pascal, Fisher, Kelvin

OT&E: Operations Skills are Vital to the Success of Test • Similarly: we already have good ops in our OT&E! • We understand attack, defense, tactics, ISR, mass, unity of command, artillery, CAS, ASW, AAW, armored cav… • DOE adds the Science of Test Bonus: Match faces – Dolittle, Patton, Napoleon, Mitscher, Rickover, Francis Marion, Arnold, Puller

Methods of Test • System-science-based risk-reduction in test • Given what we know, what are the most critical quality risks? • How should we interrogate the system to mitigate risk most effectively/efficiently? • Test-science-based risk-reduction in test • If a quality risk could be anything, what are all the ways we could test? • How should we interrogate the system to mitigate risk most effectively/efficiently? IN ALL TEST, we use our system expertise and value systems, along with test-design science and analytic tools to manage test risk… but in what measure or proportion?

Why are you here? • Understand process of test design so you can interact with analysts/engineers throughout test • Learn DOE terminology/approach - how to talk to your analyst/statistician • Know what information is needed to design a good test • Trust the menu of test designs and software to perform as claimed herein • Understand principles of test design so you execute a test that gives meaningful results • Execute according to the design • Reasonable expectation of results from this class: • Learn basic principles & skills to craft a statistically well-designed experiment • Understand importance of test point placement & confidence and power – avoid “best effort” practices • What “fingerprints” or metrics accompany a well-designed experiment • It will not make statisticians; you’ll require skilled statistical/ops analysis help to apply these ideas to all but basic test programs P0 - 8

Four classes of metrics we’ll examine Manage Plan Science DOE Analyze Design Execute

Aircraft Characterization • Given: Paper Helicopter with three adjustments (factors) • Rotor width • Rotor length • Base Weight • Design an experiment to: • Predict your hang time and accuracy as a function of the three input settings P0 - 10

David H. ANNIS, Rethinking the Paper Helicopter: Combining Statistical and Engineering Knowledge, The American Statistician, November 2005, Vol. 59, No. 4 P0 - 11

Helicopter IPO INPUTS (X’s) (Factors) OUTPUTS (Y’s) (Responses) Noise Type of Paper Number of Clips PROCESS: Type of Clips Wing Length Hang Time in Seconds Wing Width Paper Helicopter Body Length Body Width Noise Wing Angle P0 - 14

Paper Helicopter Design • Do Paper Helicopter – Pt 0 Use what you know P0 - 15

Introduction to Design of Experiments