Model Assessment and Validation - PowerPoint PPT Presentation

lida
model assessment and validation n.
Skip this Video
Loading SlideShow in 5 Seconds..
Model Assessment and Validation PowerPoint Presentation
Download Presentation
Model Assessment and Validation

play fullscreen
1 / 9
Download Presentation
Model Assessment and Validation
156 Views
Download Presentation

Model Assessment and Validation

- - - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

  1. Model Assessment and Validation

  2. Model Validation Models should be based on objective research, expressed mathematically and should be shown to be useful and pass critical tests. Declaration of Independence: Modelers are independent of the system?

  3. Validation Errors

  4. Example

  5. Type III Error The modeler sets out on the wrong track altogether. The result is that the model does completely the wrong thing and is of no value at all.

  6. Open Box (White-box) Validation We know the inner workings of our model – compare to Black-box

  7. Validation Difficulties • The theory we are assuming for the real application is complex • When model is designed to look at modifications and new circumstances, we do not know how things will react in the real world. • Prediction issues

  8. Interpretive Models • 3 R’s • Reductionism: complex systems can be reduced to simpler component parts without loss of information. • Repeatability: Can we achieve repeatability – the scientific principle. • Refutation: no experiment can prove conclusively that a theory is true. (Karl Popper)

  9. Cognitive Maps Validation Cognitive Maps (A person’s mental image of a situation) If people cannot have common concepts in their respective Cognitive Maps – are the maps invalid?