1 / 22

The Atmospheric Model Evaluation Tool

The Atmospheric Model Evaluation Tool. K. Wyat Appel and Robert C. Gilliam 7 th Annual CMAS Conference, Chapel Hill, NC October 9, 2008. Acknowledgements. EPA Steve Howard Rob Gilliam Jenise Swall Alice Gilliland Sharon Phillips UNC Institute for the Environment Alexis Zubrow

kevyn-matthews
Download Presentation

The Atmospheric Model Evaluation Tool

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The Atmospheric Model Evaluation Tool K. Wyat Appel and Robert C. Gilliam 7th Annual CMAS Conference, Chapel Hill, NC October 9, 2008

  2. Acknowledgements • EPA • Steve Howard • Rob Gilliam • Jenise Swall • Alice Gilliland • Sharon Phillips • UNC Institute for the Environment • Alexis Zubrow • Saravanan Arunachalam

  3. What is AMET? • Atmospheric Model Evaluation Tool • Two modules • Meteorology (Rob Gilliam) • Air Quality (Wyat Appel) • Combination of several open source software packages • MYSQL • R • Perl • AMET specifically designed to compare observations against meteorological (e.g. MM5, WRF) and air quality model (e.g. CMAQ, CAMx) predictions • Does not export all gridded data to database

  4. Model Output • MM5 (NetCDF) • WRF (NetCDF) • Observations • NOAA ESRL MADIS AMET-MET Evaluation Flow Chart Analyses Model Performance Plot (scatter, range, histogram and table) Diurnal Statistics Time series Spatial Statistics Time-height statistics Text Upper-air statistics Model Evaluation Database MySQL server database that stores all model-observation pairs in tables for access by analysis programs. Match obs. with model values in time and space Surface-basedWind ProfilerPrecipitationUpper-air Generate database records Connect to database and insert records Other, User-developed toolsThe MySQL database is a standard, widely used and easily connectable database that allows users to easily connect and extract data using other software (Excel, Matlab, Perl, SAS, etc.) Observation-Model Synchronization

  5. Model Evaluation Database • Model Output • CMAQ (IOAPI) • MCIP (IOAPI) • Uses Combine program Observations STN, IMPROVE, CASTNet, NADP, AQS, SEARCH, MDN Analyses Model Performance Plots Diurnal Statistics Time series Spatial Statistics Box Plots Scatter Plots Bar Plots “Soccer Goal” Plots Bugle Plots MySQL server database that stores all model-observation pairs in tables for access by analysis programs. Uses either web interface or existing PERL scripts to create required MySQL tables. Observation-Model Synchronization Match obs. with model values in time and space using site compare and compare airs programs Generate database records (FORTRAN) Other, User-developed tools The MySQL database is a standard, widely used and easily connectable database that allows users to easily connect and extract data using other software (Excel, Matlab, Perl, SAS, etc.) Populate Database (PERL) AMET-AQ Evaluation Flow Chart

  6. Advantages of the AMET System • Somewhat automated/interactive system • Data stored in relational database • Data from multiple simulations stored in a single location • Allows data queries based on many factors • Time period, geographic location, time of day, etc. • Pre-generated analysis scripts • Same analysis for multiple simulations • Common analyses between different groups • Open Source • Easy to create new scripts (if you know R)

  7. Available AMET-MET Analyses • Model Performance Summary • includes various plots (scatter, box, etc.) along with various statistics • Timeseries • Spatial Plots • various statistical values (e.g. NMB, NME, etc.) • Bar Plots • error, bias, etc. • Rawindsonde • Wind Profiler • Aircraft Profiler

  8. Model Performance Summary Temperature Wind Direction

  9. 2-m Mixing Ratio 2-m Temperature 2-m Wind Speed 2-m Wind Dir. Time Series

  10. Spatial Statistics

  11. Wind Profiler – Model Comparisons

  12. Aircraft Profile Comparisons (Potential Temp) Mean Absolute Error Distribution by level Aircraft Mean WRF Mean

  13. Available AMET-AQ Analyses • Scatter Plots • model to observation • model to model (at observation points) • Summary Statistics (as csv text file) • Spatial Plots • various statistical values (e.g. NMB, NME, etc.) • concentrations (predicted, observed, and difference) • Box Plots • Stacked Bar Plot • Bugle Plot • Soccer Goal Plot

  14. Scatter plots • Model vs. Obs • Model vs. Model • Multiple Networks • select statistics • Single Network • additional statistics • Ozone Specific • Temporal Averaging • monthly, seasonal, annual

  15. Spatial Plots • Statistics • NMB, NME, Correlation, etc. • Concentrations • model, observation, difference • Sub-regions

  16. Time Series Plots

  17. Box Plots Diurnal Box Plot Monthly Box Plot

  18. Stacked Bar Plots

  19. Other Plots “Bugle” Plot “Soccer Goal” Plot

  20. Public Availability of AMET • AMET is available for download on the CMAS website • Both Met and AQ versions available • Script based version • Extensive users guide included • Contains most of the functionality shown here • Met and AQ versions can be installed together or individually • Includes tutorial data and example output plots • Bugzilla available for AMET

  21. Future Improvements to AMET • Java interface • Currently under development • Runs AMET locally and accesses remote database • Interactive tabs • User friendly • Portable (to a degree) • Additional analysis scripts • Developed internally • Developed externally (user community) • More query options

More Related