1 / 21

For Marie : A compilation of some “nice- coloured ” slides on IBI Validation

For Marie : A compilation of some “nice- coloured ” slides on IBI Validation. Marcos García Sotillo Dinámica Costera y Portuaria Área de Medio Físico. Service & Operations IBI-MFC Manager. I Workshop Técnico de Usuarios Españoles del Servicio IBI-MFC Madrid, 13 Noviembre 2012 .

makya
Download Presentation

For Marie : A compilation of some “nice- coloured ” slides on IBI Validation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. For Marie: A compilation of some “nice-coloured” slides on IBI Validation Marcos GarcíaSotillo DinámicaCostera y Portuaria Área de MedioFísico Service & Operations IBI-MFC Manager I Workshop Técnico de Usuarios Españoles del Servicio IBI-MFC Madrid, 13 Noviembre 2012

  2. IBI On-Line Validation • Several Metrics (on daily, monthly & quarterly basis) computed by MO & PdE • Outputs organization & visualization through dedicated web pages

  3. IBI On-line Validation: examples… CLASS2 (moorings & Tide Gauges)

  4. IBI On-Line Validation: Examples... SST (IBI Vs Odissey L4

  5. IBI On-Line Validation: Examples … TMP & SAL (IBI Vs ARGO)

  6. Productos IBI-MFC (Verificación exhaustiva) RADAR-HF Corrientes

  7. Scientific reporting for V3 • Example of IBI Sci Val metrics provided in QUID Winter 2012 SST(ºC) CLASS1 IBI-Vs-L4 MF ODDYSEA MyOcean2 V3 Acceptance & V4 Product Design Workshops – Madrid 28,29th January 2013

  8. Scientific reporting for V3 • Example of IBI Sci Val metrics provided in QUID Summer 2012 Surf Cur(ºC) CLASS1 IBI-Vs-PdE HF Radar-Galicia MyOcean2 V3 Acceptance & V4 Product Design Workshops – Madrid 28,29th January 2013

  9. Scientific reporting for V3 • Example of IBI CALIBRATION metrics provided in QUID SST (moorings) Calibration (IBI-V2 vs IBI-V1) T&S (ARGO) Residual elevations (tide-gauges) MyOcean2 V3 Acceptance & V4 Product Design Workshops – Madrid 28,29th January 2013

  10. IBI CAL/VAL improvements • V3 System changes (according V3 Acceptance Review): • Improved CalVal capabilities • Noticeable upgrade of the IBI-MFC Validation capabilities: Launch of NARVAL Tool (On-line & Delayed Mode) • Statistics covering longer periods (p.eg. monthly, seasonal and annual reviews) MyO Quarterly Validation Reports • Validation of daily IBI forecast cycle. MyOcean2 V3 Acceptance & V4 Product Design Workshops – Madrid 28,29th January 2013

  11. IBI CAL/VAL improvements • NARVAL continuous developments. Working lines: • To include new OBS Sources • SMOS, ARGO(in D-M: automatic generation of nc files for WP17) BIAS RMSE BIAS RMSE February, 2012 February, 2012 MyOcean2 V3 Acceptance & V4 Product Design Workshops – Madrid 28,29th January 2013

  12. IBI CAL/VAL improvements • NARVAL continuous developments. Working lines: • To include new OBS Sources • SMOS, ARGO (dm metrics) • To automatize extra metrics computation • Annual, seasonal & monthly basis (plots, tables & indicators) • To provide automatic feedback to MyO CALVAL • Already sending quarterly nc files to MyO WP17 • To integrate visualization of both IBI Pus (MO & PdE) metrics/plots • To explore new metrics (i.e. triple collocation statistics, skill scores based indicators, etc…) • Finally, keep an eye to decisions on MyOcean2 V3 Acceptance & V4 Product Design Workshops – Madrid 28,29th January 2013

  13. System Updates in V4 • IBI Scientific VALidation in V4 • Upgraded automatic procedures to generate IBI validation metrics • More IBI metrics sent to WP17 for further dissemination • Updated of the IBI validation Tool (NARVAL) • More metrics (on-line & Delayed mode) available through WWW • More observational data sources included • Research in new metrics for further operational application. • Triple collocation, skill scores statistics, contingency table ,… MyOcean2 PCs and CIS status meeting – Paris 24th September 2013

  14. Update of monthly statistics provided to WP17 • Previously (IBI-V3): • Comparison: SST • Sources: IBI vs L4 ODYSSEA (MF product) • Region: only IBISR (full IBI servicedomain) • Forecasthorizons: HC01 (IBI bestestimate) • IRISH • ECHAN • GOBIS • IBISR • NIBSH • CurrentState: • Comparison: SST • Sources: • IBI vs L4 OSTIA (throughMyO) • IBI vs L3 (MyOproduct) • Regions: 10 differentregions • Forecasthorizons: HC01 / FC03 / FC05 • WIBSH • WSMED • GIBST • CADIZ • ICANA MyOcean2 PCs and CIS status meeting – Paris 24th September 2013

  15. Update of monthly statistics provided to WP17 • Previously: • Comparison: SST • Sources: IBI vs L4 Meteofranceproduct • Regions: only 1, IBISR (full domain) • Horecasthorizons: HC01 (bestestimates) • CurrentState: • Comparison: SST • Sources: • IBI vs L4 OSTIA MyO2 product • IBI vs L3 MyO2 product • Regions: 10 regions • Horecasthorizons: HC01 / FC03 / FC05 • * Reprocessingbackwardstomakethe files consistent in shape • Also for V4 (in short-term future) Inclussion of automatic 3D SAL & TMP metrics (using ARGO floats (by regions, levels and horizons) MyOcean2 PCs and CIS status meeting – Paris 24th September 2013

  16. System Updates in V4 • NARVAL Progress • More obs sources: Argo floats, SMOS, Gibraltar strait HF Radar. • More metrics, both delayed & on-line mode MyOcean2 PCs and CIS status meeting – Paris 24th September 2013

  17. Triple collocation to determine relative error ranges of MyOcean products • L3 obs • TC method is used to compared data sets of the same geophysical field • TC gives an estimation of the error associated to each data set and allows the calibration of the data sets. The errors are generally supposed to be uncorrelated with each other and with the geophysical field. • Application: one year of SST data (Aug 2011-Sep 2012), Bay of Biscay region. • Data sets: multi-sensor L3 observations (taken as reference), IBI and NWS forecasts (1-D averaged). Calculation performed for grid points with at least 200 valid obs. • IBI MFC • 0.5 • NWS MFC • 0.0 • Variance of errors MyOcean2 PCs and CIS status meeting – Paris 24th September 2013

  18. TEMP: IBI vs ARGO FULL-PROFILE (AUGUST 2013) TEMP: IBI VS ARGO 0-5 m LAYER (AUGUST 2013) BIAS BIAS LOCATION LOCATION RMSE RMSE CORRELATION CORRELATION

  19. TEMP: IBI VS ARGO 200-600 m LAYER (AUG 2013) TEMP: IBI vs ARGO FULL-PROFILE (AUG 2013) BIAS BIAS LOCATION LOCATION RMSE RMSE CORRELATION CORRELATION

  20. AUG 2013: RMSE TEMP AT DIFFERENT LAYERS (AVERAGED OVER THE WHOLE IBI SERVICE AREA) AUG 2013: BIAS TEMP AT DIFFERENT LAYERS (AVERAGED OVER THE WHOLE IBI SERVICE AREA) AUG 2013: CORRELATION OF TEMP PROFILES (AVERAGED OVER THE WHOLE IBI SERVICE AREA) NUMBER OF ARGO STATION AVAILABLE PER DAY IN THE IBI SERVICE AREA USED TO COMPUTE STATISTICS

  21. SALINITY: IBI vs ARGO FULL-PROFILE (AUG 2013) SALINITY: IBIvsARGO 200-600 m LAYER (AUG 2013) BIAS BIAS LOCATION LOCATION RMSE RMSE CORRELATION CORRELATION

More Related