1 / 17

Data QC, Aggregation, and Visualization with ODV

Data QC, Aggregation, and Visualization with ODV. Reiner Schlitzer , Alfred Wegener Institute, Bremerhaven , Germany. Providing data QC as well as outlier flagging and filtering . Providing data file aggregation and production of large integrated datasets .

pembroke
Download Presentation

Data QC, Aggregation, and Visualization with ODV

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Data QC, Aggregation, andVisualizationwithODV Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany

  2. Providing data QC as well as outlier flagging and filtering. Providing data file aggregation and production of large integrated datasets. Providing production of time-series plots, maps, sections and animated3Dplots.

  3. Visual Quality Control • easy spottingandidentification of outliersoroffsets • painlessediting of datavalueandqualityflag • logging of all valueorflagmodifications

  4. Automatic Range Checks • full sample set • sample sub-set

  5. QF MassAssignments • all samples of manyor all stations (initialization) • all samples in a window • all orsomeselectedsamples of currentstation • current sample only

  6. Using Quality Flag Filters Before filtering After filtering

  7. File Aggregation Multi-fileimport (analysisandaggregationphases).

  8. File Analysis • Use//SDN_parameter_mappingsection • Determine type of data (profile, time-series, trajectory). //SDN_parameter_mapping //<subject>SDN:LOCAL:PRESSURE</subject><object>SDN:P011::PRESPS01</object><units>SDN:P061::UPDB</units> //<subject>SDN:LOCAL:T90</subject><object>SDN:P011::TEMPS901</object><units>SDN:P061::UPAA</units> //<subject>SDN:LOCAL:Salinity</subject><object>SDN:P011::PSALPR02</object><units>SDN:P061::UUUU</units> //<subject>SDN:LOCAL:fluorescence</subject><object>SDN:P011::CPHLPM01</object><units>SDN:P061::UGPL</units> //<subject>SDN:LOCAL:Trans_red_25cm</subject><object>SDN:P011::POPTDR01</object><units>SDN:P061::UPCT</units> //<subject>SDN:LOCAL:POTM</subject><object>SDN:P011::POTMCV01</object><units>SDN:P061::UPAA</units> //<subject>SDN:LOCAL:Density</subject><object>SDN:P011::SIGTPR01</object><units>SDN:P061::UKMC</units>

  9. Aggregation • ODV collectionsarecreatedforeverydata type found. • Data of a givenfileareimportedintothecorresponding ODV collection. • Processisfullyautomatic. • Results in oneormore ODV collectionscontaining all data of a given type.

  10. Aggregated Variables // //SDN_parameter_mapping //<subject>SDN:LOCAL:DEPH</subject><object>SDN:P011::ADEPZZ01</object><units>SDN:P061::ULAA</units> //<subject>SDN:LOCAL:PRES</subject><object>SDN:P011::PRESPR01</object><units>SDN:P061::UPDB</units> //<subject>SDN:LOCAL:TEMP</subject><object>SDN:P011::TEMPPR01</object><units>SDN:P061::UPAA</units> //<subject>SDN:LOCAL:PSAL</subject><object>SDN:P011::PSLTZZ01</object><units>SDN:P061::UUUU</units> //<subject>SDN:LOCAL:DOX1</subject><object>SDN:P011::DOXYZZXX</object><units>SDN:P061::UMLL</units> //<subject>SDN:LOCAL:DOXY</subject><object>SDN:P011::DOXYZZXX</object><units>SDN:P061::UPOX</units> //<subject>SDN:LOCAL:TUR4</subject><object>SDN:P011::TURBXXXX</object><units>SDN:P061::USTU</units> //<subject>SDN:LOCAL:NTRA</subject><object>SDN:P011::NTRAZZXX</object><units>SDN:P061::UPOX</units> //<subject>SDN:LOCAL:SLCA</subject><object>SDN:P011::SLCAZZXX</object><units>SDN:P061::UPOX</units> //<subject>SDN:LOCAL:PHPH</subject><object>SDN:P011::PHXXZZXX</object><units>SDN:P061::UUPH</units> //<subject>SDN:LOCAL:CORG</subject><object>SDN:P011::CORGZZZX</object><units>SDN:P061::UPOX</units> //<subject>SDN:LOCAL:POCP</subject><object>SDN:P011::MDMAP010</object><units>SDN:P061::UMMC</units> //<subject>SDN:LOCAL:TSMP</subject><object>SDN:P011::TSEDZZZZ</object><units>SDN:P061::UMGL</units> // // //SDN_parameter_mapping //<subject>SDN:LOCAL:DEPTH</subject><object>SDN:P011::ADEPZZ01</object><units>SDN:P061::ULAA</units> //<subject>SDN:LOCAL:Temperature</subject><object>SDN:P011::TEMPS901</object><units>SDN:P061::UPAA</units> //<subject>SDN:LOCAL:Salinity</subject><object>SDN:P011::ODSDM021</object><units>SDN:P061::UUUU</units> //<subject>SDN:LOCAL:Oxygen</subject><object>SDN:P011::DOXYCZ01</object><units>SDN:P061::KGUM</units> //

  11. When aggregating SDN files different BODC parameter/unit codes are maintained as separate variables (e.g., 3 oxygen variables). User may combine separate variables by means of aggregated derived variables (e.g., 1 oxygen variable for scientific usage).

  12. Aggregatedderived variable Oxygen [ml/l]= 1 * (DOX1 DISSOLVED OXYGEN ml/l) + 0 0.02297 * (DOX2 DISSOLVED OXYGEN micromole/kg) + 0 0.02241 * (DOXY DISSOLVED OXYGEN millimole/m3) + 0 • Merging Principles: • Merging Type (exclusiveuseoffirstavailablevalue, averageover all availablevalues) • Order ofinput variables matters (in caseofeclusivemerge) • Standard or user-specifiedconversion formulas • Quality flag inheritence

  13. Time-series Plots

  14. Time-series Plots

  15. Distribution Maps Sections

  16. 3D Animations

More Related