Water Information System for the Management and Storage of Time Series Data
Download
1 / 29

Presented by: Steve S. Di Lonardo & James C. Alair September 15 th , 2009 West Point, New York - PowerPoint PPT Presentation


  • 194 Views
  • Uploaded on

Water Information System for the Management and Storage of Time Series Data. Presented by: Steve S. Di Lonardo & James C. Alair September 15 th , 2009 West Point, New York. Water Quality. New York City Department of Environmental Protection. Bureau of Water Supply. Outline.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Presented by: Steve S. Di Lonardo & James C. Alair September 15 th , 2009 West Point, New York' - neona


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

Water Information System for the Management and Storage of Time Series Data

Presented by: Steve S. Di Lonardo & James C. Alair

September 15th, 2009

West Point, New York

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


Outline
Outline Time Series Data

  • Challenges associated with time series data

  • WISKI software as a solution

  • Improvements to NYC DEP time series data quality and access?

  • Case studies

  • Other potential applications

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


Challenges of time series data
Challenges of time-series data Time Series Data

  • Government & environmental agencies produce large amounts of data

    • Requires the establishment of information systems to acquire and store data

    • Limited or no built-in QA/QC capabilities

    • Often results in data silos

    • Limited data sharing / access between groups

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


Time series data
Time series data Time Series Data

  • As part of DEP efforts to improve and facilitate the availability of time series data:

    • Pilot study using WISKI software

    • Database manager software

    • Designed by Kisters North America Inc.

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


WISKI database manager Time Series Data

  • Infrastructure to automatically IMPORT, PROCESS, COMPUTE, STORE, and REPORT all time series data

  • Unlimited sites, stations, parameters and data storage (only limited by hardware)

  • Based on MS-SQL, Oracle, etc….

  • Scalable from a single user to hundreds of users

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


WISKI database manager Time Series Data

  • Data file importing (current and archival)

    • All major data loggers formats

    • Telemetry data acquisition systems

    • SCADA systems

    • XML, ZRXP, & Comma delimited files

    • User defined time-series data

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


Who uses wiski
Who uses WISKI? Time Series Data

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


Applications types of data

Surface water (temperature) Time Series Data

Ground water (salinity)

Meteorological (precipitation)

Water quality (O2)

Stream discharge (flood management)

Any time-series data!

Applications – Types of Data

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


How where does wiski fit at dep
How/Where does WISKI fit at DEP? Time Series Data

  • LIMS – lab/field data

  • SAS – historical lab/field data

  • SCADA – real-time data (operations)

  • WISKI

    • Compatible with LIMS, SCADA, SAS, ARCGIS

    • Organization of high frequency data files into a manageable user-friendly format

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


Wiski software at dep
WISKI software at DEP Time Series Data

  • Purchased by NYC DEP (2005)

    • Used primarily by EOH Hydrology - Kensico streams

  • Advancements 2007 - Present

    • Kensico Streams

    • USGS gauge stations

    • Weather stations

    • Keypoints

    • Reservoir Elevation/Capacity

  • Water Security Initiative (EPA Grant)

    • Integral part of keypoint data acquisition and storage

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


Wiski as a software solution
WISKI as a software solution Time Series Data

  • Access via BWS intranet to all DEP employees

  • Automated data imports (excel, html, asci)

  • Reduce need for data requests

  • Data available in a working format

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


NYC Watershed & Distribution Time Series Data

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


Water Quality Time Series Data

New York City Department of Environmental Protection

Bureau of Water Supply


Data computations

WISKI Data Management System Time Series Data

Data Computations

  • Data Conversions

    • By Formula

    • Through Rating Tables

  • Creates Summary Data

    • Min, Max, Mean, Total

    • Daily, Monthly, & Yearly

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


WISKI Data Reports Time Series Data

  • Standard Reports

    • Year End Reports

    • Monthly Reports

    • Rating Curve Reports

    • Discharge Measurement Summary

    • User-defined Reports

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


WISKI Data Management System Time Series Data

  • Time and user stamped data QA/QC

  • Original imported time-series data cannot be edited

  • Altered data maintains history

  • User-defined plausibility flags (eg. Turbidity)

  • Restrict sensitive data to certain user groups

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


WISKI Data Management System Time Series Data

Tabular presentation of the Flags

Graphical presentation of the Flags

Comments and Remarks

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


Case Studies & Potential Applications at NYC DEP Time Series Data

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


Case Study: Sewage Spill Warning & Prevention Time Series Data

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


Water budgets storm monitoring
Water Budgets / Storm Monitoring Time Series Data

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


Event detection
Event Detection Time Series Data

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


Operational shutdown monitoring
Operational Shutdown Monitoring Time Series Data

  • Reservoir elevation

  • Discharge and turbidity

  • Plausibility checks for out of range values

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


Flood forecasting
Flood forecasting Time Series Data

  • Create a flood forecasting system using existing gage data

  • Establish a web-based warning network for towns

Flood warning

Flood watch

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


Data Modeling Time Series Data

  • Nodes: represent catchments, junctions or recording sites

  • Links: define how the information flows in the model

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


Data analysis trends
Data analysis - Trends Time Series Data

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


Water meter information
Water Meter Information Time Series Data

  • Efforts have been made by NYC to automate water meter data acquisition

  • WISKI could interface with the data stream and auto-generate reports

  • Provide a historical database for data analysis

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


Summary
Summary Time Series Data

  • WISKI Software represents a state of the art tool for dealing with any time series data

  • Does not require special infrastructure – can interface with any data source

  • Significant improvement in QA/QC & data access

  • Success requires collaboration

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


Acknowledgements
Acknowledgements Time Series Data

  • Kisters North America

  • Kerri Alderisio

  • Lorraine Janus

  • DEP Management

Water Quality

New York City Department of Environmental Protection

Bureau of Water Supply


ad