Surface water quality monitoring information system swqmis l.jpg
This presentation is the property of its rightful owner.
Sponsored Links
1 / 45

Surface Water Quality Monitoring Information System (SWQMIS) PowerPoint PPT Presentation

  • Uploaded on
  • Presentation posted in: General

Surface Water Quality Monitoring Information System (SWQMIS) . Cindi Atwood Tetra Tech, Inc. (703) 385-6000 [email protected] Nancy Ragland TCEQ (512) 239-6546 [email protected] TCEQ’s New Enterprise Data System for Managing Ambient Water Quality Data . Benefits.

Download Presentation

Surface Water Quality Monitoring Information System (SWQMIS)

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript

Surface water quality monitoring information system swqmis l.jpg

Surface Water Quality Monitoring Information System (SWQMIS)

Cindi Atwood

Tetra Tech, Inc.

(703) 385-6000

[email protected]

Nancy Ragland


(512) 239-6546

[email protected]

Slide2 l.jpg

TCEQ’s New Enterprise Data System for Managing Ambient Water Quality Data

Benefits l.jpg


Benefits4 l.jpg


  • Consolidate and centralize data

  • Increase data consistency and integrity

  • Assist your agency with internal and external data requests

  • Help management to turn around urgent, high priority requests quickly

  • Save time and money

One week vs one day l.jpg

One Week vs One Day

  • 44 Hours down to 8 Hours

  • 2 person task down to a 1 person task

System deployment l.jpg

System Deployment

System deployment7 l.jpg

System Deployment

  • Deployed the system successfully in early 2007

  • Developed the system as:

    • Web-based

    • J2EE and Oracle

  • Integrated the system with web-based GIS functionalities using ESRI ArcIMS and ArcSDE

Core system modules l.jpg

Core System Modules

  • Monitoring Stations

  • Equipment

  • Geographical Areas

  • Constituents

  • Sampling

  • Comparison Information

  • Projects

  • Reports and Extracts

  • Maps (GIS)

  • Assessment

  • Administration

Manage ambient water quality data l.jpg

Manage Ambient Water Quality Data

Manage ambient water quality data10 l.jpg

Manage Ambient Water Quality Data

  • Organize data in a way that enhances business processes

  • Protect data integrity through clean system design

  • Involve stakeholders at all levels of organization in design and test

  • Keep system flexible to meet future needs

Consolidate centralize databases l.jpg

Consolidate & Centralize Databases

Consolidate centralize databases12 l.jpg

Consolidate & Centralize Databases

  • Allow core data submittal from various data owners

  • Consolidate and centralize databases containing :

    • Field measurements

      • Toxics and organics in a variety of media

      • Biological

      • Habitat parameters, etc.

    • Spatial data

Various data sources l.jpg

Various Data Sources

Various data sources14 l.jpg

Various Data Sources

  • Supply custom interfaces for manual entry

    • Administrators

    • Data Managers

    • Field Personnel

    • Assessors

  • Provide mass data loaders for various data sources including

    • Continuous data from data loggers

    • LIMS

    • USGS

    • River and municipal authorities in Texas

Data integrity l.jpg

Data Integrity

Data integrity16 l.jpg

Data Integrity

  • Provide custom interfaces for manual entry

  • Enforce consistent data entry of all types of data

    • Typographical errors

    • Outlier checks

  • Validate data from manual and mass loaded data

  • Review of submitted data by data managers to approve or deny

Mass loaded data validation l.jpg

Mass Loaded Data Validation

  • The automated validation checks are all run, without stopping after the first “failure.”  In this way, a complete list of errors can be shown.

  • Over 50 validation checks run on mass loaded data

    • Check for outliers.  Check measurements against predefined ranges (min/max).  Compares verify flag in the Results file to see if the outlier value has already been verified by the collector.

    • If sample collected when raining or has rained within the last 24 hours, report a value of <1.  In other words, is days since precipitation (72053) < 1?

    • Check for duplicates in data set based on station ID, sample date, sample time, and parameter code.

Gis integration l.jpg

GIS Integration

Gis integration19 l.jpg

GIS Integration

  • Allow map-based creation of sites

  • Automatically assign geographic attributes such as basin, county and ecoregion to a site

  • Provide map-based search and reporting features

  • Synchronize geographic data with tabular data

Gis integration20 l.jpg

GIS Integration

Gis integration21 l.jpg

GIS Integration

Public access l.jpg

Public Access

Public access23 l.jpg

Public Access

  • Allow the public and other organizations to retrieve water quality data

Public access24 l.jpg

Public Access

Public access drill down l.jpg

Public Access – Drill Down

100 x 100

Mile Square

Public access drill down26 l.jpg

Public Access – Drill Down

25 x 25

Mile Square

Public access drill down27 l.jpg

Public Access – Drill Down

6.25 x 6.25

Mile Square

Public access select stations l.jpg

Public Access – Select Stations

Public access reports l.jpg

Public Access -- Reports

Public access text reports l.jpg

Public Access – Text Reports

Reports data extractions l.jpg

Reports & Data Extractions

Reports data extractions32 l.jpg

Reports & Data Extractions

  • Avaliable in:

    • HTML

    • CSV (Comma Separated Values)

    • Pipe delimited “|” (text) format

Reports data extractions33 l.jpg

Reports & Data Extractions

Station Inventory Report

Reports data extractions34 l.jpg

Reports & Data Extractions

Sampling History Report

Assessments l.jpg


Assessments36 l.jpg


  • Integrates SWQMIS with the statistical SAS tools in order to:

    • Summarize data

    • Calculate various statistics

    • Provide reports for assessors

Assessments37 l.jpg


Assessments business logic l.jpg

Assessments – Business Logic

  • Identify and convert preferred parameters to correct units

  • Handle profile samples appropriately

    • Identification of the mixed surface layer

  • Summarize data and calculate statistics

    • Mean, geometric mean, median, standard deviation, percentiles, confidence intervals

Assessments business logic cont l.jpg

Assessments – Business Logic (cont.)

  • Determine appropriate criteria and identify exceedances

    • Basin-specific

    • Segment-specific

    • Site-specific

    • Formulas (acute & chronic metals)

  • Ascertain waterbody’s support status

  • Provide full documentation for all steps of the process

Data flow l.jpg

Data Flow

Data flow41 l.jpg

Data Flow

  • Transfer of core data to EPA automatically on a periodic basis through web services and the Central Data Exchange (CDX via the Water Quality Exchange (WQX)

Data flow42 l.jpg

Data Flow

  • Actively flowing data to the EPA since September, 2007

  • Fully automated process

  • Currently transfer physical and chemical data

  • Will transfer biological data at a later date

Administration l.jpg


Administration44 l.jpg


  • Track the “history” of data changes

  • Provide interfaces that allow a database administrator to manage:

    • Users

    • Security

    • Reference data

Lessons learned l.jpg

Lessons Learned

  • Allow design time that is adequate for the scope

  • Employ tried technology

  • Use agile development techniques

  • Start third party integration communication and testing early

  • Login