PTAGIS System Review and Roadmap
This presentation is the property of its rightful owner.
Sponsored Links
1 / 42

PTAGIS System Review and Roadmap for the 2013 PIT Tag Steering Committee Annual Meeting PowerPoint PPT Presentation


  • 49 Views
  • Uploaded on
  • Presentation posted in: General

PTAGIS System Review and Roadmap for the 2013 PIT Tag Steering Committee Annual Meeting. Summary of PTAGIS Data Processing for 2012. 2.8 million PIT-tagged fish released. 27 organizations. 336 release locations. Summary of PTAGIS Data Processing for 2012. 14+ million observations.

Download Presentation

PTAGIS System Review and Roadmap for the 2013 PIT Tag Steering Committee Annual Meeting

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Ptagis system review and roadmap for the 2013 pit tag steering committee annual meeting

PTAGIS System Review and Roadmap

for the

2013 PIT Tag Steering Committee Annual Meeting


Summary of ptagis data processing for 2012

Summary of PTAGIS Data Processing for 2012

2.8million

PIT-tagged

fish

released

27organizations

336release

locations


Summary of ptagis data processing for 20121

Summary of PTAGIS Data Processing for 2012

14+million

observations

1.06million

unique

tags

177interrogation

sites


2012 field data systems update

2012 Field Data Systems Update

  • P3: current version 1.5.1

    • Removed Tag Manufacturer's Code Validation per PTSC request

    • Support for Biomark HPR+ Portable Transceiver

  • MiniMon: current version 1.7.0

    • Removed Tag Manufacturer's Code Validation per PTSC request

    • Support for Biomark FS-2020 Adult Transceiver

  • M4: current version 1.5.1

    • SbyC features implemented and lab tested

    • Live fish test at GOJ confirmed lab testing

    • Site evaluation at GOJ, B2J, and BCC in June

    • High-availability features implemented and tested

    • Deployed to all PTAGIS-maintained sites for 2013 season


M4 deployment for 2013 evaluation no sbyc

M4 Deployment for 2013 Evaluation (no SbyC)


M4 deployment for sbyc 2013 evaluation

M4 Deployment for SbyC 2013 Evaluation


New ptagis website beta

New PTAGIS Website (Beta)

  • May 2012: Internal Release to Focus Group

  • October 2012: Public Release

  • January 2013: Update


Website content management system as foundation

Website: Content Management System as Foundation

  • Manages online content such as documents, photos and videos

  • Manages users accounts and roles (tag coordinator, data steward, etc.)

  • Searching: tagged-based and full-text

  • Web page templates (support for mobile devices)

  • Newsletter creation, subscription and distribution

  • Email campaigns


Website features community forums

Website Features: Community Forums


Website features interrogation site maps

Website Features: Interrogation Site Maps


Web site features news and announcements

Web Site Features: News and Announcements


Web site features ptsc contacts and charter

Web Site Features: PTSC Contacts and Charter


Website features document library

Website Features: Document Library


Web site features updated online tour

Web Site Features: Updated Online Tour


Website features services

Website Features: Services


Website features request new validation code

Website Features: Request New Validation Code


Website features sbyc project request service

Website Features: SbyC Project Request Service


Website features data dictionary

Website Features: Data Dictionary


Website features quick reports

Website Features: Quick Reports


Website features advanced reports

Website Features: Advanced Reports


Advanced report features standard report types

Advanced Report Features: Standard Report Types


Advanced report features querybuilder 2

Advanced Report Features: QueryBuilder 2


Advanced report tutorials documentation and webinars

Advanced Report: Tutorials, Documentation and Webinars


Ptagis4 data file extracts

PTAGIS4 Data File Extracts

  • File-based replica of the entire PTAGIS dataset

  • Replacement for TMT and Telnet features from PTAGIS3

  • Primarily for large data consumers such as FPC and DART

  • Files are downloaded and merged into another database

  • Updated nightly

  • Partitioned by periods of time, such as changes occurring

    • Yesterday

    • Last week

    • Last month

    • Last year


Website features analytics oct 24 th 2012 to today

Website Features: Analytics (Oct. 24th 2012 to Today)


Summary of querybuilder2 web report usage october 24 th 2012 to today

Summary of QueryBuilder2 Web Report Usage (October 24th 2012 to Today)

144users

ran

at least one

report

8,879jobs

run

225million

rows

returned


Summary of querybuilder1 web report usage october 24 th 2012 to today

Summary of QueryBuilder1 Web Report Usage (October 24th 2012 to Today)

228users

ran

at least one

query

3,167queries

run

674million

rows

returned


2013 roadmap introduction

2013 Roadmap Introduction

  • PTAGIS3 Server and related components disabled by Oct. 2013

    • Ingres Database (license agreement requires uninstall)

    • Legacy Website and QueryBuilder

    • IDL and FDVL field data processing

    • O&M reports and tools (PTOC central)

    • Telnet and TMT files

    • Tag Distribution System

  • Requires complete transition to PTAGIS4 server


2013 roadmap interrogation data processing and o m reporting

2013 Roadmap: Interrogation Data Processing and O&M Reporting

  • Before 2013 Field Season (March 1):

  • All interrogation data to be processed in PTAGIS4 server

  • Disable any PTAGIS3 interrogation data source in PTAGIS4 reporting

  • PTAGIS3 interrogation data and reports will be used for reference only

  • Requires the following tasks to be completed:

    • Transform and load MiniMon data into PTAGIS4 for sites not running M4

    • Complete transceiver diagnostic data extraction for O&M reporting

    • Disable interrogation data sync from PTAGIS3

    • Consolidate PTAGIS4 data model

    • Complete remaining O&M reports and tools:

      • Diversion Gate Efficiency (DGE) for SbyC operations

      • TASS enunciator tool


Ptagis4 field interrogation data processing for 2013 evaluation

PTAGIS4 Field Interrogation Data Processing for 2013 Evaluation

PTAGIS Maintained Sites

M4

(PRIMARY)

MultiMon

(Backup)

MiniMon

(Backup)

  • PTAGIS4

  • Server

  • PTAGIS3

  • Server

PTAGIS3 QueryBuilder

PTAGIS4 Advanced Reports


Ptagis4 field interrogation data processing for 2013 evaluation1

PTAGIS4 Field Interrogation Data Processing for 2013 Evaluation

PTAGIS Maintained Sites

Other Interrogation Sites

M4

(PRIMARY)

MultiMon

(Backup)

MiniMon

(Backup)

MiniMon

PIFF

(data logger)

  • PTAGIS4

  • Server

  • PTAGIS3

  • Server

PTAGIS3 QueryBuilder

PTAGIS4 Advanced Reports


Ptagis4 field interrogation data processing for 2013 evaluation2

PTAGIS4 Field Interrogation Data Processing for 2013 Evaluation

PTAGIS Maintained Sites

Other Interrogation Sites

M4

(PRIMARY)

MultiMon

(Backup)

MiniMon

(Backup)

MiniMon

PIFF

(data logger)

  • PTAGIS4

  • Server

  • PTAGIS3

  • Server

Patch Manager

PTAGIS3 QueryBuilder

PTAGIS4 Advanced Reports


Patch manager utility

Patch Manager Utility

  • Patch gaps in data between systems

  • Source can be M4 or MiniMon

  • Update PTAGIS3 or PTAGIS4 systems


Observation detail comparison between systems

Observation Detail Comparison Between Systems


Tag code validation on ptagis4 server

Tag Code Validation on PTAGIS4 Server

Each tag code processed as an observation is validated against a list of known tag masks, for example:

3D9.1BF1, 3D9.1C2C, …

If tag code doesn’t match:

  • Observation event marked ‘INVALID’

  • Observation is Processed into reporting datamart

  • Steward is notified

    Causes of an ‘INVALID’ tag may be:

  • Spurious Read

  • Unapproved Vendor

    ‘INVALID’ tag events do not appear in reports by default

    Need to create approval process for new vendors and tag types

    Tag Validation for Mark, Recapture, Mort Data to be added later


2013 roadmap new system evaluation

2013 Roadmap: New System Evaluation

  • Evaluation tasks during the 2013 out-migration season:

  • Monitor M4 systems – update as needed

  • Continue manual and automated data audits to evaluate PTAGIS4 transition

  • Monitor field data processing in PTAGIS4 – update as needed

  • Maintain both platforms for SbyC operations (M4 and MultiMon)

  • Evaluate new O&M reports and tools – update as needed


2013 roadmap promote ptagis4 website into production

2013 Roadmap: Promote PTAGIS4 Website into Production

  • Promote Beta Website as Production End of March 2013

  • Notify users of this change via email in February

  • May be able to demote current site as legacy

  • www.ptoccentral.org to remain operational for O&M report evaluation

  • ftp.ptagis.org will transition later (TBD)

    • To avoid changing field data collection systems

    • New FTP server is ptagisftp.ptagis.org


2013 roadmap mark data processed via sync into ptagis4

2013 Roadmap: Mark Data Processed via Sync into PTAGIS4

P3

  • PTAGIS4

  • Server

  • PTAGIS3

  • Server

Sync

PTAGIS3 QueryBuilder

PTAGIS4 Advanced Reports


2013 roadmap process mark data directly into ptagis4

2013 Roadmap: Process Mark Data Directly into PTAGIS4

  • Scheduled in Summer 2013

  • Use New Tag Coordinator Features in PTAGIS4

  • Complete decoupling from PTAGIS3

  • Extend Tag Code Validation

P3

  • PTAGIS4

  • Server

  • PTAGIS3

  • Server

Sync

PTAGIS3 QueryBuilder

PTAGIS4 Advanced Reports


2013 roadmap potential deliverables

2013 Roadmap: Potential Deliverables

  • These features and tasks may be accomplished in 2013 as time and resource allow:

  • Develop a replacement Tag Distribution System

    • Based upon Scoping Process

  • Additional Web Content:

    • Existing Interrogation Site Metadata

    • Complete Image Library

    • Add Tagging/Interrogation Videos Resources

  • Additional web-enabled workflow services:

    • New interrogation site requests

    • Additional metadata


2013 roadmap potential deliverables continued

2013 Roadmap: Potential Deliverables Continued

  • These features and tasks may be accomplished in 2013 as time and resource allow:

  • Metadata Analysis and Refinement

    • Refine Data Dictionary

    • Revise Spec-Doc

    • Scope next tagging software P4

    • Enhance M4 interrogation data

  • Interrogation Site Steward Web Portal

    • Stewards to manage interrogation data and metadata

    • Web-enabled PIFF for non-standard data submissions

  • Consolidate raw data file repository


2013 roadmap conditions for delivery

2013 Roadmap: Conditions for Delivery

  • No Contingency Planning

    • Systems Failures

    • Budget Shortfalls

  • Limit Ad-Hoc Requests

    • Includes Technical Coordination and Review

  • Use Remaining Resources Wisely

    • Synergetics Subcontract for PTAGIS3 (Doug Clough) Limited to ~300 hours

    • Limited Subcontracts for PTAGIS4 Development

    • Limited Travel and Training

  • Retain Talent and Morale


  • Login