1 / 17

Tools and Services Vision FY12-FY14

Tools and Services Vision FY12-FY14. C. Thompson. SOTO Raster Processing Pipeline: FY12. gridding. n ew g ranule collection. tiling. Dataset A. unified data structure. reader/ conditioner A. config file. config file. Dataset C. reader/ conditioner B. KML pyramids. MRF files.

lupita
Download Presentation

Tools and Services Vision FY12-FY14

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Tools and Services VisionFY12-FY14 C. Thompson

  2. SOTO Raster Processing Pipeline: FY12 gridding new granule collection tiling Dataset A unified data structure reader/ conditioner A config file config file Dataset C reader/ conditioner B KML pyramids MRF files reader/ conditioner C full MRF generation global geoTIFFtile generation global PNG generation Dataset B KML generation floating tile repository

  3. SOTO Raster Processing Pipeline: FY13 DMAS (execute) gridding new granule collection unified data structure universal file format tiling Dataset A reader/ conditioner A config file config file universal reader Dataset C reader/ conditioner B trigger DMAS (ingest) MRF files reader/ conditioner C full MRF generation global geoTIFFtile generation Dataset B generate metadata floating tile repository

  4. SOTO Raster Processing Pipeline: FY14 DMAS (execute) gridding new granule collection tiling Dataset A unified data structure reader/ conditioner A PO.DAAC Image Generation Subsystem config file config file universal file format global & per granule hdf5-MRF generation universal reader floating MRF generation Dataset C reader/ conditioner B trigger DMAS (ingest) MRF files reader/ conditioner C full MRF generation global geoTIFFtile generation Dataset B generate metadata floating tile repository

  5. HITIDE Web Services: FY12 reader/tiler A tile DB crawlers XML ingestor reader/tiler B space time dataset(s) Dataset A reader/tiler C XML L2 OpenSearch WS L2 extract WS L2 WMS Dataset C dynamic extraction dynamic image generation imaging plugin C imaging plugin A imaging plugin B Dataset B extract plugin A extract plugin B extract plugin C

  6. HITIDE Web Services: FY13 space time dataset(s) data summaries DMAS (execute) reader A tiler A universal tiler reader/tiler A tile DB trigger reader B tiler B crawlers XML ingestor reader/tiler B space time dataset(s) Dataset A reader C tiler C reader/tiler C config file XML universal file format L2 OpenSearch WS L2 extract WS L2 WMS Dataset C dynamic extraction dynamic image generation universal writer universal file format imaging plugin C imaging plugin A imaging plugin B universal reader Dataset B extract plugin A extract plugin B extract plugin C

  7. HITIDE Web Services: FY14 DMAS (execute) space time dataset(s) data summaries reader A universal tiler tile DB reader B crawlers XML ingestor Dataset A reader C config file XML universal file format Tiled WMS L2 OpenSearch WS L2 extract WS L2 WMS Dataset C dynamic extraction dynamic image generation hdf5-MRF granule files universal writer universal file format imaging plugin C imaging plugin A imaging plugin B universal reader Dataset B extract plugin A

  8. Tiled WMS: FY12/FY13 (GWiNN) • Editable color palette (fixed bin size/data range) • WMTS compatible • Partial MRF updates • Dynamic tile resizing (“overzoom”) • Server architecture optimization • Re-organization of source code for easier deployment • Bolster documentation • Per granule MRF generation • Multiple projections • Sample clients • RESTful calls to individual tiles • Vector support • More flexible key-value pair ordering client-side solution completed high priority client-side solution high priority high priority high priority mid priority mid priority completed mid priority high priority mid priority

  9. SOTO Raster Processing Pipeline: FY14 DMAS (execute) gridding new granule collection tiling Dataset A unified data structure reader/ conditioner A PO.DAAC Image Generation Subsystem config file config file universal file format global & per granule hdf5-MRF generation universal reader floating MRF generation Dataset C reader/ conditioner B trigger DMAS (ingest) MRF files reader/ conditioner C full MRF generation global geoTIFFtile generation Dataset B generate metadata floating tile repository

  10. Tiled WMS: FY13/FY14 (PO.DAAC) • Design and development of hdf5-MRF format • Benchmark hdf-MRF against MRF access times • Build hdf5-MRF Apache plug-in colorized cylindrical or reprojected image (cached request) gridding tiling colorized reprojected image (new request) unified data structure universal file format global & per granule hdf5-MRF generation floating MRF generation colorized reprojected image (new request) universal reader colorized cylindrical image (new request) colorized cylindrical image (new request)

  11. Consolidated Web Services: FY12

  12. Consolidated Web Services: FY13

  13. Event Service: FY12

  14. Event Service: FY13

  15. DMAS- Execute read/write encapsulation Baseline MRF pipeline for SOTO Universal reader/writer development Metadata requirements For MRF files Universal Data Model Requirements/ Design Install Tiled WMS Server

  16. FY13 • SOTO’s raster image generation backend must be modified to produce daily MRF’s(Jeff) • Move to MRF, phase I • SOTO’s vector processing backend (specifically for U/V components) must be reimagined utilizing the MRF format • Move to MRF, phase II

  17. FY13, continued • SOTO’s floating-tiles-to-GeoTIFF backend must be rewritten in python • IDL-to-python conversion • SOTO’s GUI needs to be updated, including the addition of the “flat Earth” • SOTO 2.0 • SOTO’s target audience, its use cases, and its requirements need to be identified • SOTO Use Cases • SOTO’s external KML layers need to be displayed as is or converted to another format, as necessary • SOTO Feeds

More Related