1 / 32

The GFDL Data Portal A NOAA partnership

The GFDL Data Portal A NOAA partnership. Kevin O’Brien Steve Hankin Serguei Nikonov V. Balaji. Background. GFDL. Background. TMAP. PMEL. Introduction to LAS. The Live Access Server (LAS).

Download Presentation

The GFDL Data Portal A NOAA partnership

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. The GFDL Data PortalA NOAA partnership Kevin O’Brien Steve Hankin Serguei Nikonov V. Balaji

  2. Background • GFDL

  3. Background • TMAP • PMEL

  4. Introduction to LAS The Live Access Server (LAS) A highly configurable Web server designed to provide flexible access to geo-referenced scientific data

  5. Introduction to LAS LASTwo types of configurability • Configurable hierarchical presentation • to address different “information architectures” • Configurable data browse/access • to address grids, variables, constraints, …

  6. Introduction to LAS Configurable hierarchy of information Example – GODEA Intercomparison

  7. Introduction to LAS Configurable hierarchy of information Example – NDBC Buoy Prototype

  8. Introduction to LAS Once the dataset or variable of interest has been identified …

  9. Introduction to LAS

  10. Matlab, IDL, IDV, Ferret, GrADS, … Information Products netCDF, HYCOM binary, ASCII, GIS layers

  11. Introduction to LAS

  12. FDS (Ferret Data Server) • FDS is an OPeNDAP server • Automatically installed with LAS • Therefore every gridded LAS dataset is served via OPeNDAP • Has extended analysis capabilities beyond basic OPeNDAP servers

  13. Introduction to LAS Compare Fields

  14. Introduction to LAS Compute simple analyses

  15. Introduction to LAS LAS UI LAS core Meta- Internet (perl) data Standard legacy Local application Data Batch ( Ferret ) K-12 Multiple User Interfaces The UI talks to LAS through an XML “web service”

  16. Introduction to LAS

  17. Introduction to LAS

  18. Technical challenges include: • Managing large collection of model files • Directing “customers” to desired data • Controlling resource-intensive data requests • Dealing with curvilinear coordinate systems

  19. Technical challenges include: • Managing large collection of model files • Annual, monthly, daily, 3-hourly, etc • Directing “customers” to desired data Solution: Unidata Aggregation server and OPeNDAP • Handling resource-intensive data requests • Dealing with curvilinear coordinate systems

  20. Technical Challenges Solution: Unidata Aggregation server and OPeNDAP • Unidata Aggregation server • Combines a group of files/datasets into one logical dataset • Uses THREDDS catalogs to specify the datasets it serves • OPeNDAP • Allows access to remote data via the internet, using http • format of the native data not a worry • only need to transfer the subset of interest

  21. Technical challenges include: • Managing large collection of model files • Directing “customers” to desired data • Handling resource-intensive data requests Solution: Use LAS “categories” • Dealing with curvilinear coordinate systems

  22. LAS categories: GFDL Data Portal

  23. LAS categories: GFDL Data Portal

  24. Search coupled coupled

  25. Index

  26. Technical challenges include: • Managing large collection of model files • Handling resource-intense data requests • Directing “customers” to desired data Solution: LAS defaults to a “batch” mode for large requests • Handling resource-intensive data requests • Dealing with curvilinear coordinate systems

  27. LAS “Batch” mode

  28. Technical challenges include: • Managing large collection of model files • Dealing with curvilinear coordinate systems • Directing “customers” to desired data Solution: Ferret, FDS, regridding…… • Handling resource-intensive data requests • Dealing with curvilinear coordinate systems

  29. XY plot of curvilinear data

  30. netCDF subset of curvilinear data • Using nc operators

  31. Future directions: • Automation • Implement standards for regridding • Expand Modeler community • Increase “fusion” of GFDL models with others • OPeNDAP • LAS Sister Servers • Several different LAS servers which share XML

  32. For more information: • Ferret: http://www.ferret.noaa.gov • LAS: http://www.ferret.noaa.gov/Ferret/LAS • GFDL data portal: http://nomads.gfdl.noaa.gov • OPeNDAP: http://www.opendap.org Thank you!

More Related