Share and Publish Your Data and Models with HydroShare

1. Share and Publish Your Data and Models with HydroShare David Tarboton, Ray Idaszak, Jeffery Horsburgh, Dan Ames, Jon Goodall, Larry Band, Venkatesh Merwade, Alva Couch, Rick Hooper, David Maidment, Pabitra Dash, Michael Stealey, Hong Yi, Tian Gan, Tony Castronova, Brian Miles, Zhiyu Li, Mohamed Morsy, Shaowen Wang, Yan Liu USU, RENCI, BYU, UNC, UVA, CUAHSI, Tufts, Texas, Purdue, Caktus, NCSA http://www.hydroshare.org OCI-1148453 OCI-1148090 2012-2017

2. Motivation • Advancing Hydrologic Understanding • requires integration of information from multiple sources • is data and computationally intensive • requires collaboration and working as a team/community Analysis Grand challenge (NRC 2001): Better hydrologic forecasting that quantifies effects and consequences of land surface change on hydrologic processes and conditions Data Models Floods and Droughts

3. Web Based Collaboration Environment www.hydroshare.org Enable more rapid advances in hydrologic understanding through collaborative data sharing, analysis and modeling

4. Data and models used by hydrologists are diverse… • Time series • Geographic rasters • Geographic features • Multidimensional space/time • Model programs • Model instances • … http://www.usgs.gov http://www.unidata.ucar.edu http://www.esri.com From Jeff Horsburgh

5. At its heart, HydroShare is a system for sharing Resources and Collaborating • Files and sets of files structured to represent a hydrologic process, model, or element in the hydrologic environment • Standard data models enhance interoperability and support functionality “hydro value added” • Tools (Web apps) that act on resources to visualize, modify and create new resources • Encode standard/best practices • Access control and sharing model

6. Architecture • Web software to operate on content you have access to (Apps) • Extensibility • Organize and annotate your content • Manage access HydroShare Apps Django website API Actions on Resources Resource exploration OAuth API API Anyone can set up a server/app platform (software service) to operate on HydroShare resources through iRODS and API iRODS “Network File System” Distributed file storage SWATShare (Hubzero) CyberGIS Unidata - THREDDS, Hyrax Landlab ? Parallels the paradigm for how PC’s are used CyberGIS Data Store HydroShare Data Store

7. HydroShare Functionality • Sharing and publication of data (DOI) • Social discovery and added value • Model sharing • Model input data preparation • Model execution • Visualization and analysis (best of practice tools) Collaboration, Reproducibility, Credit, Transparency Clearing your desk! • Server/Cloud Computation • Platform independence • Big data • Reproducibility • Reduce needs for software installation and configuration

8. Clearing your desk. The trend towards network (cloud) computing. Can we deliver Hydrologic Research and Analysis functionality as a service over the web? Data Sources Server Software as a Service Functions and Tools Users Based on slide from Norm Jones

9. http://apps.hydroshare.org supports web based visualization and analysis working with HydroShare Resources

10. Hydrologic Terrain Analysis (TauDEM) Pit Removal Raw DEM Flow Related Terrain Information Flow Field Watersheds are the most basic hydrologic landscape elements http://hydrology.usu.edu/taudem

11. Ridge sr sr pr pr vr vr Point of interest Stream ps ps vs vs ss ss hr hr hs hs TauDEM generalized terrain flow surfaces Distance to stream (vertical) Decaying accumulation Dinfinity contributing area Distance Down and Distance Up

12. Using TauDEM today requires • Expertise in Hydrologic DEM analysis • The software • ArcGIS licenses (for ArcGIS plugin) • The ability to install software • TauDEM command functions with MPI installation • Compilation for other platforms • Sufficient Hardware (RAM and Disk) • The data (uncompressed GeoTIFF, projected, consistent grid size and spatial reference)

13. TauDEM in CyberGIS http://gateway.cigi.illinois.edu/ Analysis submitted Analysis running Results data created Results Ready

14. An Example: TauDEM and Height above the Nearest Drainage (HAND) for flood inundation mapping • WRF + NOAH-MP + RAPID/SPRNT produce flows at reach scale • Need a way to obtain reach level hydraulic properties for inputs to these models • Need a way to map from reach scale stage to flood inundation depth • Exploit high resolution topography represented by a digital elevation model (DEM) Additional details are in: https://www.hydroshare.org/resource/f1d1d9b5b70f4174b650c899168f632a/

15. Height above the nearest drainage (HAND) flood mapping • Each stream reach has a water depth hw (e.g. from SPRNT) • Each stream reach has an ID • Each grid cell has the ID of the reach it connects to and the height above the nearest stream hs • Evaluate approximating inundation using hw-hs If(hw(id) > hs(id)) Inundation depth = hw(id) - hs(id) Else Inundation depth = 0

16. Reach based height above nearest drainage flood map example hw=9 ft hw=8 ft hw=11 ft hw=12 ft hw=14 ft hw=10 ft hw=15 ft

17. Terrain based derivation of “reach scale” hydraulic properties • A table with reach hydraulic parameters as keyed to hydrography • Derived from DEM or LIDAR For each Catchment For each height h Identify cells where hs < h Single Cell Plan Area =dx * dy Surface Area As Surface area Bed Area Approximates each cell as sloping plane L Wetted Bed Area Ab Volume = T V Volume T Cross Section Area A Depth h P Wetted Perimeter P T Top Width R Hydraulic Radius

18. Reach Hydraulic Properties Example 1 m inundation 3 m inundation

19. Terrain Approximated Reach Average Hydraulic Properties Hydraulic Radius Wetted Perimeter Cross-sectional Area Top Width Need to evaluate in Hydraulic Model (e.g. SPRNT)

20. HAND Conclusions • The height above nearest drainage approach suggested as way to rapidly approximate real time flood inundation • Includes an approach to approximate reach scale hydraulic properties • Need to evaluate versus more detailed (e.g. HEC-RAS) hydraulic model • Need to evaluate with HRT (LIDAR) vs general (NED) DEM as input

21. Summary • A new, web-based system for advancing model and data sharing • Access multiple types of hydrologic data using standards compliant data formats and interfaces • Flexible discovery functionality • Model sharing and execution • Facilitate and ease access to use of high performance computing • Social media and collaboration functionality • Links to other data and modeling systems

22. Thanks to the HydroShare team! • USU • RENCI/UNC • CUAHSI • BYU • Tufts • UVA • Texas • Purdue • SDSC • Caktus http://www.hydroshare.org OCI-1148453 OCI-1148090 2012-2017