1 / 34

QuakeSim Project: Portals and Web Services for Geo-Sciences

QuakeSim Project: Portals and Web Services for Geo-Sciences. Marlon Pierce Indiana University mpierce@cs.indiana.edu. QuakeSim Project Summary. Goal is to provide a distributed environment for connecting scientific computing and data resources with Web based user interfaces.

swhitfield
Download Presentation

QuakeSim Project: Portals and Web Services for Geo-Sciences

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. QuakeSim Project: Portals and Web Services for Geo-Sciences Marlon Pierce Indiana University mpierce@cs.indiana.edu

  2. QuakeSim Project Summary • Goal is to provide a distributed environment for connecting scientific computing and data resources with Web based user interfaces. • QuakeSim’s IT development includes • Portals for user interfaces. • Web Services for running remote applications and accessing databases • Databases for semantic fault models and INSAR(USC) • This talk reviews major revisions that we have undertaken since 2006.

  3. Some QuakeSim Applications and Their Data Disloc, Simplex Fault models are used to calculate surface displacements (Disloc) using Okada method. Simplex is the inverse. GeoFEST (JPL/CalTech) Finite element code for detailed modeling of fault stresses, seismic displacements, uses fault models as input. Coupled to mesh generation tools Regularized Dynamic Annealing Hidden Markov Method (RDAHMM) (JPL) Time series analysis code, can be applied to GPS and seismic archives. Identifies signal components (possibly associated with underlying physical causes) with no fixed parameters.

  4. Browser Interface HTTP(S) Portlets + Client Stubs SOAP/HTTP WSDL WSDL WSDL WSDL WSDL WSDL WSDL WSDL DB Service Job Sub/Mon And File Services Visualization Or Map Service JDBC DB DB Operating and Queuing Systems Host 1 (Quaketables) Host 2 (Grid) Host 3 (G Maps)

  5. Some Design Choices • Build portals out of portlets (Java Standard) • Reuse capabilities from our Open Grid Computing Environments (OGCE) project, the REASoN GPS Explorer project, and many TeraGrid Science Gateways. • Decorate with Google Maps, Yahoo UI gadgets, etc. • Use Java Server Faces to build individual component portlets. • Build standalone tools, then convert to portlets at the very end. • Use simple Web Services for accessing codes and data. • Keep It Stateless … • Use Condor-G and Globus job and file management services for interacting with high performance computers. • TeraGrid • Favor Google Maps and Google Earth for their simplicity, interactivity and open APIs. • Generate KML and GeoRSS • Use Apache Maven based build and compile system, SVN on SourceForge

  6. Daily RDAHMM Updates Daily analysis and event classification of GPS data from REASoN’s GRWS.

  7. Disloc output converted to KML and plotted.

  8. Simplex refines fault models from GPS displacements

  9. TeraGrid Supercomputing Resources (GPIR)

  10. UCSB’s Queue Prediction Service (QBETS) Forecasts time you will wait in the queue on various TG super computers. Inherited from OGCE project.

  11. GeoFEST Finite Element Modeling portlet and plotting tools

  12. What Is a Gadget? Simple gadgets for getting a Grid proxy credential and running remote commands. Both run on my own Web server.

  13. Google Reader and GeoRSS

  14. Google Maps and GeoRSS

  15. Google Earth and KML

  16. More Information • Email: mpierce@cs.indiana.edu • QuakeSim Web Site: • www.quakesim.org • Portal URL: • http://gf7.ucs.indiana.edu:8080/gridsphere • Portal SourceForge Page: • https://sourceforge.net/projects/crisisgrid • Code SVN: • http://crisisgrid.svn.sourceforge.net/viewvc/crisisgrid/

  17. Acknowledgments • QuakeSim work is funded by NASA AIST (A. Donnellan, PI) and ACCESS (Y. Bock, PI) programs. • Indiana University developers: Galip Aydin, Xiaoming Gao, Zhigang Qi • Robert Granat (JPL), Jay Parker (JPL), Maggi Glasscoe (JPL), John Rundle (UC-Davis), Harout Nazerian (JPL), Rami Al-Ghanmi (USC), Dennis Mcleod (USC), Paul Jamason (Scripps), Ruey-Juin Chang (Scripps), Gerry Simila (CSUN)

  18. Stop Talking Now, Champ

  19. Grid Job Submission • Globus provides a universal queuing system interface. • PBS, LoadLeveler, Sun Grid Engine, LSF • We chose Condor-G as our job management software for submitting jobs to HPC queuing systems. • University of Wisconsin • Works with Globus, Matlab DCE, Unicore, etc. • We co-locate Condor-G with our GeoFEST Web Service. • Communication is through Birdbath, Condor’s Web Service interface. • So GeoFEST service API is more or less the same, just now Grid enabled. • We also plan to release a general version of this service. • Condor command line and Birdbath have different names for job description parameters. • Big Easter Egg hunt to find this, but now we know.

  20. Portlet Summary

  21. Security Concerns They’ll see the Big Board!

  22. QuakeSimDistributed Environment for Modeling Observations

  23. Managing Real Time GPS Data Slides from Galip Aydin

  24. California Real Time Network Continuous GPS Stations (CGPS) are depicted as triangles while the Real-Time stations are represented as circles. Image is obtained from SOPAC GPS Explorer at http://sopac.ucsd.edu/projects/realtime How does one manage all the data generated by the 85 stations? How can you get just the data you want? Note this is fundamentally different from traditional request/response style Web Services.

  25. Processing Real-Time GPS Streams RYOPorts 7010 Scripps RTDServer Raw Data 7011 7012 NB Server GPS Networks Station Health Filter ryo2nb ascii2pos Single Station Displacement Filter RDAHMM Filter ryo2ascii ryo2nb ascii2pos Single Station RDAHMM Filter ascii2gml ryo2ascii /SOPAC/GPS/CRTN01/RYO Raw Data /SOPAC/GPS/CRTN01/ASCII /SOPAC/GPS/CRTN01/POS /SOPAC/GPS/CRTN01/DSME A Complete Sensor Message Processing Path, including a data analysis application.

  26. Application Integration with Real-Time Filters • Station Monitor Filter records real-time positions for 10 minutes and calculates position changes • Graph Plotter Application creates visual representation of the positions. • RDAHMM Filter records real-time positions for 10 minutes and invokes RDAHMM application which determines state changes in the XYZ signal. • Graph Plotter Application creates visual representation of the RDAHMM output.

  27. 2 – Multiple Publishers Test Topic 2 Topic 1A Topic n Topic 1B We add more GPS networks by running more publishers. The results show that 1000 publishers can be supported with no performance loss. This is an operating system limit.

  28. 4 – Multiple Brokers Test RYO Publisher RYO To ASCII Converter Topic 1A NB Server 1 Topic 1B Simple Filter 1 Simple Filter 2 Simple Filter 750 Simple Filter 751 Simple Filter 752 Simple Filter 1500 NB Server 2 NB Server 2 Topic 1B NaradaBrokering allows creation of Broker networks. We create a two-broker network. Messages published to first broker can be received from the second broker. We take timings on each broker. We connect 750 clients to each broker and run for 24 hours. We chose 750 clients to stay well below the saturation limit. The results show that the performance is very good and similar to single broker test.

More Related