1 / 31

Remote Instrumentation and Sensor Networks on the Great Barrier Reef

Remote Instrumentation and Sensor Networks on the Great Barrier Reef. CIMA based sensor networks… Ian Atkinson Ian.Atkinson@jcu.edu.au. Sensor Networks: will enable us to monitor our environment more closely than ever before.

terentia-avis
Download Presentation

Remote Instrumentation and Sensor Networks on the Great Barrier Reef

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Remote Instrumentation and Sensor Networks on the Great Barrier Reef CIMA based sensor networks… Ian Atkinson Ian.Atkinson@jcu.edu.au

  2. Sensor Networks: will enable us to monitor our environment more closely than ever before. Grid computing: will enable the distribution of data collected to researchers around the globe in real time, as well as storing the massive amounts of historical data in online repositories. The challenge: Streamlining the transfer of data from sensors to researchers and managers. New Technologies…

  3. Major Projects ReefGrid Remote Instrument Monitoring

  4. RoadNet: SIO, SDSC, UCSD http://roadnet.ucsd.edu

  5. Frank Vernon, SIO

  6. Rutgers Cool Room: Costal Observatories http://marine.rutgers.edu/cool

  7. ReefGrid is a pilot project to develop the technologies to allow real time sensor network monitoring of the Great Barrier Reef (GBR). NCRIS-Integrated Marine Observation System GBR monitoring program Encompasses the entire e-Research data flow ReefGrid Data Ingestion and Storage Data Aggregation Data Dissemination Data QA/QC Sensors Data Transport • Foundation for QOOS: Queensland Oceans Observing System

  8. ReefGrid @ Davies • Davies Reef is the location for the initial deployment of a sensor network on the GBR • Davies Reef is ~100km East of Townsville. Data has to be sent 80km to AIMS.

  9. GBR Network? Local Communications Networks

  10. AIMS’ Weather Station at Davies Reeg is being used as a base for the sensor network. A hybrid power system with wind and solar energy and battery back up powers the system. ReefGrid @ Davies

  11. ReefGrid @ DaviesThe Sensors Data Ingestion and Storage Data Aggregation Data Dissemination Sensors Data QA/QC Data Transport • A range of sensor technologies is being used. The most important two are 1-Wire Sensors and Ambient Systems’ Wireless uNodes • These technologies provide low cost sensors that can be deployed in large numbers covering a wide area.

  12. HF ocean surface radar to monitor surface currents, wind directions and wave heights Capricorn and Bunker Group of reefs and islands in the southern part of the GBR 100 x100 km, 3km pixel April 2006 deployment Costal Radars (CODAR) Mal Heron, JCU

  13. ReefGrid @ DaviesData Aggregation Data Ingestion and Storage Data Aggregation Data Dissemination Sensors Data QA/QC Data Transport • Software tools that allow us to organise many different types of sensing devices for simple reference, access & probing. • System is scalable so that many sensors can be added. Data Sinks Data Aggregation Individual Sensors

  14. To add / remove / re-configure a sensor Make the change at the hardware level Update the configuration database Sink Source Root Sensor Push the new configuration file to the appropriate sink See http://www.reefgrid.org Sensor Gateway: Use Case

  15. ReefGrid @ DaviesData Transport Data Ingestion and Storage Data Aggregation Data Dissemination Sensors Data QA/QC Data Transport Two aspects of Data Transport: • the physical connection to sensor networks many 10’s of km off the coast • the protocols for interacting with the sensor network (retrieving data and interrogating the system).

  16. ReefGrid @ DaviesData Transport Data Ingestion and Storage Data Aggregation Data Dissemination Sensors Data QA/QC Data Transport • microwave link to provide data communications between the sensor network at Davies Reef and the mainland. • "evaporation duct" just above the ocean, allows microwaves to propagate around the curved surface of the Earth. • removes the need for a line-of-site connection between the two ends of the microwave link.

  17. ReefGrid @ DaviesData Transport JAINIS Data Ingestion and Storage Data Aggregation Data Dissemination Sensors Data QA/QC Data Transport • The protocols for communications with the Grid are tied to an overall dataflow that includes QA/QC and ingestion of data into storage facilities. • JAINIS (JCU And INdiana University Instrument Services). • CIMA provides a consistent and reusable framework for including shared instrument resources distributed Grids. • Several enhancements have been made to the CIMA implementation

  18. ReefGrid @ DaviesJAINIS JAINIS Data Ingestion and Storage Data Aggregation Data Dissemination Sensors Data QA/QC Data Transport • JAINIS has a structure that has an Instrument Representative that allows the instrument (or data sink in ReefGrid) to be represented as a web service. • This web service can be accessed by a Data Manager to control the flow of data through QA/QC and preprocessing to a data repository. • The Web Services can also be used to stream live data and to provide interactive control over the sensor network.

  19. CIMA core code from IU JCU/DART reengineered CIMA code SDSC Components ReefGrid @ DaviesJAINIS Data Manager CIMA Instrument Representative Data Sinks/ Sensors Kepler mediated Experimental logic CIMA SOAP Interface Live Data Feeds, Instrument Control GridSphere Portal Workflow & computational Pipelines, Automatic metatdata generation PGL Applications/ Processing SRB MCAT SRB Data Repository (data and metadata)

  20. ReefGrid @ DaviesData Manager Data Ingestion and Storage Data Dissemination Sensors Data Aggregation Data QA/QC Data Transport • JAINIS uses Kepler as its Data Manager. • Kepler provides a graphical user interface allowing the user to define workflows. • Metadata can be automatically generated in Kepler based on input data from the Instrument Representative

  21. ReefGrid @ DaviesData Manager Data Ingestion and Storage Data Dissemination Sensors Data Aggregation Data QA/QC Data Transport • QA/QC routines are performed in Kepler. • Preprocessing can also be performed in Kepler (e.g. converting units of a measurement) • Kepler can controls the location where data is stored (creating file names and directories, metadata)

  22. ReefGrid @ DaviesData Ingestion and Storage Data Ingestion and Storage Data Aggregation Data Dissemination Sensors Data QA/QC Data Transport • In the JAINIS implementation, the data is stored using SRB (Storage Resource Broker). • Heterogenous storage devices act as single logical storage • Metadata Catalogue Service (MCAT) • Stores metadata associated with objects • Metadata is vital for finding data in large data stores, as well as describing how the data was collected, what QA/QC and what pre-processing has been done

  23. Implementation of a web-based digital library (Gridsphere portlets) Provides an interface to templated metadata manipulation Define object classes (Images, reports, datasets...) Define appropriate metadata tags Define metadata display template Uses SRB to manage the digital objects and the metadata Exists by placing a metadata template file in a directory - used by interface to render library Personal Grid Library: PGL http://plone.jcu.edu.au/hpc/staff/projects/hpc-software/personal-grid-library/documentation/pgl-project-information

  24. PGL: Interface and metadata/annotations http://ngportal.hpc.jcu.edu/gridsphere/gridsphere

  25. ReefGrid @ DaviesData Ingestion and Storage Data Ingestion and Storage Data Aggregation Data Dissemination Sensors Data QA/QC Data Transport • Integrating SRB with content management systems (plone).

  26. ARC Research Network on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP). ARC Research Network for Materials and Molecular Sciences (MMSN). Key partner of Queensland Cyber-Infrastructure Foundation (QCIF). Australian Partnership for Advanced Computing (APAC). Ambient Systems and University of Twenté (Netherlands) Indiana University (USA). San Diego Supercomputing Centre. EM Solutions (Brisbane). JCU e-Research and Sensor Network Collaborations

  27. Custom portals / Research codes Compute resources Sensor Data Flows Summary • Sensor Networks • Temp, salinity, • Light, turbidity, etc. Data Manager Microwave links - via humidity ducting Kepler mediated Experimental logic CIMA SOAP Interface Internet Data ‘Sinks’ Grid computing Local and remote Workflow & computational pipelines, Automatic metatdata generation ––Wireless data links • Data Sinks enable • Simple sensor configuration Interface • Scalability / ease of maintenance • Model for ‘plug and play’ sensor configuration • Security • Automatically update backend data structures • Developed by DART for Davies Reef SN Platform • Network & sensor monitoring Data Repository SRB MCAT AODC-JF & other portals • Sensor Devices • Inexpensive, commodity inspired • Ad hoc network • Above and below water wireless network & wired • Many partners involved Disk/Tape Storage (multiple locations) Great Barrier Reef -Ocean Observing System

  28. Register Notify Microwave link Locate Events/Streaming Request/Response Instrument Semantics, Metadata Registry and directory server Web Services interface Data Acquisition Code(s) Analysis Codes Storage Storage

  29. DIMSIM: Distributed Integrated Multi-Sensor and Instrument Middleware

More Related