130 likes | 249 Views
Querying Integrated Observation and Measurement data. SONet June 8,2010. Framework. Query 1. Query 2. Result Q1. Result Q2. … …. … …. Online query engine. File 1. OBOE-aware DB. File 2. Offline data processing. Annotation 1. Annotation 2. Annotation 4. Annotation 3. File 3.
E N D
Querying Integrated Observation and Measurement data SONet June 8,2010
Framework Query 1 Query 2 Result Q1 Result Q2 … …. … …. Online query engine File 1 OBOE-aware DB File 2 Offline data processing Annotation 1 Annotation 2 Annotation 4 Annotation 3 File 3 Annotation interface File 4 OBOE domain model …
Annotation as a bridge Map Measurement type table Observation Type table File 1 Entity type table Context type table File 2 OBOE-aware DB File 3 Offline data processing Annotation 1 Annotation 2 Annotation 4 Annotation 3 File 4 …
Annotation as a bridge Map (for ann1, 2, …) Measurement type table (for ann1, 2, …) Observation type table (for ann1, 2, …) File 1 Entity type table (for ann1, 2, …) File 2 Context type table (for ann1, 2, …) OBOE-aware DB File 3 Annotation 1 Annotation 2 Annotation 4 Annotation 3 File 4 …
Raw data loading Map (for ann1, 2, …) Measurement type table (for ann1, 2, …) Table 4 Table 3 Observation type table (for ann1, 2, …) Table 2 File 1 Table 1 Entity type table (for ann1, 2, …) … File 2 Context type table (for ann1, 2, …) OBOE-aware DB File 3 Offline data processing (raw data loading) Annotation 1 Annotation 2 Annotation 4 Annotation 3 File 4 …
Data materialization Map (for ann1, 2, …) Measurement type table (for ann1, 2, …) Table 4 Measurement table Table 3 Observation type table (for ann1, 2, …) Table 2 Observation table File 1 Table 1 Entity type table (for ann1, 2, …) Entity table … File 2 OBOE-aware DB Context type table (for ann1, 2, …) Context table File 3 Offline data processing (data materialization) Annotation 1 Annotation 2 Annotation 4 Annotation 3 File 4 …
Data materialization Measurement Table (for file 1, 2, …) Map (for ann1, 2, …) Measurement type table (for ann1, 2, …) Table 4 Observation table (for file 1, 2, …) Table 3 Observation type table (for ann1, 2, …) Table 2 Entity table (for file 1, 2, …) File 1 Table 1 Entity type table (for ann1, 2, …) … Context table (for file 1, 2, …) File 2 Context type table (for ann1, 2, …) OBOE-aware DB File 3 Annotation 1 Annotation 2 Annotation 4 Annotation 3 File 4 …
Query strategy 1 Measurement Table (for file 1, 2, …) Online query engine (query re-writing over raw data) Map (for ann1, 2, …) Measurement type table (for ann1, 2, …) Table 4 Observation table (for file 1, 2, …) Table 3 Observation type table (for ann1, 2, …) Table 2 Entity table (for file 1, 2, …) Table 1 Entity type table (for ann1, 2, …) … Context table (for file 1, 2, …) Context type table (for ann1, 2, …) OBOE-aware DB
Query strategy 2 Measurement Table (for file 1, 2, …) Online query engine (query re-writing over materialized data) Map (for ann1, 2, …) Measurement type table (for ann1, 2, …) Table 4 Observation table (for file 1, 2, …) Table 3 Observation type table (for ann1, 2, …) Table 2 Entity table (for file 1, 2, …) Table 1 Entity type table (for ann1, 2, …) … Context table (for file 1, 2, …) Context type table (for ann1, 2, …) OBOE-aware DB
Query strategy n?? Measurement Table (for file 1, 2, …) Online query engine Map (for ann1, 2, …) Measurement type table (for ann1, 2, …) Table 4 Observation table (for file 1, 2, …) Table 3 Observation type table (for ann1, 2, …) Table 2 Other materialization?? RDF triple store? Entity table (for file 1, 2, …) Table 1 Entity type table (for ann1, 2, …) … Context table (for file 1, 2, …) Context type table (for ann1, 2, …) OBOE-aware DB
Query • Tree[Height > 5 Meter]: return datasets that have at least one Tree observation containing a Height measurement with a value greater than 5 Meters • Tree[Height > 5 Meter], Soil[Acidity >= 7 pH]: return datasets that contain at least one Tree observation (having a measurement where the Height was greater than 5) and at least one Soil observation (having an Acidity measurement of 7 or greater).
Query • Tree[Height > 5 Meter] -> Soil[Acidity >= 7pH]: • Incorporates context via the "->” (arrow) symbol, which can be read as "contextualized by" or "has context". • The query returns datasets that contain at least one Tree observation (with the corresponding height value) where the observation was taken within the context of a Soil observation (with the corresponding acidity value). • …
Queries • ????