460 likes | 582 Views
This initiative aims to revolutionize how organizations find and utilize climate change data. Recognizing the non-stationarity of climate dynamics, it seeks to address the challenges posed by overwhelming volumes of data and outdated analytical techniques. By leveraging cloud computing and enterprise data management, we strive to maximize the value of climate data. Our goal is to support vulnerability analyses, enhance planning processes, and foster informed decision-making. Join us in this paradigm shift towards smarter, data-driven solutions for climate challenges.
E N D
Making Climate Change Data Easier to Find and Use Michael CorselloSeshu Vaddey Michael.Corsello@ieee.org http://Eclime.blogspot.com
Climate Change is a Paradigm Shift • In how we think of climate dynamics: • Non-Stationarity Michael.Corsello@ieee.org http://Eclime.blogspot.com
Climate Change is a Paradigm Shift • In how we work • As Planners, Engineers, Biologists, Hydrologists, etc. Michael.Corsello@ieee.org http://Eclime.blogspot.com
Climate Change is a Paradigm Shift • Goal: Maximize the value of climate data in your organization • Aid in Vulnerability Analyses • Support Planning Processes • Support Decision Making Frameworks Michael.Corsello@ieee.org http://Eclime.blogspot.com
Otherwise • We are using old analytical techniques • Designed for an old paradigm • Being applied to a new paradigm of problems Michael.Corsello@ieee.org http://Eclime.blogspot.com
Example • You get new Climate Change data Michael.Corsello@ieee.org http://Eclime.blogspot.com
Example • What’s the first thing you do? Michael.Corsello@ieee.org http://Eclime.blogspot.com
Example • Try to put it into excel Michael.Corsello@ieee.org http://Eclime.blogspot.com
Take a closer look at ClimateChange data • UW CIG CBCCSP • 2 emission scenarios • 10 GCM’s • 3 downscaling methods • From available total of • 6 emission scenarios • 23 GCM’s • Multiple Approaches Michael.Corsello@ieee.org http://Eclime.blogspot.com
Take a closer look at ClimateChange data Michael.Corsello@ieee.org http://Eclime.blogspot.com
Take a closer look at ClimateChange data Michael.Corsello@ieee.org http://Eclime.blogspot.com
Take a closer look at ClimateChange data Michael.Corsello@ieee.org http://Eclime.blogspot.com
Take a closer look at ClimateChange data Michael.Corsello@ieee.org http://Eclime.blogspot.com
Take a closer look at ClimateChange data Michael.Corsello@ieee.org http://Eclime.blogspot.com
Working with Climate Change data • The Challenge • Volume of data swamps Cyber Infrastructure • Steep learning curves to use new tools • Tools are always changing Michael.Corsello@ieee.org http://Eclime.blogspot.com
Enter the Web and Cloud computing • Software as a Service • Platform as a Service • Infrastructure as a Service Michael.Corsello@ieee.org http://Eclime.blogspot.com
Enterprise Data Management • Move away from data living on our computers Michael.Corsello@ieee.org http://Eclime.blogspot.com
Enterprise Data Management • The data and tools / applications now reside on servers (Cloud) • The data is now more crucial than ever • We all “share” common sets of data “through” the cloud Michael.Corsello@ieee.org http://Eclime.blogspot.com
Enterprise Data Management Management of data is paramount • The data and tools / applications now reside on servers (Cloud) • The data is now more crucial than ever • We all “share” common sets of data “through” the cloud Michael.Corsello@ieee.org http://Eclime.blogspot.com
Summary • The need for a paradigm shift • In how we work • This new paradigm must provide for • Ease of use, and value to the organization (Return on Investment) • CRF is working towards this goal • We need users across different domains to work with us Michael.Corsello@ieee.org http://Eclime.blogspot.com
Questions? Blog: http://Eclime.blogspot.com Breakout Discussion Session Wednesday at 10am
CRF Developed Solution Michael.Corsello@ieee.org http://Eclime.blogspot.com
CRF Developed Solution Develop series of database structures Based upon “real-world things” (like flows) Michael.Corsello@ieee.org http://Eclime.blogspot.com
CRF Developed Solution • Organize these structures into separate databases for each “domain aspect” • Rather than a single monolithic database. Michael.Corsello@ieee.org http://Eclime.blogspot.com
CRF Developed Solution Cloud Based Data Warehouse Michael.Corsello@ieee.org http://Eclime.blogspot.com
Metadata Examples • An important form of metadata is “chain of custody” (provenance) • Talks about the process by which data originates • What processing methods were used? • What was the source data? • Who did the work? • Another important form of metadata is descriptive • When was the sensor last calibrated? • What was the nominal error as defined by the manufacturer? • What is the temporal nature of the data (does it “expire”)? • What about licensing info? • Metadata can often be “linked” rather than “stored” Michael.Corsello@ieee.org http://Eclime.blogspot.com
The real Challenge with Climate Change? • We want the ONE true answer to Climate Change • The rest of the data is meaningless • Because the paradigm we work with is deterministic • We have a hard time dealing with uncertainty Michael.Corsello@ieee.org http://Eclime.blogspot.com
Cloud Computing Basics • Move computing from device oriented to resource oriented • Give me enough computing resources to get an answer • I don’t care where • Software as a Service • Software is delivered as an online service • Salesforce.com, Mint.com, Office 365 • Platform as a Service • A software platform (e.g. Sharepoint, Drupal) is provided as a service • Your agency customizes the platform to your needs • Infrastructure as a Service • You rent “virtual machines” and set them up as you see fit • Basically a “virtual” computer • Add or remove machines “on-demand” Michael.Corsello@ieee.org http://Eclime.blogspot.com
Data Models Michael.Corsello@ieee.org http://Eclime.blogspot.com
Workflows • More data to manage as we create more data • All of our “final” data • Much of our “working” data Michael.Corsello@ieee.org http://Eclime.blogspot.com
Workflows • Management translates to • Ease of Access to Data • Analysis / Modeling with Data • Results & Reporting • Store Results for future use Michael.Corsello@ieee.org http://Eclime.blogspot.com
CRF Developed Solution Developed Web and Desktop Tools to Access the Database(s) Michael.Corsello@ieee.org http://Eclime.blogspot.com