1 / 10

Leveraging External Data Sources for Data Science Projects

Explore how to access and use external data from reputable sources like NASA, EPA, and USGS for data science projects. Learn how to find, access, and utilize diverse data sets effectively. Dive into a class exercise involving collaborative data exploration.

damali
Download Presentation

Leveraging External Data Sources for Data Science Projects

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Class exercise - Working with someone else’s data Peter Fox Data Science – ITEC/CSCI/ERTH-6961-01 Week 9, November 2, 2009

  2. Reading – data resources • Department of Energy EIA • Humanities - Digging into Data • Environmental Protection Agency (EPA) • US Geological Survey (and state surveys) (USGS) • NASA Earth Observing System (EOS) and ECHO • National Oceanic and Atmospheric Administration (NOAA) NODC, NGDC, NCDC • Department of Energy (DoE) • National Library of Medicine (NLM) • Cancer Grid (CaBIG) • OneGeology • data.gov • One of your own

  3. Contents • Is it possible to use someone else’s data – a quote from the trenches • Understanding appropriate data sources • Finding and accessing them • Using them • Defining a project

  4. From Carole Goble (Manchester) • “Scientists would rather share their toothbrush than their data” • However, some are made to share…

  5. Appropriate Data Sources • Remember the data management principles • Goal and investigation? • What is of interest?

  6. Finding and Accessing • From the lists already provided? • Web search?

  7. Using • The access interface • Form? • Web service? • Limits? • Formats? • Metadata conventions?

  8. Defining a Project: Class Exercise • Using someone else’s data • You will use someone else’s toothbrush • 4 groups of 5 people • Let’s discuss some options • Intent is to mix your skills/ interest and carry out a challenging data (collect/ manage/ use) exercise • Remainder of this class is to search, formulate, develop your ideas and discuss and seek guidance

  9. Groups • A – Tim, Jia, Vaanan, Brian, Chad • B – Eric, Jennifer, Ruby, Rajashree, Fred • C – Mandeep, Katy, Chitti, Cameron, Han • D – Kristin, Gino, Johanna, Dylan, Arun • Pat – you can choose (lucky you!)

  10. What is next • Assignment 4 on the wiki to guide your efforts • Due on Nov. 30 write up and Dec. 7 presentation • Note Term assignment also due that day but it is written and individual – will be handed out on Nov. 23 (week 12). • Next week • Data Analysis and Visualization • Reading: • Peirce and Semiotics • Data Analysis Tutorial • Modern Visualization • Periodic Table of Visualization

More Related