1 / 43

AIRS at the GES Data and Information Services Center (DISC)/DAAC

AIRS at the GES Data and Information Services Center (DISC)/DAAC. Gregory Leptoukh Gregory.G.Leptoukh@nasa.gov. Outline. AIRS processing, archive and distribution status Users’ questions and requests Tools and services Processing options Partnership for customized services.

edcard
Download Presentation

AIRS at the GES Data and Information Services Center (DISC)/DAAC

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. AIRS at the GES Data and Information Services Center (DISC)/DAAC Gregory Leptoukh Gregory.G.Leptoukh@nasa.gov

  2. Outline • AIRS processing, archive and distribution status • Users’ questions and requests • Tools and services • Processing options • Partnership for customized services AIRS STM, Spring '04, Greenbelt, MD

  3. AIRS Status at the GES DISC/DAAC • Processing: nominal • Reprocessing (collection 2) requirements: • 1x forward • 1x reprocessing • Actually averaging 1.74x on reprocessing • Currently over 2 months ahead of schedule • On 05/05/04, the 2nd anniversary of the launch; we are required to add 1x for reprocessing for a total of 2x AIRS STM, Spring '04, Greenbelt, MD

  4. Reprocessing: Projection AIRS STM, Spring '04, Greenbelt, MD

  5. Reprocessing: Completion AIRS STM, Spring '04, Greenbelt, MD

  6. Archive AIRS STM, Spring '04, Greenbelt, MD

  7. Production and Distribution to JPL GB) AIRS STM, Spring '04, Greenbelt, MD

  8. Data Pool Distribution (Volume) AIRS STM, Spring '04, Greenbelt, MD

  9. Data Pool Distribution (Granules) AIRS STM, Spring '04, Greenbelt, MD

  10. Distribution from the Archive AIRS STM, Spring '04, Greenbelt, MD

  11. Total Distribution AIRS STM, Spring '04, Greenbelt, MD

  12. Typical user questions • “What's the strength of the AIRS data?” • “How significantly does the AIRS data improve the numerical weather prediction?” • “Can we use AIRS data for mesh-scale system modeling and diagnostic studies?” • “Should I use MODIS or AIRS data for my research project in the area of ....?” • “We expect to see a continuous time series of AIRS data. What is your GDAAC's processing schedule? When will you fill the gaps?” AIRS STM, Spring '04, Greenbelt, MD

  13. Typical user questions • “I just need a time series of the AIRS data for North America. How I can get it?” • “I need 2 weeks of global AIRS L1B data, but the volume of my order can reach 0.5 TB or more. How can I get the data?” • “The L1B radiance data has file size of 120MB. I just need a very small fraction of the file. Is there any quick way to get the subset on-line?” • “I need water-vapor profile from AIRS products. Can you help me?” AIRS STM, Spring '04, Greenbelt, MD

  14. Typical User Requests and Comments • Data subsetting • Data mining • Request for processing algorithm • Request for processing customized data products • WHOM is not easy to use • DataPool data should have longer retention • Users show strong interest in L3 products • Data reduction and/or compression AIRS STM, Spring '04, Greenbelt, MD

  15. Services and Tools (Operational) • L1B on-demand subsetting • NADM for AIRS data mining activities • Desk-top tools: • HDFLook • HDF-reader for AIRS • L1B/L2 QuickViewer, • L1B granule data global stitching tool AIRS STM, Spring '04, Greenbelt, MD

  16. Services and Tools (Operational) • "Global browse image gallery" for AIRS • WHOM/DataPool embedded preview/browsing feature • WHOM/DataPool embedded “summary browse image search” • AIRS data quick search AIRS STM, Spring '04, Greenbelt, MD

  17. Services and Tools (almost done) • L1B/L2 data on-the-fly subsetting • L2 data on-demand subsetting • AIRS data visualization toolkit AIRS STM, Spring '04, Greenbelt, MD

  18. AIRS STM, Spring '04, Greenbelt, MD

  19. Saharan Dust Across West Africa On March 3rd, you began to see the dust plume (Jason Li) AIRS STM, Spring '04, Greenbelt, MD

  20. Saharan Dust Across West Africa Dust storm is in full swing (March 4th) - found from the global visible image (JL) AIRS STM, Spring '04, Greenbelt, MD

  21. Visible/NIR Level 1&2 Granule Browse Images AIRS STM, Spring '04, Greenbelt, MD

  22. Corresponding MODIS Image AIRS STM, Spring '04, Greenbelt, MD

  23. Level 1&2 Granule Browse Images AIRS STM, Spring '04, Greenbelt, MD

  24. Level 1&2 Granule Browse Images AIRS STM, Spring '04, Greenbelt, MD

  25. Level 1&2 Granule Browse Images AIRS STM, Spring '04, Greenbelt, MD

  26. Partnering with GES DISC/DAAC • The development of these tools and services seem to be going well. However… • It could have been completed sooner if given a sufficient budget • What can be done when the budget is shrinking? • The only way to develop customized tools and services is through partnerships! AIRS STM, Spring '04, Greenbelt, MD

  27. What Can We Do for You, AIRS Scientists and Users? • We can show you optimal ways to receive data from us • We can subset data spatially and/or by parameter • We can build interfaces so you can do your analysis online, without having to download all of the data AIRS STM, Spring '04, Greenbelt, MD

  28. What can we do for you? (cont.) • We can process data at the GES DISC/DAAC (next to the input data) with your algorithms: • As a PGE within the main processing stream • As a stand-alone code next to the Data Pool • As a build-it-yourself code within NADM • As an on-the-fly analysis within *OVAS … So you can concentrate on science … AIRS STM, Spring '04, Greenbelt, MD

  29. Can You Do All This Without Us? Yes, you can do it yourself (requires significant data management): • Find, request and get data • Subset data (channel/parameter, area) • Colocate with other data • Build and maintain a data management system • Deal with time consuming and expensive data flows • Build and maintain you own processing system • Run processing operationally … But how much time and cost can you afford? AIRS STM, Spring '04, Greenbelt, MD

  30. Why Are We Suggesting That You Partner With Us? It helps you: • To concentrate on science, while we handle data management, and data processing. • We already have an infrastructure that supports a wide spectrum of options, from simple data support to sophisticated online analysis tools. • We can do it faster and cheaper. AIRS STM, Spring '04, Greenbelt, MD

  31. Why Are We Suggesting That You Partner With Us? (Cont.) It helps us: • We can time your data acquisition with the beginning of the major reprocessing campaign. • We can serve more users more efficiently. • We can better prioritize our online holdings. AIRS STM, Spring '04, Greenbelt, MD

  32. How Much Does It Cost?Matching Funds • In some cases, it is still part of our core work, and we will do our best to help users • In other cases, it is almost no extra labor cost for us, but we might need to buy more CPU and disk space • In a few cases, we need some funding to support our level of effort - from a few days to a few weeks AIRS STM, Spring '04, Greenbelt, MD

  33. Example: Near-Archive Data Mining (NADM) • Manage user’s research data more efficiently • Decrease download time by applying algorithm closer to the data • Access 50 TB of online data • Algorithm language (C, FORTRAN or IDL) • Cost to you: minimal (to cover extra disk space and extra CPU) http://g0dug03u.ecs.nasa.gov/OPS/www/nadm AIRS STM, Spring '04, Greenbelt, MD

  34. Example: (M/T)OVAShttp://lake.nascom.nasa.gov/www/online_analysis/ Started as TRMM Online Visualization and Analysis System. Then, in collaboration with Yoram Kaufman, a MODIS instance has been developed to support the AEROCENTER. It can be used in a wide variety of Earth science applications: climate and weather events study and monitoring, data products comparison. It can be easily configured for new applications. AIRS STM, Spring '04, Greenbelt, MD

  35. Accumulation (mm) TRMM Online Visualization and Analysis System T O V A S Makes it Simple Rainfall Rate (mm/h) Rainfall accumulation (mm) Rainfall rate (mm/h) AIRS STM, Spring '04, Greenbelt, MD

  36. Example: TOVAShttp://lake.nascom.nasa.gov/www/online_analysis/ The Power of Simplicity: Makes TRMM and other gridded precipitation data available in a format that anyone can learn to use within minutes and put to work productively for research or applications. With TOVAS and a few mouse clicks, one can easily obtain precipitation information from around the world. AIRS STM, Spring '04, Greenbelt, MD

  37. Example: TOVAShttp://lake.nascom.nasa.gov/www/online_analysis/ Output options available now: • Area plot – averaged or accumulated over any available data period for any rectangular area. • Time plot – time series averaged over any rectangular area. • Hovmoller plots – image view of any longitude-time and latitude-time cross sections. • ASCII output – for all plot types. Can be imported into GIS applications. • Image animation – for area plot. AIRS STM, Spring '04, Greenbelt, MD

  38. Example: MOVAS Interface AIRS STM, Spring '04, Greenbelt, MD

  39. Example: MOVAS (area plot) AIRS STM, Spring '04, Greenbelt, MD

  40. Example: MOVAS (area plot) AIRS STM, Spring '04, Greenbelt, MD

  41. Example: MOVAS (Time-series) AIRS STM, Spring '04, Greenbelt, MD

  42. Example: MOVAS (Hovmoller) AIRS STM, Spring '04, Greenbelt, MD

  43. Conclusion • AIRS at the GES DISC/DAAC seems to be moving in the right direction • AIRS data size reduction will boost usage of Level 1 & 2 data online • AIRS Level 3 data are long awaited • AIRS scientists and users should partner with the GES DISC/DAAC, to optimally deal with: • Data access • Data processing • Data analysis options AIRS AIRS STM, Spring '04, Greenbelt, MD

More Related