Data Assimilation Workshop Notes - PowerPoint PPT Presentation

Data assimilation workshop notes
1 / 20

  • Uploaded on
  • Presentation posted in: General

Why and What is Data Assimilation? What Data Assimilation is not Key Challenges in Data Assimilation Key Challenges with respect to magnetospheric DA How magnetospheric DA differs from meteorological DA. Data Assimilation Workshop Notes.

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.

Download Presentation

Data Assimilation Workshop Notes

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript

Data assimilation workshop notes

Why and What is Data Assimilation?

What Data Assimilation is not

Key Challenges in Data Assimilation

Key Challenges with respect to magnetospheric DA

How magnetospheric DA differs from meteorological DA

Data Assimilation Workshop Notes

  • CU/LASP held a data assimilation workshop after Space Weather Week

  • Copies of the talks are available at

Lessons learned why and what is da

Purpose of data assimilation is to combine measurements and models to produce best estimate of current and future conditions.

Kalman filter often used as a method for data assimilation. It became popular because it is a recursive solution to the optimal estimator problem. (Only last time step of information needs to be stored.)

Full implementation of Kalman filter is usually not possible. There is a growing field in the study alternatives.

Lessons LearnedWhy and What is DA?

  • AD ≠ DA (The Assimilation of Data is not necessarily Data Assimilation)

  • Data assimilation does not require a physics-based model.

Data assimilation workshop notes

Model Types

Vector X contains all quantities on the grid, S is the external driver, M propagates the state forward

  • Linear:

  • Nonlinear:

  • Physical:

Challenges in da

Challenges in DA

  • Analyzed field does not match a realizable model state

  • Non-uniform and sparse measurements

  • Observed variables do not match variables predicted by the model

  • Observing systems are diverse and subject to error, sometimes poorly known

Challenges for magnetospheric da

Very sparse measurements

Diverse set of both forward and inverse models that are highly specialized and/or are expert in different areas.

Challenges For Magnetospheric DA

  • How to combine forward models (MHD, particle pushing) with inverse models (empirical, stochastic).

  • How to integrate data with these models

Data assimilation workshop notes







Satellite, Aircraft,

& Drift Buoys

Continued Improvements

Graphical to



Estimation &


Physical Modeling


Physical Modeling




4DDA in



and Rad-Belts

Discovery of



Empirical Studies

Leading to NASA’s

AE / AP Models


Radiation Belt


Magnetospheric Data Assimilation

Magnetospheric data assimilation baseline model considerations

Magneto-Hydrodynamic (MHD) and hybrid models are (currently) computationally prohibitive for many space-weather applications.

Incomplete physics result in significant scaling problems.

The system is strongly driven by poorly sampled boundary conditions.

Empirical baseline models provide an excellent interim solution for the radiation belts due to strong global dynamical coherence.

Magnetospheric Data Assimilation: Baseline Model Considerations

Specifying relativistic electrons in the outer radiation belt

CRRES-ELE used as a baseline model:

Good global coverage (L = 2.5 to ~6.7)

Good energy coverage (0.5 to 6.6 MeV)

Quasi-dynamic (6 geomagnetic activity levels based on Ap15 index)

Electron data to be assimilated / validated:

Los Alamos Geostationary Satellites (80, 84, 95)

NOAA GOES Satellites (8, 9)

GPS Satellites (24, 33, 39)

Pre-assimilation requirements:

Correct for CRRES-ELE B-field errors and satellite magnetic latitude

Cross-calibrate and normalize sensor data

Interpolate / extrapolate to fill gaps in data coverage

Re-parameterize geomagnetic activity based on GPS electron data

Specifying Relativistic Electrons in the Outer Radiation Belt

Data assimilation workshop notes

Four-Dimensional Data Assimilation

Real time optimal specification of radiation belt electrons

Based on AFRL


ORBSAF (Outer Radiation Belt Specification and Forecast) Program [Moorer and Baker, 2000]

Utilizes GOES, LANL and GPS data as inputs

Real-time, Optimal Specification of Radiation Belt Electrons

Data assimilation workshop notes

High Accuracy at Geostationary Orbit

Anomaly analysis actual electron flux at spacecraft location

Spacecraft—Brazilsat (A2)


References: Frederickson et al., 1991-92; Weenas, et al., 1979

Electron Flux: Discharges were observed on CRRES for fluxes > 5e5 #/cm2/sec for > 10 hours

Flux at Brazilsat location exceeded this threshold for 8 hours before failure

Electron Fluence: Discharges were observed at fluences greater than 1.8e10 electrons in a 10-hour period on CRRES

Assuming a nominal leak rate of 2e5 electrons/sec, fluence at Brazilsat location exceeded this figure for 2 hours prior to failure

Anomaly Analysis—Actual Electron Flux at Spacecraft Location

Dynamical model identification

Dynamical Model Identification

Why linear prediction filters

Days Since Solar Wind Impulse

Why Linear Prediction Filters?

SISO Impulse Response

Operational Forecasts


Extended kalman filter ekf

Model parameters can be incorporated into a state-space configuration.

Process noise (vt) describes time-varying parameters as a random walk.

Observation error noise (et) measures confidence in the measurements.

Provides a more flexible and robust identification algorithm than RLS.

Extended Kalman Filter (EKF)

Adaptive single input single output siso linear filters

Adaptive Single-Input, Single-Output (SISO) Linear Filters

EKF-Derived Model Coefficients (w/o Process Noise)

EKF-Derived Model Coefficients (with Process Noise)

Siso model residuals

SISO Model Residuals

Multiple input output mimo

Multiple Input / Output (MIMO)

Average prediction efficiencies

Average Prediction Efficiencies


EKF-MIMO PE (w/o process noise)

EKF-MIMO PE (with process noise)

Alternative model structures

ARMAX, Box-Jenkins, etc.

Better separation between driven and recurrent dynamics.

Colored noise filters.

True, non-linear dynamic feedback.

Alternative Model Structures

Combining the State and Model Parameters

  • True data assimilation.

    • Issues exist with bias and stability of the EKF algorithm.

    • Ideal for on-line specification and forecast model.

    • Framework is amenable to physics-based dynamics modules.

  • Login