Data assimilation for high impact weather forecast
This presentation is the property of its rightful owner.
Sponsored Links
1 / 51

Data Assimilation for High Impact Weather Forecast PowerPoint PPT Presentation


  • 155 Views
  • Uploaded on
  • Presentation posted in: General

Data Assimilation for High Impact Weather Forecast. Yuanfu Xie NOAA/OAR/ESRL. Outline. Review data assimilation techniques; Improving variational data assimilation; Limitations of ensemble Kalman filter (EnKF); Highly nonlinear and non-Gaussian data assimilation;

Download Presentation

Data Assimilation for High Impact Weather Forecast

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Data assimilation for high impact weather forecast

Data Assimilation for High Impact Weather Forecast

Yuanfu Xie

NOAA/OAR/ESRL


Outline

Outline

  • Review data assimilation techniques;

  • Improving variational data assimilation;

  • Limitations of ensemble Kalman filter (EnKF);

  • Highly nonlinear and non-Gaussian data assimilation;

  • Some case studies of hurricane and tornado;

  • Summary.


History and modern techniques

History and modern techniques

  • Objective analysis in the 70s;

  • Variational analysis in the 90s;

  • Kalman filter including EnKF, EnSRF, became hot topics in the late 90s til now;

  • Hybrid of variational analysis (3DVAR/4DVAR) with EnKF covariance matrix now;

  • What is next?


Improving variational analysis

Improving variational analysis

Major reason for the recent interests in EnKF is due to the unsatisfactory variational analysis even it is so successful at ECMWF.

Of course, the easy implementation of EnKF or any Monte Carlo methods is another reason.

Variational analysis, particularly, 4DVAR, is too complicated and difficult to maintain.


Issues for the unsatisfactory story

Issues for the unsatisfactory story

  • It is known that the error covariance is difficult to compute as it is flow, location and time dependent;

  • Adjoint system is complicated, 4DVAR;

  • Control variables, e.g. wind;

  • Constraints for 3DVAR and 4DVAR;

  • Forward operators.


Control variable issues

Control Variable Issues

Xie et al 2002 has studied the analysis impact by selecting different control variables for wind, ψ-χ, u-v, or ζ-δ VARS.

Conclusions:

  • ζ-δ is preferable (long waves on OBS; short on background);

  • u-v is neutral;

  • ψ-χ is not preferred: short on OBS; long on background;


Non physical error by vars

Non-physical error by ψ-χ VARS

  • Ψ and χ are some

    type of integral of

    u-v. A correction to

    the background toward the obs changes the integral of u. The background term adds opposite increment to the analysis for keeping the same integral as the background.


Responses of three type of vars

Responses of three type of VARS

For a single obs of u, e.g., ψ-χ, u-v, or ζ-δ VARS have different responses as shown here. A ψ-χ VAR may not show this clearly as many filters applied.


Limitations of ensemble da

Limitations of Ensemble DA

Ensemble DA is relatively easy to implement and It has been considered to improve VARs.

Limitations:

  • Major challenge is the limited ensemble members for any applications (more needed, Julier et al 1997);

  • It may not be appropriate for nonlinear and non-Gaussian applications (e,g., severe weather);

  • For some nonlinear observation data, it may have problems.


Hybrid technique

Hybrid technique

  • Ensemble filter to provide an error covariance matrix for variational techniques;

    At ESRL, STMAS uses a multigrid technique to combine EnKF or particle filter with a sequence of variational analysis; at coarse grids, it can use any estimated error covariance matrix, e.g. EnKF…


Multigrid technique

Multigrid Technique

Using the number of gridpoints to control the base functions. For irresolvable scales, EnKF or particle filter is used.


Nonlinear and non gaussian da

Nonlinear and Non-Gaussian DA

  • Particle filter has been investigated for nonlinear and non-Gaussian DA. It requires more ensemble members;

  • STMAS considers a DA in two steps, variational retrieval and data assimilation. With modern observation networks, more accurate information is available for retrieving. STMAS uses a variational retrieval to mimic objective analysis with simultaneous dynamic constraints.


A lognormal 1dvar

A Lognormal 1DVAR

PDF:

Cost function:


Recent development

Recent development

  • STMAS has been developed and under testing;

  • Its adjoint system is under development;

  • Radar radial wind and reflectivity DA has been added into STMAS;

  • STMAS uses a u-v as control variable in its multigrid analysis;

  • NCAR WRF DA group is working with ESRL for testing ζ-δ WRF DA as seen some advantages in cloud scale analysis.


Storm boundary detection

Storm Boundary Detection

  • ESRL and MIT have been using STMAS surface analysis of high resolution (2-5km) and high temporal (5-15 minutes);

  • It uses high frequency observation data, e.g., 5 minute ASOS (1 minute ASOS planned);

  • Multi-variate analysis with certain dynamic constraints is under development;

  • STMAS technique will be applied to fire weather, wind energy and other applications.


Status of stmas surface analysis for storm gust front detection

Status of STMAS Surface Analysisfor Storm/Gust Front Detection

Space and Time Multiscale Analysis System (STMAS) is a 4-DVAR generalization of LAPS and modified LAPS is running at terminal scale for FAA for wind analysis.

STMAS real time runs with 15 minute latency due to the observation data:

  • STMAS surface analysis is running in real time over CONUS with 5-km resolution and 15-minute analysis cycle. It is so efficient that it runs on a single processor desktop;

  • Real time 5-minute cycle run of STMAS assimilating 5-minute ASOS data also on single processor.

  • Note: Modified LAPS is running at 40+ sites at terminal scales for FAA in real time.

    STMAS surface analysis with 5 minute latency with (MPI/SMS) and targeting at

    2-km resolution;

    5-minute cycle;

    over CONUS domain;

    assimilating 1-minute ASOS;

    using HRRR as background.

CONUS

15-min

cycle

5-min

ASOS,

5-min

cycle


Faa mit boundary detection application

FAA/MIT Boundary Detection Application


Stmas for frontal boundary detection

STMAS for frontal boundary detection


Stmas vs hpc

STMAS vs. HPC


Hurricane forecast improvement project hfip noaa

Hurricane Forecast Improvement Project (HFIP/NOAA)

NOAA HFIP is a major effort for improving hurricane forecast (both tracks and intensity);

NOAA 5 year plan:

  • Accuracy of hurricane intensity forecast is improved by 50%;

  • Track lead time is up to 5 days with 50% accuracy improvement.


Data assimilation for high impact weather forecast

Hurricane: costly natural disaster

Overview of 2008 hurricane season:

8 hurricanes (5 major)

Fatalities: 855

Damage: $42 billions


Increased national needs

Increased National Needs


Data assimilation for high impact weather forecast

Hurricane Forecast Enhancements

— 48-Hour Hurricane Track Forecast Error


Hurricane forecast enhancements

Hurricane Forecast Enhancements

— 48 hr Hurricane Intensity Forecast Error Trend


Esrl in hfip

ESRL in HFIP

  • Global modeling: FIM (finite volume Icosahedra grid modeling);

  • Statistical post-processing;

  • OSSE etc;

    DA:

  • Regional EnSRF (square root EnKF).

  • Testing STMAS for hurricanes and typhoon (supported by CWB/Taiwan) comparing to LAPS


Data assimilation for high impact weather forecast

LAPS analysis

Katrina

Pre-balanced 950-mb wind speed

and height.

Balanced 950-mb wind speed

and height.


Data assimilation for high impact weather forecast

KATRINA LAPS / HRS(2005)


Data assimilation for high impact weather forecast

Track: WRF 20km Katrina forecast by STMAS

Best track:

every 6 hours

WRF-ARW

72 hour fcst w/

Ferrier physics:

every 3 hours


Data assimilation for high impact weather forecast

j

Intensity: WRF Katrina forecast by STMAS

Wind Barb, Windspeed image,

Pressure contour at 950mb

Surface pressure


Testing cycling scheme for stmas

Testing Cycling Scheme for STMAS

  • The previous analysis is done by STMAS using GFS 1 degree forecast as background. The analysis does not contain detailed small scales;

  • The observation data for Katrina at Aug. 27, 2005 at 18Z is sparse even though there is some dropsonde data into the hurricane eyes.

  • Cycling scheme could provide detailed information through assimilation of early hours before STMAS 4DVAR is used.


Cycling impact on stmas analysis

Cycling Impact on STMAS analysis


Stmas wrf arw cycling impact

STMAS-WRF ARW cycling Impact

OAR/ESRL/GSD/Forecast Applications Branch


Rapid intensification and rapid weakening rirw

Rapid Intensification and Rapid Weakening (RIRW)

  • Cycling certainly helps with the rapid intensification;

  • For the Kartina case, the WRF ARW keeps the intensification for a longer period of time, which is not realistic;

  • Further study will be on the rapid weakening.


Severe storms and tornado

Severe Storms and Tornado

NOAA long term goal (20 years) is on tornado forecasts, for longer lead time forecasts (1-3 hour forecast)

ESRL/GSD/FAB is investigating the possibility of tornado forecast, what is needed and how to improve.

Radar data assimilation is critical to severe storms and tornado forecasts.


Examples of laps stmas analysis impact

Examples of LAPS/STMAS analysis impact

LAPS hot-start & WRF-ARW Forecast (2km with Lin Micro-physics ): IHOP cases

LAPS Forecast: Jun. 13, 2002

LAPS Forecast: Jun. 16, 2002

(Steve Albers and Isidora will talk these cases in more details at their presentations

A well-balanced initial condition is the key for improving very short range

forecast for tornados.


Data assimilation for high impact weather forecast

Windsor tornado case, 22 May 2008

  • Tornado touched down at Windsor, Colorado

  • around 17:40 UTC, 22 May 2008

  • STMAS initialization 1.67 km

  • 301 x 313

  • background model: RUC 13km, 17 UTC

  • hot start (cloud analysis)

  • Boundary conditions:

  • RUC 13km, 3-h RUC forecast (initialized at 15 UTC)

  • WRF-ARW

  • 1.67 km, 1-h forecast

  • Thompson microphysics

  • Postprocessing: Reflectivity


00 01hr 800mb wind initialized at 17 utc 22 may 2005 stmas analysis vs wrf forecast stmas

00-01hr 800mb wind initialized at 17 UTC 22 May 2005, STMAS analysis vs. WRF forecast (STMAS)


00 01hr wind cross section initialized at 17 utc 22 may 2005 stmas analysis vs wrf forecast stmas

00-01hr wind cross-section initialized at 17 UTC 22 May 2005, STMAS analysis vs. WRF forecast (STMAS)


00 01hr 800mb reflectivity initialized at 17 utc 22 may 2005 mosiac radar vs wrf forecast stmas

00-01hr 800mb reflectivity initialized at 17 UTC 22 May 2005, mosiac radar vs. WRF forecast (STMAS)


Data assimilation for high impact weather forecast

00-01hr reflectivity cross-section initialized at 17 UTC 22 May 2005, mosiac radar vs. WRF forecast (STMAS)


00 01hr reflectivity cross section initialized at 17 utc 22 may 2005 wrf forecast ruc vs stmas

00-01hr reflectivity cross-section initialized at 17 UTC 22 May 2005, WRF forecast, RUC vs. STMAS


Future study

Future Study

  • Investigating the initialization of STMAS for WRF forecast model;

  • Assimilating radar reflectivity data into the well-balance analysis of STMAS;

  • STMAS rapid update cycle;

  • Satellite radiance and GPS impact on severe storm and tornado forecasts;

  • Possible OSSE system for severe storms.


Summary

Summary

  • Variational data assimilation requires further improvement, particularly the adjoint systems;

  • Effectively combining variational data assimilation techniques with EnKF or particle filter for nonlinear and non-Gaussian data assimilation for severe weather forecasts;

  • Improving radar, satellite data assimilation, forward operators and efficiency.


First assumption in a 3dvar

First Assumption in a 3DVAR

  • In most cases, DA has two information sources: Background and observation;

  • A standard 3DVAR treats the background (xb)and observation (xo) as random representations of the true atmosphere (xt);

  • Assumption I:xb-xtand xo-xtare random variables.


The bayesian theorem

The Bayesian Theorem

A simplified version:

Pa(x) P(x=xt | x=xo) = P(x=xo | x=xt) P(x=xt);

P(x=xo | x=xt) = P(xo=xt) = Po(x-xo), i.e., observational error probability.

Assumption II.P(x=xt) = Pb(x-xb), as this prior probability can depend our knowledge of the background on the true atmosphere, see Lorenc 86.

Then we have: Pa(x)= Po(x-xo) Pb(x-xb).


Derivation of a 3dvar i

Derivation of a 3DVAR I

Assumption III.

The background and observation error probabilities follow a Gaussian distribution:

Po(x-xo)  exp[-(x-xo)TO-1(x-xo)]

Pb(x-xb)  exp[-(x-xb)TB-1(x-xb)]

Assumption IV.

Covariances O and B are known!


Derivation of a 3dvar ii

Derivation of a 3DVAR II

To maximize the probability for estimation of the To best approximate the true atmosphere xt , we maximize

exp[-(x-xb)TB-1(x-xb)]+exp[-(x-xo)TO-1(x-xo)].

This is equivalent to minimize:

(x-xo)TB-1(x-xo)+(x-xo)TO-1(x-xo),

the standard 3DVAR cost function.

Optimality = maximized probability


Single 3 4dvar approach

Single 3-4DVAR approach

It is derived from a statistical analysis assuming the error’s distribution is Gaussian. It solves a variational problem:

subject to a model constraint for 4DVAR

南京大学


Data assimilation for high impact weather forecast

Resolvable Information for

a Given Observation Network

Obse

r

vation

Longer wave

Obse

r

vation

Longer wave

B

ac

k

g

r

ound

B

ac

k

g

r

ound

Difference on longer wave

Difference on shorter wave

南京大学


Stmas

STMAS

STMAS is implemented in two steps.

  • It retrieves the resolvable observation information.

  • After the resolvable information retrieved, STMAS is reduced to a standard statistical variational analysis

    With long waves retrieved, STMAS deals with a localized error covariance, a banded matrix, at its last phase of analysis.

南京大学


  • Login