On the methodology of measuring the effectiveness of financial education programs l.jpg
This presentation is the property of its rightful owner.
Sponsored Links
1 / 22

On the Methodology of Measuring the Effectiveness of Financial Education Programs PowerPoint PPT Presentation


  • 59 Views
  • Uploaded on
  • Presentation posted in: General

On the Methodology of Measuring the Effectiveness of Financial Education Programs. Jeanne Hogarth Dan Gorin Casey Bell Consumer & Community Affairs Federal Reserve Board

Download Presentation

On the Methodology of Measuring the Effectiveness of Financial Education Programs

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


On the methodology of measuring the effectiveness of financial education programs l.jpg

On the Methodology of Measuring the Effectiveness of Financial Education Programs

Jeanne Hogarth

Dan Gorin

Casey Bell

Consumer & Community Affairs

Federal Reserve Board

The analysis and conclusions set forth in this presentation represent the work of the author and do not indicate concurrence of the Federal Reserve Board, the Federal Reserve Banks, or their staff. Mention or display of a trademark, proprietary product, or firm in the presentation by the author does not constitute an endorsement or criticism by the Federal Reserve.


Critiques of studies l.jpg

Critiques of Studies

  • No control group

  • No longitudinal studies

  • Sensitive to stages of behavior change

  • Multiple measures of outcomes

    • Behaviors, attitudes, satisfaction


Federal reserve system efforts l.jpg

Federal Reserve System efforts

  • Three major efforts at evaluation of financial education are in at various stages

    • Federal Reserve Board - Financial management course at Ft. Bliss

    • Philadelphia Reserve Bank (RB) – Homeownership Counseling study

    • Kansas City RB – Workplace Fin. Ed.


Federal reserve system efforts4 l.jpg

Federal Reserve System efforts

  • Philadelphia Reserve Bank longitudinal study of the effectiveness of homeownership counseling

    • $2 million study

    • 1,000 participants randomly assigned to two different levels of training

    • To be tracked for 5 years including tax returns and credit bureau records

    • Have enrolled over 600 families


Federal reserve system efforts5 l.jpg

Federal Reserve System efforts

  • Kansas City Reserve Bank evaluation of Workplace Counseling

    • Working with Wadell & Reed Financial Advisors

    • Access to large amount of proprietary data on employee responses to financial education efforts in the workplace


Financial management behaviors of military personnel project l.jpg

Financial Management Behaviors of Military Personnel Project

  • Addresses issues of control group and longitudinal nature of studies

  • Tracks changes in stages and behaviors

  • Includes multiple measures

    • Behaviors, attitudes, satisfaction


Project timeline l.jpg

Project Timeline

  • 2002 – MOU with Defense

  • 2003 – identified AER as collaborator

  • 2004 – obtained funding and contractor

  • 2005 – developed survey and web site

  • 2006 – started paper surveys

    implemented 2nd round online surveys


Project timeline8 l.jpg

Project Timeline

  • 2007 – started paper surveys for 2nd round

  • 2008 – on-post “umbrella week” paper survey

    • Some 2nd round surveys, some new baseline data


Lessons learned l.jpg

Lessons Learned

  • Be patient, but not too patient

    • Have back-up plan(s)

  • Communicate your priorities

  • Find an advocate

  • Follow up


Baseline data l.jpg

Baseline Data

  • Ages 19-25

  • 3/4ths are E1 or E2 ($1,350 - $1,500/mo)

  • 2/3rds have HS or GED

  • Race/ethnicity same as general population

  • Financial ed course vs. “basic training”

  • All have bank accounts


Baseline data11 l.jpg

Baseline Data

  • Collected at time of course (financial education group) or “in-processing” at ACS orientation (control group)

  • Identify baseline differences between 2 groups

  • ~ 680 in control group, ~2625 in education group, ~95 time series obs.


Questions l.jpg

Questions

  • Demographics

  • Pre-military history/experiences

  • Financial products

  • Current financial standing

  • Financial behaviors

  • Financial activities

  • Self-assessment – stress, skills, situation

  • Additional financial education or training


Good news l.jpg

Good News


Good financial behaviors l.jpg

“Good” Financial Behaviors


Bad news l.jpg

Bad News


Bad financial behaviors l.jpg

“Bad” Financial Behaviors


Formal education behavior l.jpg

Formal Education & Behavior


Income behaviors l.jpg

Income & Behaviors


Early exposure to finances l.jpg

Early Exposure to Finances


Marital status and behaviors l.jpg

Marital Status and Behaviors


Family influences on good behaviors l.jpg

Family Influences on Good Behaviors


What s next l.jpg

What’s Next?

  • Comparisons

    • Education vs control

    • Reserve & National Guard vs others

    • “in-processing” control group vs umbrella week control group

    • 1-day education group vs 2-day education group

  • Time series

    • Changes over time


  • Login