1 / 23

Assessing the Relative Impact of a Media Ad Campaign

2003 National Conference on Tobacco or Health Page 1. Assessing the Relative Impact of a Media Ad Campaign. Selina Carver Idaho Department of Health and Welfare. Michael Willmorth, Ph.D. Clearwater Research, Inc. December 11, 2003. Policy. Media. R & E.

MikeCarlo
Download Presentation

Assessing the Relative Impact of a Media Ad Campaign

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 2003 National Conference on Tobacco or Health Page 1 Assessing the Relative Impact of a Media Ad Campaign Selina Carver Idaho Department of Health and Welfare Michael Willmorth, Ph.D. Clearwater Research, Inc. December 11, 2003

  2. Policy Media R & E 2003 National Conference on Tobacco or Health Page 2 Background • Idaho Tobacco Prevention and Control Program (ITPCP) • Bureau of Health Promotion, IDHW • Prevent initiation of tobacco use, eliminate exposure to ETS, promote quitting among youth and adults, and eliminate disparities in the population • es/drake (ESD) • Clearwater Research, Inc.

  3. 2003 National Conference on Tobacco or Health Page 3 Research History • ITPCP’s targeted surveillance and evaluation efforts • Baseline survey of teens and parents in 2000 • Anti-tobacco marketing survey of teens and parents in 2001 • Counter-marketing media campaign evaluation surveys of teens in 2002 and 2003

  4. 2003 National Conference on Tobacco or Health Page 4 2002 Teen Media Ad Campaign • Targeted to teens (aged 12–17) • Messages • If you smoke, quit • Don’t start • Channels • Radio • Television • Billboards • Flights: September 2001–May 2002

  5. 2003 National Conference on Tobacco or Health Page 5 2001–2002 ITPCP Radio Ads

  6. 2003 National Conference on Tobacco or Health Page 6 2001–2002 ITPCP TV Ads

  7. 2003 National Conference on Tobacco or Health Page 7 2001–2002 ITPCP Billboards

  8. 2003 National Conference on Tobacco or Health Page 8 2002 Study Objectives • Measure the effectiveness of ITPCP media campaign based on campaign objectives and exposure. • Provide research-based conclusions that can guide message development and delivery to Idaho teens. • Evaluate impact of current media campaign on teen behavior.

  9. 2003 National Conference on Tobacco or Health Page 9 2002 Study Design Overview • Data collection • Telephone interview with 630 Idaho teens (12–17) • Field period: April 24–June 13, 2002 • Sample • Probability sample (list-assisted RDD) • Stratified proportionately by media market • ±3.9% C.I. At 95% C.L. for entire state • Response rate: 49.0% CASRO, 63.9% upper bound

  10. 2003 National Conference on Tobacco or Health Page 10 Research Questions • What impact has the campaign had on the population of teenage smokers' propensity to quit or reduce smoking? • Has the campaign sparked conversation for the teenage population in Idaho? • How effective were particular ads in influencing smoking behavior? How convincing was each one? How sellable was the idea in each one? • What ads received by Idaho’s teenage population have been the most effective (whether or not a part of the ESD/ITPCP media ad campaign)? • What messages are the most beneficial for effecting change in smoking behavior? What works and what doesn’t? • What audience is most receptive to the current media ad campaign?

  11. 2003 National Conference on Tobacco or Health Page 11 Data Collection Methodology • Telephone interviews • CATI • 10 minute interviews (on average) • Instrument design: screening questions • Determine eligibility of household • Obtain permission from parent/guardian to interview teen • Enumerate number of teens in household • Random selection of teen (with replacement as refusal avoidance)

  12. 2003 National Conference on Tobacco or Health Page 12 Questionnaire Topics • Demographics (including media use) • Social activities • Use of tobacco (self, family, friends) • Quit attempts • Tobacco-related beliefs (including ad-related messages) • Campaign and noncampaign ads (recall, awareness, effectiveness) • Conversations about tobacco/ads

  13. 2003 National Conference on Tobacco or Health Page 13 Recall Frequency Hearing Ad • Over the past 12 months, how frequently have you heard a radio commercial or ad telling you about the risks of smoking and tobacco? Would you say … • Not at all • Less than once a month • 1 to 3 times a month • 1 to 3 times a week • Every day or almost every day • More than once a day

  14. 2003 National Conference on Tobacco or Health Page 14 Unaided Recall • Please describe one of the anti-tobacco radio ads you have heard over the past 12 months. (SELECT UP TO 3) • Facts • 5th Guy • Singing Pollution • Just a Pinch • Lucky Rick • Joe DeBoer • Critique • Look at Me • When You Smoke • OTHER (SPECIFY)

  15. 2003 National Conference on Tobacco or Health Page 15 Prompted Recall • Now, I will describe for you an ad that might or might not have been playing on the radio in your area. [READ DESCRIPTION] Over the past 12 months, how many times have you heard this ad? Would you say … • Not at all • Once • 2 to 4 times • 5 to 10 times • More than 10 times • Followed up with 3 agree/disagree assessments • Ad was convincing • Ad exaggerated the problem • Ad made me more aware of the risks of smoking and tobacco

  16. 2003 National Conference on Tobacco or Health Page 16 Coding Data • Interviewers coded open-ended responses into existing categories or recorded verbatim descriptions • New categories were created for “other” ads • Consultation with ESD • Internet searches • Analysts reviewed open-ended responses • Checked and corrected interviewer coding • Recoded “other” ads into new categories • New variables (“yes”/”no”) • Any ITPCP ad • Only ITPCP ads • No ITPCP ads

  17. 2003 National Conference on Tobacco or Health Page 17 Most Recalled Radio Ads

  18. 2003 National Conference on Tobacco or Health Page 18 Most Recalled TV Ads

  19. 2003 National Conference on Tobacco or Health Page 19 Most Recalled Billboards

  20. 2003 National Conference on Tobacco or Health Page 20 Calculating “Impact” • “Impact” = percentage of unaided mentions accounted for by ITPCP ads • Lower bound = % only ITPCP ads / % any antitobacco ad • Upper bound = % any ITPCP ad / % any antitobacco ad • “Ballpark” point estimate = average of lower and upper bound

  21. 2003 National Conference on Tobacco or Health Page 21 Relative Impact of Campaign

  22. 2003 National Conference on Tobacco or Health Page 22 Recommendations • Use to quantify (in a “ballpark” way) how components of a media ad campaign fit into the larger system of antitobacco messages in which it operates • Limitations • Very restricted definition of “impact” • Relies completely on unaided recall, so interpretation is dependent on time of measurement

  23. 2003 National Conference on Tobacco or Health Page 23 Thanks! Michael Willmorth, Ph.D. Clearwater Research Senior Study Director 2136 North Cole RoadBoise, ID 83704(208) 376-3376 1-800-727-5016 http://www.clearwater-research.com

More Related