1 / 13

Measuring the Dosage Effect: Using Tenure as a Variable in Assessing Program Impact

Measuring the Dosage Effect: Using Tenure as a Variable in Assessing Program Impact. Angela Helman, Principal June 23, 2011. WasteWise Background. Established in 1994 Designed to assist organizations in identifying cost-effective strategies for:

verity
Download Presentation

Measuring the Dosage Effect: Using Tenure as a Variable in Assessing Program Impact

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Measuring the Dosage Effect: Using Tenure as a Variable in Assessing Program Impact Angela Helman, Principal June 23, 2011

  2. WasteWise Background • Established in 1994 • Designed to assist organizations in identifying cost-effective strategies for: • Reducing municipal solid waste (MSW) generation • Increasing recycling of MSW • Increasing purchasing of recycled-content products • Program has approximately 2700 partners across many sectors • Partners include private firms, local governments, colleges and universities, and other agencies and organizations

  3. WasteWise Partner Services • Technical Assistance - Website - Helpline - Waste tracking and reporting system (Re-TRAC) - GHG calculations • Recognition - Awards Program - WasteWise publications • Networking - Annual Conference

  4. WasteWise Program Evaluation Questions • WasteWise uses a variety of approaches to influence the behavior of partners. Which approaches—for example technical assistance, information, awards and recognition—are most effective for which types of partners? • In addition to participation in WasteWise, what other factors may influence a partner organization’s decisions to improve management of MSW (e.g., cost savings, consumer pressure, other voluntary program opportunities)? • What can be determined about how WasteWise participation contributes to partner behavior regarding MSW management (e.g., by effecting waste management improvements sooner, better incorporating waste management as a permanent feature of corporate culture, facilitating non-participant changes by providing information)? • What can EPA do to encourage WasteWise partners to submit sufficient environmental data for performance measurement and evaluation purposes?

  5. USPS Survey • USPS is very active in WasteWise; all relevant USPS facilities have been enrolled since 2008 • Conducted an online survey of USPS facilities that manage large quantities of MSW • Survey focused on recycling and source reduction behavior, and influences on waste management behavior • Divided universe into early joiners and later joiners • “Dosage Effect” hypothesis: If WasteWise promotes better MSW management, then early WasteWise joiners should report greener waste management behaviors compared to later WasteWise joiners, due to longer exposure to WasteWise technical assistance and services

  6. Natural Controls for Self-Selection Bias • Facilities surveyed were of two specific types: bulk mail centers and processing and distribution centers • Facilities surveyed have the same characteristics in terms of their operations and wastes generated • Decisions of when to join WasteWise were typically made at higher levels

  7. Survey Sample Design • Early joiners (Group A): surveyed universe of facilities that joined in the 1990s • Later joiners (Group B): surveyed a geographically stratified sample of facilities that joined in 2007-2008 • For Group B, chose a sample size that considered need for statistical validity and need to limit burden on USPS staff

  8. Actual Response Rates Actual response rates were very similar among Group A and Group B, and averaged at 52% This response rate was high enough to support statistical analysis

  9. Select Findings on the Dosage Effect • Early USPS WasteWise joiners conduct more recycling activities than later joiners

  10. Findings on the Dosage Effect • Early USPS WasteWise joiners have higher recycling frequencies than later joiners

  11. Findings on the Dosage Effect • Early USPS WasteWise joiners are more aware of their recycling rates than later joiners

  12. Additional Findings that Underscore Dosage Effect • Timing of when facilities started recycyling is generally consistent with when facilities joined WasteWise • Even though WasteWise technical assistance was generally not “branded” with the program name at the facility level, 27% of facilities in Group A compared to just 14% in Group B cited the program as a reason for originating recycling activities • Results from focus group of several sectors represented in WasteWise (not just USPS), and interviews with USPS management, validate survey findings that WasteWise contributes to positive changes in waste management behavior

  13. IEc INDUSTRIAL ECONOMICS, INCORPORATED 617.354.0074

More Related