Experiential learning from Total Sanitation and Sanitation Marketing(TSSM) Project, 2007-10 on

1. Experiential learning from Total Sanitation and Sanitation Marketing(TSSM) Project, 2007-10 on Monitoring Progress and Program performance, and Sequencing of CLTS and Sanitation Marketing Nilanjana Mukherjee with inputs from Amin Robiarto IDS Workshop on Monitoring CLTS. Malawi. August 2012

2. 1. Monitoring progress in communities

3. Experience from 29 districts in East Java during Scaling Up Rural Sanitation showed: • Communities are able to monitor access to improved sanitation, and progress towards ODF achievement, in ways that satisfy JMP monitoring requirements. • Key pre-condition – Establish and use locally relevant,commonly agreed definitions for Improved/unimproved sanitation and criteria for ODF status, which are easy to understand and communicate in local language.

4. Examples of maps E. Java communities make and use for monitoring - households color coded by sanitation practice ( open defecators, sharers, users of improved/unimproved latrines)

6. Examples of Improved latrines, by local definition

7. Examples of Unimproved latrines, by local definition

8. Community register- updated monthly from map

9. Data picked up from community maps/registers by Health Extension worker – recorded in Primary Health Center format • But, • Manual pick up and transfer of data to district often late. • When triggered communities ran into hundreds and thousands, manual monitoring data collection systems failed to keep up.

10. Possible solution - Cell phone text message-based reporting introduced in 2010 Data Base Data Input • Data more accurate • Quick data transfer • Resource-efficient Distance DATA SOURCE • WSP-developed software installed in district Health Office • computer gateway. • Auto-checks for validity of data received via text messages. • Only from phones registered with the gateway.

11. # community households reported via phone text message every month.- Baseline report – one time- Monthly updates thereafter

12. ODF Verification guidelines provided-For use by sub-district agencies/Puskesmas Guidelines include: • Definitions – Improved/Unimproved sanitation, ODF. • Recommended community-level process • Recommended composition of Verification team • Checklist for household latrine observation • Checklist for environmental observation

13. Open Defecation Free Certificate presented to verified ODF community by District Government

14. 2. Monitoring program performance

15. Using monitoring data to improve program efficiency within districts District government have used it for: • Identifying bottlenecks, high/low performing sub-districts • Comparing outputs and outcomes from different program approaches (e.g.CLTS vs. other approaches) • Advocacy with district legislatures for budget allocation for rural sanitation

18. Using monitoring data to improve program efficiency in province Province and national governments have used it for: • Comparing program performance across districts • Generating competition among districts – linking program outcomes to award ( annual Good Governance evaluation by JPIP Media Foundation) • Annual Stakeholder Learning Reviews – publicizing cross-district performance data, generating learning analysis by district government personnel- sparking mutual support/sharing of knowledge and expertise from one district to others.

22. FINANCING: Local government budget for sanitation FINANCING: OUTCOME: Access increased per 1 million Investment FINANCING: % Local government sanitation budget For non-construction category 10 10 10 10 OUTCOME: Program investment by ODF Communities DEMAND CREATION:number of triggered communityies 10 10 5 OUTCOME: Community investment per 1 million program investment SUPPLY IMPROVEMENT: number of masons trained per sub-district which provide “WC-ku Sehat” 15 5 15 SUPPLY IMPROVEMENT:number of “WC-ku Sehat” vendor per sub-district OUTCOME: % Access increas to Improved latrine OUTCOME: Number of ODF commuities

23. 3. Sequencing CLTS and Sanitation marketing interventions

24. What we learned about sequencing CLTS and Sanitation Marketing in rural sanitation programs at scale It is critically important to invest in market research BEFORE creating demand (e.g.with CLTS and Behavior Change Communication)at large scale, because: • Market research findings identify how best to move forward in scaling up so as to maximize program impact. • Market research findings prevent funds being mis-allocated and wasted at scale. Sanitation marketing interventions at scale need 12-18 months’ preparation time. Start market research as early as possible in new projects. Lesson learned from TSSM implementation experience and research on Factors associated with achieving and sustaining ODF communities (WSP, 2011) See following examples…………

25. Rich Households 6 5 Middle income households Poor Households 4 Rp.2-4 million 3 Rp.1 – 1.5 million 2 Rp.300,000 – 500,000 1 Rp.5-12 million Rp.50,000– 300,0000 WHO IS BUILDING WHAT- AT WHAT COST IN EAST JAVA 2008-2010. (WSP,2011) Labor + 0 cost OD

26. TSSM Informed Choice Catalogue - developed before Market Research T5 T4 Concrete slab and ceramic pan T3 Concrete offset Slab T2 Concrete Slab with a lid Missing option - Consumers want T5 technology, but at much lower than T5 cost – WSP Market Research (Nielsen,2009) Wooden slab with a lid T1 Bamboo clay-lined slab with a lid

27. Market research finding used by local sanitation entrepreneur to identify and develop missing options desired by consumers.His products are in very high demand

28. Sumadi’s 1-page promotional flyer ” Informed Choice Catalogue for Affordable and Progressively Upgradable Healthy Latrine”

29. Post-project action research in 20 districts : TSSM-trained masons found in only 9% sampled communities(all ODF). Rest gone to cities/abroad/ not serving rural consumers. Where trained entrepreneursare present, they are providing, reduced-cost versions of what consumers want/aspire to, e.g. • Pour-flush latrines at Rp.250,000 – 750,000 • Offset pit latrines with lids at – Rp.59,000O • Providing designs upgradable over next 1-2 years • Offering installment payments terms of Rp 20,000 – 50,000 monthly • Need to increase numbers of locally resident masons capable of serving poor customers in these ways.(WSP Action research, 2011) • Need to intervene at enterpreneur level (higher than masons) for impact at scale (WSP market research, Nielsen, 2009)

30. TSSM INFORMED CHOICE CATALOGUE–developed as a communication tool for masons to use with customers

31. But –information tools on options, made available from TSSM, are NOT reaching rural consumers – copies lying in District/PHC offices. Action researchers showed, discussed and left behind the TSSM Informed Choice Catalogue (ICC) in 40 Not ODF communities…. Frequency of responses Never seen before: in 40 of 40 communties Interest expressed in the options: in 21 of 40 communities Action initiated immdtly with local mason to build 1 or more options from ICC : in 11of 40 communities No interest in the Dry pit options: in18 of 40 communities No interest in latrines (river OD-ers): in 4 of 40 communities (WSP, 2011) Recommendation : Make available informed-choice communication tools on market-research-based options in the hands of locally resident masons in communities !!

32. THANK YOU !