1 / 25

François Fonteneau, OECD/PARIS21

UNSD/ NSCB Regional workshop on data dissemination & communication Manila, Philippines, 20-22 June 2012 Promoting (survey) microdata dissemination policies: the experience of the IHSN / ADP. François Fonteneau, OECD/PARIS21

rayya
Download Presentation

François Fonteneau, OECD/PARIS21

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. UNSD/ NSCB Regional workshop on data dissemination & communicationManila, Philippines, 20-22 June 2012 Promoting (survey) microdata dissemination policies: the experience of the IHSN / ADP François Fonteneau, OECD/PARIS21 International Household Survey Network (IHSN)Accelerated Data Program (ADP) francois.fonteneau@oecd.org

  2. IHSN / ADP: background • Marrakech Action Plan for Statistics (MAPS): creation of IHSN and ADP • Program funded by World Bank, implemented by a small core team (P21/WB + others); open partnership (ADB, UNSIAP, SPC, DFID , FAO, others)

  3. Survey microdata: growing supply, unsatisfied demands By producers: • “we don’t know how to deal with microdata” • how to document them? • how to improve transparency on sources? • can we disseminate them in our country? • If YES, how to disseminate them? • To whom? • What costs? • “what do others do?” • identification of good practice

  4. Survey microdata: growing supply, unsatisfied demands By users: • “we didn’t know they had data” Visibility • “they don’t want to share them” Accessibility • “these data are messy” Reliability • “this is not really what I need” Relevance • “how can I assess progress?” Comparability • “where is the documentation?” Usability • “there is no transparency” Quality, credibility

  5. Different needs, different challenges Reports, tables (PDF) Any web development tool No issue of confidentiality Indicators CensusInfo/DevInfo, etc. On-line interactive tabulation, analysis and mapping tools REDATAM/IMIS, SuperStar, Nesstar, etc. Disclosure risk managed by the application Microdata (n% sample) and detailed metadata IHSN MMT + NADA Requires data anonymization What outputs? What tools?

  6. Promoting microdata dissemination policies: a variety of challenges • Legal apply the law…or change it • Strategic set your priorities (NSDS) • Organizational break silos • Financial allocate minimal budget • Technical steal good practice • … and cultural (fear of change) => Advocacy on benefits / risks

  7. The importance of documentation For discovering data • You and your users will know about data availability by providing searchable data catalogs For making data usable • Users need to fully understand the data: why, by whom, when, and how they were collected, processed and disseminated For assessing data quality => International metadata standards for microdata: DDI

  8. DDI : before and after (...or worse !)

  9. GSBPM

  10. GSBPM, DDI, SDMX

  11. IHSN toolkit for documentation IHSN Microdata Management Toolkit (DDI metadata editor) NADA: on line searchable survey cataloguing system

  12. Confidentiality of microdata • Anonymized datasets for dissemination • Anonymization techniques/tools: • Risk measurement / risk reduction / information loss • Methods: recoding, rank swapping, micro-aggregation, sampling, etc. • Available tool (R package): sdcMicro {guidelines in preparation} • Different levels of anonymization / different users controls / different procedures : PUF; SUF • Full dataset in enclave  direct control of NSO

  13. Confidentiality of microdata • Only when no confidentiality concerns • 3 modes for file distribution: • PUF - Direct • SUF - Licensed • Enclave • Screen users and usage • Progressive approach

  14. Principles for microdata dissemination • From UNECE Task Force • It is appropriate for microdata collected for official statistical purposes to be used for statistical analysis to support research as long as confidentiality is protected (i.e. as long as it is not possible to identify data referring to an individual). • Microdata should only be made available for statistical purposes. • Provision of microdata should be consistent with legal and other necessary arrangements that ensure that confidentiality of the released microdata is protected. • The procedures for researcher access to microdata, as well as the uses and users of microdata should be transparent, and publicly available. • UPDATES IN NATIONAL STAT LEGISLATION?

  15. Principles, guidelines and practices Formulating an access policy and procedures http://www.ihsn.org/home/index.php?q=focus/dissemination-microdata-files-principles-procedures-and-practices

  16. PHILIPPINES Good practice !

  17. Provides detailed metadata, all automatically taken from the DDI and transformed into HTML

  18. REQUEST ACCESS TO DATA !

  19. INDIA

  20. COLOMBIA

  21. VANUATU

  22. More? • IHSN: www.ihsn.org • ADP: www.ihsn.org/adp • francois.fonteneau@oecd.org • odupriez@worldbank.org THANK YOU !

More Related