1 / 37

New and easier ways of working with aggregate data and geographies from UK censuses

Explore the UK Data Service and their Census Support, offering access to aggregate data and geographies from UK censuses. Learn about the challenges of disseminating census data and how InFuse, a data and geography model, is making it easier to find, understand, and use census outputs.

codyingram
Download Presentation

New and easier ways of working with aggregate data and geographies from UK censuses

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. New and easier ways of working with aggregate data and geographies from UK censuses Justin Hayes UK Data Service Census Support

  2. Overview • The UK Data Service • UK Data Service Census Support • Census background • Aggregate data • Geographies • Dissemination challenges • InFuse • Data model • Geography model • Live demonstration!

  3. The UK Data Service • An ESRC initiative integrating several previous resources • A single, comprehensive and integrated point of access to a wide range of social science data • Access beyond traditional academic audience where possible • Support, training and guidance • ukdataservice.ac.uk

  4. UK Data Service Census Support (CS) • A specialist unit of the UK Data Service • Access to, and support for use of data from the last five UK censuses (1971 – 2011) • Add value by making census outputs easy to find, understand and use • Extend audience beyond ‘experts’ • Long history of innovation • census.ukdataservice.ac.uk

  5. ukdataservice.ac.uk

  6. CS@Mimas • Aggregate component of census outputs Justin Hayes Richard Wiseman Rob Dymond-Green

  7. CS@Mimas • Aggregate component of census outputs Justin Hayes Richard Wiseman Rob Dymond-Green

  8. UK Censuses • Decennial questionnaire surveys • Entire UK population every ten years* since 1801 • Questions about people and households • 2011 Census cost ~ £500m • Primary evidence for government policy and spending • Wide range of high quality demographic and socio-economic characteristics • What? - Detailed combinations of characteristics • Where? - Small areas • When? - Long history • Rich secondary source of information • Open Government License!

  9. UK 2011 Census • 27 March 2011 • Three UK census agencies (ONS, NRS, NISRA) • New questions and variables • Targeted enumeration • Online and postal completion • Sophisticated quality assurance • Best census ever!

  10. Census aggregate outputs • Counts of people and households* with particular combinations of characteristics for particular geographical areas • Females aged 16-74 in employment in associate professional and technical occupations and usually resident in wards in the County of Devon • Derived from unit-level questionnaire responses • Variables and categories • Sex - Male and Female and All • Age - single and multiple years • Ethnicity and Occupation – standard classifications • Traditionally specified by tables combining one or more variables

  11. Aggregate specification tables

  12. Census aggregate data Age : Age 16 to 74 - Economic activity : in employment the week before the census - Occupation : 3. Associate professional and technical occupations - Sex : Female - Unit : Persons Age : Age 16 to 74 - Economic activity : in employment the week before the census - Occupation : All categories\ Occupation - Sex : Female - Unit : Persons

  13. Census aggregate data

  14. Aggregate data

  15. 2011 Census geographies • Subdivisions of the UK into smaller areas • Sets of similar areas called geographies • Functional and statistical geographies • Local government districts • Wards and electoral divisions • Expecting around 100 different geographies • Hierarchies of geographies with nesting areas • Administrative • Statistical • Health, Electoral, Postcode, etc

  16. UK administrative geographies

  17. UK statistical geographies

  18. Dissemination challenges • Size and complexity of planned outputs • Ongoing releases from three different agencies • Inconsistencies in definitions • Categorisation differences within and between countries • Table universes • Inconsistent labelling • Incomplete geographical availability of data • Disclosure control • Lower Threshold (LT), Higher Threshold (HT) and other data • Thousands of separate datasets • Restricted global operation and understanding

  19. InFuse • Live service with 2001 census data since 2012 • 2011 data since 2013 • Tip of the iceberg! • Data model • Geography model

  20. InFuse data model • Single multidimensional dataset • Deconstruction, rationalisation and re-integration of variables and categories • All UK table specifications processed • Integration of table universes as variables • Enforce consistency across dataset • Library of variables and categories to describe all counts • Re-insertion of counts into model • Retain original cell identifiers • Attachment of metadata

  21. 2011 census variables • 97 variables and counting!

  22. InFuse geography model(s) • Raw geography model • All original geographies and their areas • Direct and indirect hierarchical relationships • Simplified geography model • Combinations of equivalent geographies into geography sets with UK coverage where possible • Condensed standard/merged geographies in England • Selections of areas across the UK • Multiple geographies in one operation • Geography jumps in interface • Currently administrative and statistical geographies • More to follow

  23. Raw geography entities and relationships

  24. InFuse administrative and statistical geographies

  25. InFuse features • Open access • All data is open via Open Government Licence • Global search across entire UK dataset • Variable combinations • No tables! • Guide users to find data • Populated variable combinations • Available geographies • More data for more geographies • All LT and HT data available for all areas above LT • Improved contextual information • No data fast!

  26. InFuse 2011 demonstration • http://infuse.mimas.ac.uk/

  27. What’s next? • Big data release imminent! • Progressive release of UK 2011 outputs • Scottish and Northern Ireland • Integrated boundary data in GIS formats • Interface design and features • More contextual information

  28. After that? • Integration of multiple censuses • Non-census data • External access to API for application development • Development of data and geography models • Continued engagement with NSIs • Data production using multidimensional approach • Automated disclosure control • No all or nothing table constraints

  29. Use InFuse! • Let us know what you think • help@ukdataservice.ac.uk

More Related