240 likes | 345 Views
Reconciliation of the 2006 Canadian Census of Agriculture with the Farm Register. Martin Lachance, Statistics Canada. The Third International Conference on Establishment Surveys. Introduction. Census of Agriculture - CEAG.
E N D
Reconciliation of the 2006 Canadian Census of Agriculture with the Farm Register Martin Lachance, Statistics Canada The Third International Conference on Establishment Surveys
Introduction Census of Agriculture - CEAG • Collection : hand in hand with Census of Population, mail-out + field • Reference date: May 16, 2006 • Collected :contact info + commodities + practices + financial info • Survey Frame :Crops, Livestock, Environmental surveys, etc
CEAG --- > FR • Reconciliation: add farms + update contact info + update profile Introduction Farm Register - FR • Repository :list of farms + contact info + historical profiling • Manages survey collection • Reference for Census of Agriculture coverage
Survey Updates Introduction Reconciliation => Integration CEAG Census of Agriculture FR Farm Register • May 16, 2006 • ~230,000 farms • ~330,000 farm operators • 3 operators/farm (max) • Evolves constantly • ~280,000 farms • ~410,000 farm operators • 3 operators/farm (max)
FR – Farm Register CEAG – Census May 16, 2006 Overview FR – Snapshot May 16, 2006 Missing known operations? (Match – Follow-Ups – Unduplication)
FR – Farm Register CEAG – Census May 16, 2006 => Reconciliation Overview FR – Snapshot Pre-reconciled May 16, 2006
CEAG Different collection methods => different sources of errors Aside from response errors...
CEAG – Census May 16, 2006 Farm Operator (farmer) Coverage & Pre-reconciliation • Prior to 2006 Census: • Link to Snapshot only: • no reconciliation of administrative info • Census coverage FR – Snapshot Pre-reconciled May 16, 2006 • 2006: • Census coverage • Link + micro-editing of CEAG administrative info
Matching Operations CEAG – Census FR – Snapshot May 16, 2006 (farms) UPDATED May 16, 2006 (farms) May 16, 2006 (households) Census of Population
Benefits of Pre-reconciliation • Take advantage of powerful match systems • CEAG has “cleaner” administrative data (May 16, 2006) • Increased linkage to the Census of Population and FR Snapshot thanks to “cleaner” data • Link to Census of Population may bring information missing on both CEAG and FR: • e.g. Same people on CEAG and FR, • living together according to the Census of Population, • but missing the date of birth of one operator, • only available on Census of Population.
Benefits of Pre-reconciliation • Provide Reconciliation with links at the operator level • Help to identify inconsistencies on the Farm Register: • dates of birth mixed up (criss-cross information on operators) • identify duplicates of operators still on Farm Register • Reconciliation accelerated for most Farm Register farms with no survey updates since Census Day (May 16, 2006): • Farm Register Snapshot = Farm Register “live”
Pre-reconciliation Pieces of information considered (for matching operations + to be reconciled) 1. Telephone numbers 2. Operator’s name, date of birth & gender 3. Address, municipality & postal code 4. Farm name & corporation name 5. E-mail address & Fax number
Pre-reconciliation Resolve missing info + Correct inconsistencies: Increase linkage + Verify quality of links + Fix scanning errors: YES Same person?
Pre-reconciliation CEAG farm operators with no link (to FR, Census of Population): Names not appearing in home-built DICTIONARY of names were manually examined Correct errors introduced by Missing Farm Follow-Ups: Before phone call After phone call 1937
Anthony has a partner who also filled a paper questionnaire, but who was not sure of Anthony’s home address or knew it but put down the farm’s address. => We may have two questionnaires for the same farm. Pre-reconciliation Resolution of farm operators linked to multiple operations: 1 2 3 Farm #1: Kenneth has a partner who lives in Alberta (farm #3); Kenneth’s home address & phone #. Farm #2: Operated by Kenneth alone; 782-2622 is the farm’s phone number.
Pre-reconciliation Resolution of farm operators linked to multiple operations: 1 2 3 Farm #1: Kenneth’s home address & phone #; Kenneth has a partner X who lives in Alberta (Farm #3) Farm #2: Operated by Kenneth alone; 782-2622 is the farm’s phone number. Farm #3: Questionnaire filled by partner X; 7 Red River is the farm’s address located in Saskatchewan.
Pre-reconciliation Last step: resolution of multiple phone numbers: • Only two phone numbers are kept per farm operator. • The farmer could operate more than one farm! => synchronize the numbers among the farms
Pre-reconciliation Tools MixMatch* • Record linkage system with interesting tools: LIKENESS, address proxy, etc SAS programs • Automated resolution of suggested links • Batching for manual resolution + quality checks Manual work (tool: images, SQL queries, electronic phone book) • Manual resolution of links, inconsistencies + quality checks
Surveyed after May 16, 2006 Combine Reconciliation CEAG – Pre-reconciled FR – Farm Register 34,559farms 194,814 farms • Automated match • Manual searches: • Use questionnaire images and links to Census of Population • Non-linked CEAG farms are birthed on the Farm Register • Reconcile farms first, then operators
Auto-Combine Auto-Combine • Operation not surveyed after 2006 Census => CEAG over FR • Add/remove/modify operators on FR • Update operator information as follows:
Auto-Reconcile Auto-Reconcile • Operation surveyed after 2006 Census => FR takes priority • Keep existing operators on FR • Update administrative information as follows:
Conclusion Pre-Reconciliation (1) • New: first time • Major challenges: • Coordination of activities with CEAG processing flow (Match, Unduplication, etc) and management of resources Reconciliation (2) • 2006 system was an adapted version of 2001 system • Countless benefits from Pre-reconciliation: • links to Census of Population to identify related people, extra phone numbers for surveys, finished earlier, etc => Combine (1) and (2) and make it part of 2011 CEAG processing flow
Martin Lachance (613) 951-4899 Martin2.Lachance@statcan.ca