1 / 64

The Use of Administrative Sources for Statistical Purposes Common Problems and Solutions

The Use of Administrative Sources for Statistical Purposes Common Problems and Solutions. Public Opinion. The level of public concern about government departments sharing data varies from country to country There is usually some suspicion of the motives for data sharing

mcallistera
Download Presentation

The Use of Administrative Sources for Statistical Purposes Common Problems and Solutions

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. The Use of Administrative Sources for Statistical PurposesCommon Problems and Solutions

  2. Public Opinion • The level of public concern about government departments sharing data varies from country to country • There is usually some suspicion of the motives for data sharing • Sometimes public opinion favours data sharing

  3. Solutions • Adopt and publish a code of practice following international standards • Clearly stated limits and rules may help reduce concerns • The principle of the “one-way flow” of sensitive data must be understood by all

  4. Solutions • Publish cost-benefit analyses of the use of different sources • It may be possible to claim that data are more secure • No questionnaires sent by post • Fewer clerical staff, so fewer people with access to data

  5. Public Profile • Direct contact with the public via surveys helps raise the profile of the statistical office • The use of administrative data can reduce contact with the public and awareness of the work of the statistical office

  6. Solutions • Effective ‘marketing’ of the statistical office and data outputs • Greater involvement with education institutions, business groups, and other target customers

  7. Units • Administrative units may be different to statistical units: • Job / person • Tax unit / enterprise • Dwelling / household • They may need to be converted to meet statistical requirements

  8. Group ExerciseStatistical andAdministrativeUnits – How Many Enterprises?

  9. Enterprise Definition “the smallest combination of legal units that is an organisational unit producing goods or services, which benefits from a certain degree of autonomy in decision-making .... An enterprise may be a sole legal unit.” Source: EU Regulation 696/93 on statistical units

  10. Examples Taken from “The Impact of Diverging Interpretations of the Enterprise Concept” - a study prepared for Eurostat by Statistics Netherlands with input from Denmark and UK

  11. Example 1 Two legal units in an enterprise group have different 4 digit NACE codes; both are selling mainly to third parties outside the group. They share buildings, management, purchases and employees.

  12. Answers • NL: Combine into one enterprise • Intensity of shared production factors • UK: Combine into one enterprise • Intensity of shared production factors • DK: Two separate enterprises • Both sell more than 50% outside the group

  13. Four Legal Units : A and B have different activities, no combined purchases, but share buildings. C and D share buildings, employees, and purchases. All four present themselves as one firm. Example 2

  14. Answers • NL/DK: A and B are separate enterprises. Combine C and D into one enterprise • because A and B operate on market terms, whilst C and D share production factors • UK: All four in one enterprise • because they present themselves as one firm

  15. Example 3 Three legal units: All produce mainly for external customers, they share management and purchases, and represent themselves as one firm. A and B share a building. B and C have the same activity, share employees and capital goods and can not supply separate data.

  16. Answers • NL: Combine into one enterprise • All share management and purchases, and represent themselves as one firm • UK/DK: Combine B and C into one enterprise, A is a separate enterprise • Because B and C are horizontally integrated, and data are only available for these two together

  17. Twelve legal units form an enterprise group. Only one is active, the others have no employees. Example 4

  18. Answers • NL: One enterprise which only consists of the active unit • Because units which are not active are not part of an enterprise • UK: One enterprise which consists of all units • Because there is no point having separate enterprises for non-active units • DK: Each unit is a separate enterprise • There are no strong ties between the units

  19. Solutions • Automatic rules for simple cases • These must be clear and consistent • Statistical “adjustments” • E.g. the statistical unit is persons. The administrative unit is jobs. We know from a survey that working people have, on average, 1.15 jobs. This adjustment factor can therefore be used to estimate persons in employment from jobs • Profiling

  20. Profiling Definition • Profiling is a method to analyse the legal, operational and accounting structure of an enterprise group at national and world level, in order to establish the statistical units within that group, their links, and the most efficient structures for the collection of statistical data. Source: Eurostat Business Registers Recommendations Manual, Chapter 19

  21. Profiling • Gives a better understanding of complex unit structures • It is expensive and time consuming • It needs trained staff • It is a compromise based on a trade- off between quality, quantity and the resources available

  22. Quality Quantity Resources

  23. Business Profiling in the UK • 14 Staff • Approx. 1500 cases per year • Including 100 public sector • Mix of desk and visit profiling • Approx 200 visits per year • Should profilers also collect data from key businesses?

  24. Definitions of Variables • Administrative data are collected according to administrative concepts and definitions • Administrative and statistical priorities are often different, so definitions are often different

  25. Unemployment • Statistical definition (ILO) • Out of work • Available for work • Actively seeking work • Administrative definitions are often based on those claiming unemployment benefits

  26. Solutions • Know and document the differences and their impact • Use other variables to derive or estimate the impact of the difference • Statistical adjustments during data processing

  27. Classifications Two scenarios: 1. Same classification system 2. Different classification systems

  28. Same Classification • Used for different purposes • May not be a priority variable for the administrative source • Different classification rules • Different emphasis, e.g. specific activity rather than main activity

  29. Solutions • Understand how classification data are collected and what they are used for • Provide coding expertise, tools and training to administrative data suppliers

  30. Different Classifications (or different versions of the same classification) • Not always a 1 to 1 correlation between codes • Tools are needed to convert codes from one classification to another

  31. Solutions (1) • Stress the advantages of using a common classification • Offer expertise to help re-classify administrative sources • Give early notice of classification changes and help implement them across government

  32. Solutions (2) • Use text descriptions to re-code administrative data • Use probabilistic conversion matrices to convert codes • This results in individual unit classifications not always being correct, but aggregate data should be OK

  33. Example of a conversion matrix (Approx. 22% probability of correct code!)

  34. Missing Data • Impute where possible • Many different imputation methods are used. Two common methods are: • Deductive Imputation • Hot-deck Imputation

  35. Case Study • Eurostat have a project to develop enterprise demography • They want to estimate the impact of enterprise births • Employment of new enterprises is used, but this variable is often missing or unreliable for new units

  36. Solutions • Calculate turnover per head ratios to impute missing variables • Ratios based on “similar” units by classification and size • Problems with outliers therefore trimming used, e.g. x% or mean of inter-quartile range

  37. Possible Distributions

  38. Turnover per head ratios in practice ISIC TPH ..... 45.11 95 45.12 68 45.21 149 ..... A business has ISIC class 45.12, turnover is 200, employment is missing. What is the imputed employment value?

  39. Imputed employment is: 200 / 68 = 2.94 = 3

  40. Ratios such as turnover per head are also very useful for validating updates, matching and detecting errors!

  41. Timeliness Two Issues • Data arrive too late • Data relate to a different time period

  42. Data arrive too late • Data from annual tax returns are often only available several months after the end of the tax year, so they are unsuitable for monthly or quarterly statistics • Lags in registering “real world” events

  43. UK VAT Birth Lags (1)

  44. UK VAT Birth Lags (2) • 2/3 of businesses are on the register within 2 months of start-up • Mean lag = 4 months due to “outliers” • Median = Approx. 40 days • Some pre-register - negative lags

  45. Solutions • Understand the length and impact of lags • Adjust data accordingly • Look for ways to reduce lags where possible

  46. Different Time Periods • Administrative reference period (e.g. Financial/tax year) may not be the same as the statistical reference period • Monthly average versus point in time (e.g. employment data)

  47. Different Time Periods

  48. Solutions • Statistical corrections or estimations using data from other reference periods • Be aware of possible biases when using point in time reference dates

  49. Using data from different sources • Data from different sources may not agree • This may be due to: • Different definitions, classifications, time periods,.... • Errors

More Related