180 likes | 282 Views
Metadata of national statistical offices Belarus , Russia and Kazakhstan. Miroslava Brchanova, Moscow, October, 2014. Introduction. In fact, all national statistical offices (NSOs) all over the world are focused on presentations of reference metadata on their web sites.
E N D
Metadata of national statistical officesBelarus, Russia andKazakhstan Miroslava Brchanova, Moscow, October, 2014
Introduction In fact, all national statistical offices (NSOs) all over the world are focused on presentations of reference metadata on their web sites. It is a logical process that reflects the need to explain what the content of the published data is. Less common is the use of structural metadata in the whole cycle of processing statistical data. Metadata of national statistical offices
NATIONAL STATISTICAL COMMITTEEOF THE REPUBLIC OF BELARUS • The NSO plans to use the GSBPM 5.0 to describe the existing statistical production processes. It started a pilot survey description in February 2014. • However, metadata presented on the website of Belarus isof passive nature so far: • Information about the methodology of various statistics • Official classifications • Dates of data collection • Statistical questionnaires. Metadata of national statistical offices
RUSSIAN FEDERATION FEDERAL STATE STATISTICS SERVICE (ROSSTAT) 1 • ROSSTAT has located a conception (for the years 2011 - 2017) of creation an integrated processing system based on a unified system metadata on its web site. • The system should include: • Catalogue of statistical indicators • Uniform code lists and classifications. • Indicators and code lists should be uniformly applied throughout the process of processing statistical data. The system should be based on the methodology and standards of SDMX system. Metadata of national statistical offices
Russian Federation Federal State Statistics Service2 • There is an electronic catalogue of metadata on the web site of ROSSTAT so far. It contains a descriptive information of all input and output indicators of the Federal state statistics service.In addition, the site contains mainly passive metadata of: • Information about the methodology of various statistics • Official classifications • Dates of data collection • Statistical questionnaires. • There is also a description of the SDDS standard methodology for data transmission the IMF on the web. Metadata of national statistical offices
Collect Process Analyse Disseminate Metadata of national statistical offices Metadata driven architecture Inputs ? Outputs
Metadata driven architecture • Statistical processes are driven by metadata. • Necessary preconditions: • High level of automation • Metadata must be ready from the first stage of statistical data processing. • Such architecture ensures „active“ up-to-date metadata. • In such architecture metadata have to cover all statistical variables/indicators, not just outputs. Metadata of national statistical offices
GENERICSTATISTICALBUSINESSPROCESSMODEL Metadata of national statistical offices • Source: http://www.unece.org
The Republic of Kazakhstan - Achievements • The NSO has realized several important implementations that may be considered as thebest practices for other statistical offices. • The achievements are: • System of dissemination of statistical data and metadata TALDAU • System of statistical metadata (classifications and nomenclatures) • Model of integrated data processing, storage and dissemination(actually in advanced phase of implementation). Metadata of national statistical offices
System of the Committee on statistics Republic of Kazakhstan – IS “Metadata” • IS “Metadata” goal is a technological support of processes, extension and adjustments, internal and external integration of the components IIS“e-statistics”. • Tasks for the development of the IS “Metadata” are: • To unify recording of metadata description • To unify providing IS management • To unify dataand metadata exchangewith users. Metadata of national statistical offices
IIS“e-statistics” Collect Phase Process Phase Disseminate Phase Service Meta-block Description of Forms Meta-block Data Collection Meta-block Register Meta-block Classifiers Meta-block Data Processing Meta-block Distribution Meta-block Service Metadata Metadata of national statistical offices IS “Metadata”
GSBPM Taldau ? ? ? ? Metadata of national statistical offices Collect Phase Process Phase Disseminate Phase
Metadata driven architecture - Input • The following processes of phase Design and phase Built are not/ not fully covered by IS „Metadata“ in the Kazakh NSO: • Methodological preparation of survey • Timetables • Structure and design of questionnaires • Sample frame and samples • Metadata definition of data validation rules • Metadata definition of self-corrections • Programming specifications Metadata of national statistical offices
System of the Republic of Kazakhstan – Goals 1 • To add subsystemsin to IS „Metadata“: • Users‘ requests • Quality. • Users‘ requests application programmeshouldbe a place where: • Internal and external users can describe their needs • Methodologists and domain experts evaluate requests • Reports for management. • The sub-system should keep records of: • Decision • Reasoning • Further steps. Metadata of national statistical offices
System of the Republic of Kazakhstan – Goals 2 • To improve cooperation of methodologists with the metadata experts, subject matter statisticians and computation centre. • Methodologists should be trained on the topic of metadata. Round tables should be organized. • Conditions for sampling must be developed. • To implement a modular approach to questionnaires in order: • To reduce an administrative burden on respondents • To improve quality of statistical indicators • To improve consistency of statistical data • To publish statistical data for the general population. Metadata of national statistical offices
System of the Republic of Kazakhstan – Goals 3 • In order to create a kind of quality map is necessaryto create an application „Quality“ that allows to monitor and evaluate all stages of the data processing. • The main stages of interest from this point of view are: • Specification requirements • Design • Data collection • The processing steps. Metadata of national statistical offices
CONCLUSIONS • To make metadata active to the greatest extent possible from the very beginning. Active metadata are metadata that drive other processes and actions. • To reuse metadata where possible from the very beginning for statistical integration as well as efficiency reasons. • To preserve history (old versions) of metadata from the very beginning. • To make metadata-related work an integral part of business processes across the organisation from the very beginning. Metadata of national statistical offices
Any questions? Metadata of national statistical offices Abbreviations: SDMX – Statistical Data and Metadata Exchange SDDS – Special Data Dissemination Standard TALDAU– Information-analytical system IS – Information System IIS - Integrated Information System