Preparation for exchange of micro-data on intra-EU trade between Member States SIMSTAT-Pilot ESSnet. 16.9.2014 Olli-Pekka Penttilä Director of Statistics / Co-ordinator Finnish Customs Nordic meeting 2014. Outline of SIMSTAT: Short background Task of the ESSnet1 (Pilot)
Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.
Preparation for exchange of micro-data on intra-EU trade between Member StatesSIMSTAT-Pilot ESSnet
Director of Statistics / Co-ordinator
Outline of SIMSTAT:
Background and history (1)
Background and history (2)
The proposal from 2012 – SIMSTAT
Background clear, but what to do?
-> Target timetable: trials analysis ready on Q4/2015? Final decisions during 2016?
SIMSTAT-Pilot ESSnet1 timeline: 12 months, 27.9.2013 – 26.9.2014
Main tasksof the ESSnet1
All work will be based on work already done in PTF and Quality/Methods groups
Solutions developed and adopted for testing, no “final” decisions to be made
Organisation of the work of ESSnet1
Kick-offmeeting on 7th November in Luxembourg
2nd meeting on 22. – 23. January2014 in Lisbon
3rd meeting on 7. – 8. May2014 in Sofia
Final 4th meeting on 10. – 11. September 2014 in Helsinki
WP1 tasks:Producing the technical documentation and instructions on technical issues for the exchange of micro-data during the ESSnetand future production-test environment
1.1. Elaboration of operational rules to be followed for those variables which are currently not collected by the countries participating in the trial test. This shall also include the operational rules for the simulation of the partner ID along the principle that was agreed in the PTF. (Draft February, Final 3th meeting)
1.2. Definition and description of the dataset structure and detailed data exchange rules:“Doc Met 400 SIMSTAT” (data elements on 2nd meeting, Draft document accepted by PTF February, Final on ESSnet3rd meeting)
Follow up the WP1 by Co-ordinator:
DocMet400SIMSTAT: micro data file specifications (mandatory, monthly). New mandatory data elements:
Other data file: other data file specifications (voluntary, monthly) will include?
WP2 tasks: Setting up the confidentiality arrangements for the trial micro-data exchange
2.1. proposal for the contractual arrangements for the ESSnetdata exchange and for the future production tests using the data transmission network(final on 2nd meeting)
2.2. preparation of a draft contract template to be used in the context of the ESSnetand for the future production tests using the data transmission network (semi-final on 2nd meeting, final on April 2014)
2.3. proposal for the practical organization of the micro-data exchange in the context of the ESSnetand signatures of the data exchange contracts (on 3rd meeting)
Follow up the WP2 by Co-ordinator:
Agreements signed (in force until end of 2017) between ESSnet1 participating MSs:
Micro data exchanged between the 14 MSs on May-June 2014
Plan how new MSs will sign the agreements
WP3 tasks: Establishing rules for micro data validation and credibility checks, error correction and revision of data
3.1. Proposal for the rules to applied in the future production tests as part of data transmission network (draft on 2nd meeting, final on 3rd meeting)
3.2. Proposal for the rules to be applied in the MS’s IT systems/data validation processes prior to the transmission of the data and after receiving the data (draft on 2nd meeting, final on 3rd meeting)
3.3. Proposal for a workflow on how to sending and receiving MS deal with errors that the receiving MS detects in the delivered data (draft on 3rd meeting, final on June PTF)
3.4. Testing of the feasibility of the proposed rules using the exchanged data as to reach a balance between error detection (data quality) and data validation/error correction burden for the MS’s (on 4th meeting)
Follow up the WP3 by Co-ordinator:
Rules for micro data validation and credibility checks and error correction done.
Testing of the new rules will be done during trial tests.
WP4 tasks: Designing the production timetable for the trial tests adjusted to the production timetables of the MS’s and the current legal framework. The timetable should accommodate the impact of late responses and data corrections
4.1 Draft proposal for the production timetable with regard to the future “production test” context where data transmission network will be used. (final on 2nd meeting)
4.2.Proposal for the timing and practices of data extractions and data exchange in ESSnetcontext in order to simulate the future “production test” timetable (draft on February 2014, final on 3rd meeting)
4.3. Final proposal for the production timetable with regard to the future “production test” -context where data transmission network will be used including the impact of late response and data corrections (final on 4th meeting)
Follow up the WP4 by Co-ordinator:
4 delivery dates during the month will be used to transfer micro data between the sending MS to the HUB for onward transfer to the receiving MS. The deadline for all MSs is t+30.
The delivery of all monthly 2013(?) and 2014 data by the Member States to the HUB should be transferred either before the start of the trial or the data could be staggered during the trial test.
The trial test expects participating Member States to transfer 2014 and 2015 Intrastat data according to the agreed timetable and file specification (DocMet400 SIMSTAT).
WP5 tasks: Elaborating and implementing the data compilation guidelines
5.1. Overview to national compilation practices (final on 2ndmeeting)
5.2 Proposal for the common practices to be applied for the data compilation during the ESSnet. (final on 3rd meeting)
5.2 Proposal for the common practices to be applied for the data compilation in the future “production testing” environment. (final on 4thmeeting)
Follow up the WP5 by Co-ordinator:
National test databases done for sending and receiving of micro data files
Merging received other MSs Intra-EU exports and national Intra-EU imports data
Invoice value will be analyzed
Simulation of “ID of partner trader” if not collected
WP6 tasks: Elaborating and implementing the quality evaluation of the test results
6.1 Proposal for an analysis plan to evaluate the quality of the statistics to be produced during the ESSnetwork. The plan should include both the production of short-term estimates and the production of detailed data. (draft on February-March 2014, final on 3rd meeting)
6.2 Compilation and quality evaluation of statistics using the data exchanged during the ESSnet. Each participating MS should compile and analyze the data concerning their own economy obtained from other Member States. (reports August 2014, final on 4th meeting)
6.3 Summary report on the results of the data analyses performed by all participating MS’s. (final on 4th meeting)
Follow up the WP6 by Co-ordinator:
Analysis plan has over 10 Excel spreadsheets. Only 10 MSs had time to do analysis during the summer, first time is the most burdensome.
Summary report, first remark:
Analysis plan for trial tests: process and product
Nextsteps, the outline:
Nextsteps, detailed (1):
Nextsteps, detailed (2):