European Union Open Data Portal and Eurostats 2013 Dr. Brand Niemann Director and Senior Data Scientist Semantic Community http://semanticommunity.info/ AOL Government Blogger http://breakinggov.com/author/brand-niemann/ October 21, 2013 http://semanticommunity.info/European_Union_Open_Data_Portal
Background • At the recent SEMIC 2013 Conference Keynote: Maintaining the quality of EU statistics while enabling re-use, Eurostats' Marco Pellegrino highlighted the potential benefits and main challenges on the publication of statistical data as linked open data at the European Union Open Data Portal where 5,907 of the 6,135 datasets are from Eurostat. • Statisticians and data scientists use quality data for statistics and data stories for decision-makers. • This was what I did for US and Japanese Open Government Data.
Previous Dashboard https://silverspotfire.tibco.com/us/library#/users/bniemann/Public?EuroStats2012-Spotfire
Eurostat 2013Comprehensive Database http://epp.eurostat.ec.europa.eu/portal/page/portal/information_society/data/comprehensive_databases
Goals • The European Data Portal Video Script Challenged Me To Be: • A developer creating a useful website: I restructured the EU Open Data Portal and Eurostat Comprehensive Databases Web Page into a knowledge base in MindTouch that helped me better understand and use the content; • A journalist looking to check some figures: I extracted the statistics (keywords, resource formats, and publishers) on the data sets in the European Data Portal and the tables and queries from the Eurostat Comprehensive Database in Access to be able to actually see the numbers; • A journalist looking to check some figures: I used the spreadsheets and Spotfire to visualize the numbers in creative ways so I could write a data story.
Knowledge Base: MindTouch My Note: The entire platform can be searched. My Note: The Semantic Community Platform includes MindTouch (Wiki), Spotfire (Analytics), and Be Informed (Be Free). This page can be search by Google Chrome Find. http://semanticommunity.info/European_Union_Open_Data_Portal
Knowledge Base: Access Semantic Interoperability at the Data Element Level by Statistical Design!
Knowledge Base: Spreadsheet My Note: All of these spreadsheets can be searched. My Note: The Semantic Community approach is consistent with the ISA Recommended URI Design and Management Principles. http://semanticommunity.info/@api/deki/files/26666/ECISAJoinup2013.xlsx http://semanticommunity.info/@api/deki/files/26772/EuroStatsCD2013.xlsx
Knowledge Base: Spotfire My Note: These Visualizations Are Dynamically Linked. https://silverspotfire.tibco.com/us/library#/users/bniemann/Public?EuroStatsCD2013-Spotfire
Conclusions and Recommendations • The Eurostat 2013 Comprehensive Database is Easier to Use Than the European Union Open Data Portal and Its Linked Data. • The Eurostat 2013 Comprehensive Database Contains Semantic Interoperability at the Data Element Level by Statistical Design! • As a Statistician and Data Scientist, I Recommended the Use of Quality Data for US and Japanese Open Government Data. • "CubeViz, a Facetted Browser For Statistical Data That Uses the RDF Data Cube Vocabulary, Appears to Do the Same Thing as Spotfire With Spreadsheet and Access Databases. • Incidentally, I Find Using RDF For Data To Be More Work Than Using PDF for Data. • My three-fold challenges and goals were met and yet there is still so much that can be done with this excellent data source and these wonderful tools!