1 / 24

FME data migration and Q&A strategies

FME data migration and Q&A strategies. Ulf Månsson FME Certified Professional/Trainer. Sept 2012. !!!NERD WARNING!!!. FME-code have been excavated from 1997-1998 FME Innovator Award 2006 Vancouver FME Certified Professional 2007 FME Idol Final 2008 Vancouver FME Certfied Trainer 2009.

glen
Download Presentation

FME data migration and Q&A strategies

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. FME data migration and Q&A strategies Ulf Månsson FME Certified Professional/Trainer Sept 2012

  2. !!!NERD WARNING!!! • FME-code have been excavated from 1997-1998 • FME Innovator Award 2006 Vancouver • FME Certified Professional 2007 • FME Idol Final 2008 Vancouver • FME Certfied Trainer 2009 Ulf Månsson

  3. INSPECTION AT EVERY STAGE 2 3 1 SOURCE MAGIC DESTINATION Ulf Månsson

  4. Example 1E.ON Map Base SOURCE DWG/DXFDGN MAGIC FORMATSCHEMA REPROJECTION SYMBOLS QA DESTINATION ORACLE & DGN

  5. Example 1 - E.ON Map Base • Map data / map information for morethan 100 municipalitieshas been • handled, • analysed, • controlled, • reworked and • archived. • Data has normallybeen • metadata, • map data, • transformation parameters, • endproducts in DGN-formatand Oracle Spatial • overviews, reports and otherdata Ulf Månsson

  6. Inspection DESTINATION SOURCE Ulf Månsson

  7. Tables for schemas DESTINATION SOURCE

  8. Restructuring MAGIC QA Schema mapping

  9. Example 1E.ON Map Base Example 2City of Malmö SOURCE DWG/DXFDGN ArcSDE MAGIC FORMATSCHEMA REPROJECTION SYMBOLS QA FORMATSCHEMA REPROJECTION SYMBOLS QA/CLIPPING DESTINATION ORACLE & DGN TILED DWG

  10. Example 2 – City of Malmö Restructuring MAGIC QA Schema mapping

  11. MAGIC of batching • So many ways: • Wildcard reading ”fan in out” • Database transformers • Workspacerunner driven by ”Directory and file path reader” • FME Server Job submitters • Core FME Server functionality • Commandline? .BAT files • FME Objects? .NET etc

  12. Example 1E.ON Map Base Example 2City of Malmö Example 3QA in Utility ORACLEEXCEL DWG/DXFDGN ArcSDE SOURCE FORMATSCHEMA REPROJECTION SYMBOLS QA FORMATSCHEMA REPROJECTION SYMBOLS QA/CLIPPING QA LOGGING CANDIDATES MAGIC ORACLE ORACLE & DGN TILED DWG DESTINATION

  13. Example 3 – QA in utility MAGIC Defining municipality by zip-code from CIS… The mercyless ConvexHullAccumulator exposes bad quality.

  14. Validering Ulf Månsson

  15. ConvexHullAccumulator- Good Data

  16. Example 1E.ON Map Base Example 2City of Malmö Example 3QA in Utility Example 4Södra forestry ORACLEEXCEL SHP DWG/DXFDGN ArcSDE SOURCE FORMATSCHEMA REPROJECTION SYMBOLS QA FORMATSCHEMA REPROJECTION SYMBOLS QA/CLIPPING QA LOGGING CANDIDATES QA LOGGING GENERALIZING MAGIC ORACLE ArcSDE ORACLE & DGN TILED DWG DESTINATION

  17. Maintaining and optimising data for a nation-wide ArcSDE database • We are handling appr. 8-12 Gb vector data, in ESRI shape format. Map data are stored in an ArcSDE database which provides our clients business systems with map data through web services. • FME Workbench is used to optimize map data and thus enhance map performance dramatically. The workbench files are also used as documentation of our working process and to keep track on which data have been used, which data have been created and for what purpose! Ulf Månsson

  18. Maintaining and optimising data for a nation-wide ArcSDE database • Optimisation of map data is performed considering which information is relevant and map performance at pre-defined zoom scale levels. Ulf Månsson

  19. The FME approach is the same ! SWECO EnvironmentB. Almström, O. Persson

  20. Nya lager i ArcSDE SQLServer => Nya lager i Oracle Spatial

  21. Whydo so many live in Origo??? ”You should at least have used the 2DPointReplacer before deployment!”

  22. Thank You! • Questions? • For more information: • Ulf.Mansson@sweco.se

More Related