Designing and Using Cached Map Services

1. 2013 Esri International User Conference July 8–12, 2013 | San Diego, California Technical Workshop Designing and Using Cached Map Services Eric Rodenberg & Tom Shippee

2. What’s covered in this session • Agenda • Map cache basics • Map cache best practices • Map cache administration • Map cache clients Designing and Using Cached Map Services

3. What’s covered in other sessions • Image service caching • Caching Imagery using ArcGIS • Understanding Pyramids, Overviews and Caching • Caching in the cloud • Building and Maintaining ArcGIS Online Hosted Tiled Services • Using the Power of Amazon EC2 to Build Map Caches • Advanced topics • Enterprise Architectures for Large Map Caching Projects • ArcGIS Server Performance & Scalability—Optimizing GIS Services • Automating Cache Workflows and Building Tile Usage Heat Maps Designing and Using Cached Map Services

4. Map cache basics Understanding caching concepts Designing and Using Cached Map Services

5. How does a map cache work? Client ArcGIS Server Dynamic map Cached Map Render Label Project … Designing and Using Cached Map Services

6. Three reasons to care about map caches • Performance • Scalability • Cartographic quality Designing and Using Cached Map Services

7. Many layers fused into one tile Transportation 1:32000 Hydrography Cache tile Landbase 1:16000 1:8000 1:4000 1:2000 Designing and Using Cached Map Services

8. Authoring of map document • Use scale dependent display • Group layers by scale • Use annotation • For mash up use ArcGISOnlinescales Designing and Using Cached Map Services

9. What should you cache? • Base maps • Operational layers that are • High volumes of traffic • Don’t change often • Cover small scales only Designing and Using Cached Map Services

10. Best performing image formats • Vectors few colors • PNG (auto selects bit depth) • Vectors many colors • MIXED with 90 quality • Imagery • MIXED with 55 quality • Vectors or labels + Imagery • MIXED with 90 quality Designing and Using Cached Map Services

11. Choosing the best image format • Large number of continuous colors • JPEG ( start with quality = 55 ) • Mixed ( if transparency required ) Which one looks better? Which one looks better? JPEG 90 – 21KB JPEG 55 – 10KB JPEG 55 – 15KB JPEG 90 – 33KB Designing and Using Cached Map Services

12. What is antialiasing? • High quality line/label rendering on vector maps • Web standard (Google, Bing, AGOL) • Takes LONGER to cache No antialiasing Best antialiasing Designing and Using Cached Map Services

13. Building a map cache DEMO Publish, configure and build a cached map service. Designing and Using Cached Map Services

14. Map caching best practices Strategies and techniques Designing and Using Cached Map Services

15. Understanding cache structure Bundle8 x 8 supertiles Bundle8 x 8 supertiles (4K) Supertile16 x 16 tiles Standard tile256 x 256 pixels 16, 384 tiles Designing and Using Cached Map Services

16. Track cache status • Status.gdb • File geodatabase in caching folder • Accessed by reporting tools for status • Records cache task progress • Identify completed tiles • Copied to an ArcMap folder • Cache error review • Time aware cache analysis Designing and Using Cached Map Services

17. Anatomy of a cache DEMO Explore a 3D time aware view of cache generation. Designing and Using Cached Map Services

18. Supertiles and Labeling • ArcGIS Server Draws Large Areas • Reduces duplicate labels • Duplication May Occur • Use Annotation or MapPlex Labels with Rules • Use Map Server Cache Tiling Scheme To Polygons Supertile Boundary Designing and Using Cached Map Services

19. You don't need to generate everything • Cache by feature • Polygon features • Generates all tiles for intersecting supertiles • Saves on… • Generation time • Processor resource • Disk usage NM highway case study: Build 20 of 64 supertiles for the bundle shown Designing and Using Cached Map Services

20. Pre-create coupled with cache on demand • Pre-create high use areas • Population centers • Parks, roads, attractions • Features • Cover popular extent • Generate key tiles • All others generated on demand Generated on demand Generated on demand Designing and Using Cached Map Services

21. The ideal tiles to cache on demand • Few simple features • Barren homogenous area • Rarely accessed • Large scales only • Draw relatively fast Designing and Using Cached Map Services

22. Handling tiles you do NOT create No Data • Create “No Data” tile • Same image format (JPG or PNG) • Same size (256 x 256) • Save in cache folder …\<dataframe>\_alllayers • How to • Knowledge base article 36939 has sample files No Data

23. Build a test cache and note the following • Creation time • Appearance • Client performance • Cache size validation Designing and Using Cached Map Services

24. Map cache administration Generate and update techniques Designing and Using Cached Map Services

25. Setting the Number of Instances • Cache Tools Geoprocessing Service • Start with N • N = CPU’s per server • See cloud session for Amazon recommendations 8CPU’s = 8 Instances 8 CPU Designing and Using Cached Map Services

26. System caching services • System services • Caching Tools: Sets caching instance per machine • Caching Controllers: Assign cache jobs to instances • Manage Map server Cache Tiles • Controls instances per job • Set to -1 to use all instances Per job Per machine Designing and Using Cached Map Services

27. Update a cache using a staging server Staging ArcGIS Server Instance Production ArcGIS Server Instance All layers for cartography of map service Layers for TOC and Query Map service Map service Cache folder (On-demand caching needs the full map to build the cache) Designing and Using Cached Map Services

28. Isolate caching to certain servers • Organize GIS Servers into Clusters • Generate Cache on its own cluster • Scale or reconfigure while caching Default Cluster Caching Cluster GIS Server C GIS Server B GIS Server A Map Service instances Cache Tools instances ArcGIS Site cache Designing and Using Cached Map Services

29. Isolate caching to certain servers • Organize GIS Servers into Clusters • Generate Cache on its own cluster • Scale or reconfigure while caching Default Cluster Caching Cluster GIS Server A GIS Server C GIS Server B Cache Tools instances Map Service instances cache ArcGIS Site Designing and Using Cached Map Services

30. Cache failure & recovery – Out of the box • Out of the box tools • Course grained for locating extents • Fix errors: Re-cache extents where errors reported Report Errors… Fix Errors Export Errors to File… Details… Designing and Using Cached Map Services

31. Recovering cache failure DEMO Use Status.gdb to identify and rebuild errors. Designing and Using Cached Map Services

32. Cache failure & recovery – sample tools • Cache Validation Tools • Fine grained for locating tiles by file size • Custom tool available via resources.arcgis.com Designing and Using Cached Map Services

33. Cache update automation • Use Model Builder to script update automation • Rebuild Specific Tiles • Export to Python • Schedule Run Time • Useful update tools • Compare feature classes • Show edits since reconcile • See demo theater • Automating Cache Workflows and Building Tile Usage Heat Maps

34. Cache export tool • Export tiles • Based on extent or polygon features • Convert storage format • Use for cache import or as a disconnected cache Export Exported using Nevada and Utah state boundary features. Designing and Using Cached Map Services

35. Cache import tool • Import tiles • Based on extent or polygon features • Must have same storage format Import Import from a previously exported map cache. Designing and Using Cached Map Services

36. Map cache clients Optimizing web applications Designing and Using Cached Map Services

37. Using multiple domains • With multiple services • Use a different domain for each service • With one service • API’s support multiple URLs for a single layer • Cautions • Use with small cache tiles • Reduce browser caching results in more HTTP connections var layer = new esri.layers.ArcGISTiledMapServiceLayer( "http://www.mydomain.com/arcgis/rest/services/myMap/MapServer", { tileServers: [ " http://cache1.mydomain.com/arcgis/rest/services/myMap/MapServer ", " http://cache2.mydomain.com/arcgis/rest/services/myMap/MapServer “] }); Designing and Using Cached Map Services

38. Request large scales as dynamic maps • Supported by map services & Web API’s • Cached (most scales) • Use: ArcGISTiledMapServiceLayer • Dynamic (largest scales only) • Use: ArcGISDynamicMapServiceLayer Scale Levels 10 – 17 Cached Scale Levels 18 – 19 Forced Dynamic Draw Designing and Using Cached Map Services

39. Dynamic & tiled hybrid DEMO Configure a web application to make dynamic requests at large cache scales. Designing and Using Cached Map Services

40. Thank you… Please fill out the session evaluation First Offering ID: 1224 Second Offering ID: 1336 Online – www.esri.com/ucsessionsurveys Paper – pick up and put in drop box Designing and Using Cached Map Services

41. Designing and Using Cached Map Services