1 / 53

System Performance and Scalability in Enterprise GIS

Learn about key performance metrics, capacity planning, system testing, and monitoring strategies for optimizing Enterprise GIS efficiency and scalability. Explore tools, methodologies, and best practices to ensure smooth system operation.

eknowles
Download Presentation

System Performance and Scalability in Enterprise GIS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Enterprise GIS: Performance and Scalability Andrew Sakowicz, asakowicz@esri.com Frank Pizzi, fpizzi@esri.com

  2. Definitions

  3. Performance Speed, e.g. response time (seconds)

  4. Scalability The ability to increase output and maintain acceptable performance

  5. Capacity The maximum level of output the system can produce, e.g. X cars/sec X maps/sec At capacity Over capacity

  6. Bottleneck Resource(s) limiting the performance or capacity Not bottleneck bottleneck Think of : Lanes -as CPU processor Toll -as ArcGIS Server instances Cars -as map requests

  7. Capacity User load Throughput(req/hr) CPU Utilization (%) Network used (Mbps) Response Time (sec) Capacity (~ 85% utilization) Memory used (Mb) Content length (bytes) Time

  8. Process and Tools

  9. Process and Tools Type Presentation Title Here

  10. System Tools overview http://www.arcgis.com owner:EnterpriseImp Show ArcGIS Desktop Content

  11. Relationship between System Tools

  12. System Tools framework System Tools are not just tools

  13. Infrastructure Capacity Planning

  14. Provide sufficient hardware resources Most systems are CPU bound Most well-configured and tuned GIS systems are CPU bound. GIS Systems are bound by: • CPU - typically • Memory – when large number of services • Disk – Image Service, Synchronization • Network – low bandwidth deployment • Poorly configured virtualization can result in 30% or higher performance degradation

  15. Infrastructure Memory requirements Wide ranges of memory consumptions

  16. Infrastructure Hyper threading does not double throughput System Test case: 4 physical, 8 logical core

  17. System Designer Solution Architecture design methodology Gathering requirements Designing Capacity: CPU, Network, Memory Reporting

  18. System Designer output

  19. Demo System Designer

  20. Performance Testing

  21. Testing Objectives Meet Service-Level Agreement (SLA) Bottlenecks analysis Capacity planning Benchmarking different alternatives

  22. Testing process

  23. Required skill set Configuration, Tuning, Testing

  24. Browser Total Response Time (t1-t2) Web Server Wait Time ArcGIS Server Usage Time ArcSOC Search & Retrieval Time ArcSDE/DBMS Tuning methodology Profile each tier starting from the top t2 t1

  25. Fiddler Fiddler measurement approximately 5.2 seconds

  26. ArcGIS Server 10.3.1 Statistics http://server.arcgis.com/en/server/latest/administer/windows/about-server-statistics.htm Total requests Average response time Maximum response time Timeouts Maximum running instances 30 min resolution reports

  27. ArcGIS Server Logs http://www.arcgis.com/home/item.html?id=90134fb0f1c148a48c65319287dde2f7

  28. System Monitor –ArcGIS Server Statistics • https://systemmonitoring-emcs.esri.com/#/arcgis/ESLSRV12 • User: esridemo • Password: esridemo

  29. Mxdperfstat http://www.arcgis.com/home/item.html?id=a269d03aa1c840638680e2902dadecac

  30. Oracle Trace Compare elapsed time Elapsed time slightly changed due to different test runs

  31. Oracle Execution plan Inefficient spatial index

  32. System Test Tool features GIS Test Automation ArcGIS Services Mapping Feature Service OGC Geocoding Image Service Network Analyst Geoprocessing Tile Cache Application Testing Discipline relevant report

  33. Test tools feature comparison Tech Support by Esri PS as part of consulting support

  34. Performance testing Value Identify bottlenecks Determine system capacity Demonstrate performance SLA

  35. Demo System Test

  36. System Monitoring

  37. Monitoring Enterprise GIS Challenges Multiple administrators Multiple disparate monitoring/diagnostic tools Data collected in a reactive fashion: on demand and for limited time Correlation of data with different timestamp is difficult ArcGIS administrators do not have access to all tools, data and reports Challenging to quickly identify the root cause and take appropriate measures

  38. Standards for effective GIS monitoring • Many excellent monitoring tools on the market • Few provide GIS dashboards • System Monitor can be used as reference implementation

  39. Enterprise GIS effective monitoring “PIECE” of mind with System Monitor Proactive Integrated Dashboards across all tiers End-to-End All tier monitoring Continuous %Coverage provided Extendable Custom queries

  40. Monitoring Value Proactive validation:

  41. Demohttps://systemmonitoring-emcs.esri.com/Portaluser: esridemopassword: esridemo

  42. Use Cases Applied use of System Monitor and Test tools

  43. Demo Simulate CPU spike (e.g. Antivirus scan)

  44. Demo Simulate ArcGIS user load

  45. Demo Intermittent slow performance: Networks latency (SM extensions) https://systemmonitoring-emcs.esri.com/#/url/eslsrv12_6080_arcgisoutput_1mb_file

  46. Demo ArcGIS Server services stopped

  47. Demo ArcGIS Server service usage https://systemmonitoring-emcs.esri.com/apps/dashboard_sample/#/ArcGIS

  48. Demo Unbalanced resources: ArcGIS Server clusters https://systemmonitoring-emcs.esri.com/apps/dashboard_sample/#/ArcGISConfig

  49. Demo ArcGIS Server slow services https://systemmonitoring-emcs.esri.com/apps/dashboard_sample/#/ArcGIS

  50. Demo ArcGIS Server service usage https://systemmonitoring-emcs.esri.com/apps/dashboard_sample/#/ArcGIStuning

More Related