Mark Nesson/Vashti Ragoonath October 2008. Performance and Tuning Tips. Performance and Tuning Tips Overview. Performance Testing Used to eliminate bottlenecks and establish a baseline Should be conducted in a controlled environment Must have a clear set of expectations
Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.
Mark Nesson/Vashti Ragoonath October 2008 Performance and Tuning Tips
Performance and Tuning TipsOverview Performance Testing • Used to eliminate bottlenecks and establish a baseline • Should be conducted in a controlled environment • Must have a clear set of expectations • Number of concurrent users • Response times for queries • Meet users expectations and Service Level Response times Tuning Repetitive process of: • Running tests to identify bottlenecks • Tuning one component at a time and redoing tests • Increasing load to identify all bottlenecks ..until objectives are met
Performance and Tuning TipsOverview Bottlenecks can exist at different levels: • Application Level • Developers can look for inefficiencies in their code • Database Level • Use query optimizers and database profilers to check for bottlenecks • Operating System Level • Administrators can use utilities tools like PerfMon on Windows and on UNIX top, vmstat, iostat to track CPU, RAM, Disk Space utilization • Network Level • Network Administrators can use utilities like netstat, packet sniffers like tcpdump and others like ethereal
Performance and Tuning TipsTuning Components External Tuning Components • Operating System • Database Server • Application Server • Java Virtual Machine • Network WebFOCUS Tuning Components • Application • Data Adapters Dialect Specific or Generic • Reporting Server Workspace Manager • Reporting Server Java Services • ReportCaster Distribution Server
Performance and Tuning TipsExternal Tuning Components - OS • Operating System • Work with the OS Administrators to identify bottlenecks. If the system is maxed out on CPU and RAM use the system utilities to identify which processes are taking up all the resources. Maybe some jobs can be run at off-peak hours or deferred and a lower CPU priority. • Check all configuration files to ensure they are in sync with the current releases of installed software. Upgrades may require updates to old configuration files that could improve performance overall on the system. • Track usage patterns on the machines to identify problems and failures which can be fixed easily.
Performance and Tuning TipsExternal Tuning Components – Database Database Server • Verify that the database optimizer runs as recommended to generate good data statistics. Example: Oracle ANALYZE command creates optimizer statistics to choose methods of fast access to the data. If the statistics were not generated properly, performance will be affected. • Fix Indexes. Use EXPLAIN to see what the optimizer does with SQL statements. Does it do a full table scan? Does the table have appropriate indexes for the queries? You may have to rebuild indexes. • Spread the Database Over Disks and I/O Channels. e.g: Partition tables and indexes over multiple disks
Performance and Tuning TipsExternal Tuning Components – App Server • Use Pre-compiled JavaServer Pages • Disable Dynamic Application Reloading • Tune Thread Pool • Initial Thread Pool size • Minimum number of threads in pool • Maximum Thread Pool size • Maximum number of concurrent threads in pool • Thread inactivity timeout • Time spent waiting for client response before being returned to pool • Growable thread pool • Number of threads the pool should increase by when it’s maxed out
Performance and Tuning TipsExternal Tuning Components – JVM Java Virtual Machine (JVM) • Tune Heap Size so garbage collection time is minimized and clients can still be processed. • Initial Heap Size • Maximum Heap Size • Garbage Collection • Use the -verbosegc option to track frequency and times of garbage collection
Performance and Tuning TipsExternal Tuning Components – Network Network • Network administrators will be able to identify and tune bottlenecks are with the use of: • packet sniffers such as tcpdump • network protocol analyzers such as ethereal • utilities such as netstat, ping, traceroute and others
Performance and Tuning TipsDemo: JVM Tuning • Let’s see a live demo of tuning the Tomcat thread pool • Test Case 1 – Low thread pool • Tomcat parameters: Low thread pool(15), 256MB Heap size, 25 concurrent users, request sleeps for 15 secs, 100 available tscom agents • Capture baseline performance statistics • Tune the Tomcat JVM: Large thread pool(75), 256MB Heap size, 25 concurrent users, request sleeps for 15 secs, 100 available tscom agents • Capture performance statistics • Response times improved by a little less than 25%
Performance and Tuning TipsDemo: JVM Tuning INFO: Find registry server-registry.xml at classpath resource Oct 28, 2008 12:41:25 PM org.apache.catalina.startup.Catalina start INFO: Server startup in 65125 ms Oct 28, 2008 12:42:31 PM com.amberpoint.util.soa.servlet.ServiceDeploymentServle t$ServiceInitializer run url, then contact that service at that URL to get it started. Oct 28, 2008 12:43:24 PM org.apache.tomcat.util.threads.ThreadPool logFull SEVERE: All threads (15) are currently busy, waiting. Increase maxThreads (15) o r check the servlet status
Performance and Tuning TipsWebFOCUS Tuning Components – Application Application • Verify that requests are generating optimized SQL • Enforcing all RDBMS efficiencies Data Adapters • Enable OPTIMIZATION flags ( SET OPTIMIZATION) • Fetch data in larger blocks (SET FETCHSIZE) • Test for optimum performance • Has show to increase performance by 5% • Set ISOLATION Level RU (Read Uncommitted)
Performance and Tuning Tuning Components –Reporting Server Workspace Manager -Data Services • maximum • number_ready • deployment * private connection_pooling • Queuing • idle_session_limit • idle_agent_limit • cpu_limit • memory_limit • connection_limit • max_connections_per_user * • agent_refresh • sched_priority
Performance and Tuning Tuning Components –Java Services Workspace Manager –Configuration • Java Services • Most commonly used to: • Rendering output format of flex on the Reporting Server • With the JSCOM3 • Tuning Parameters • Initial Java Heap Size • Maximum Java Heap Size • Java Thread Stack Size • JVM_OPTIONS • Specify other performance type options
Performance and TuningDemo: Graph Processing • Let’s see a live demo of how Java Services is used for processing graphs. • JSCOM Listener under Java Services • Can have a cluster of JSCOM Listeners • Can be configurable • Graph request generates 5 flex reports. Using the default JSCOM3 Listener we will run 1, 3, 5 concurrent users and look at the response time. • We then add a second JSCOM Listener and rerun our test. • Is there an improvement in the response times? • Yes there is…
Demo: JSCOM/FLEX Processing (broflex) #JSCOM3 HEAPSIZE #THREADS RESP 1 default 1 3 1 default 5 12 1 default 10 29 1 default 15 38 1 768 1 3 1 768 5 8 1 768 10 18 1 768 15 24 3 768 1 3 3 768 5 6 3 768 10 13 3 768 15 19
Performance and Tuning Tuning Components –ReportCaster ReportCaster Configuration • General Tab • Maximum Threads • Data Server (NODE) • Maximum Connections • Data Server (CLUSTER) Weight Maximum Connection Algorithm to determine which server to send request to: • Weight * maximum connection = priority • Request will be routed to server with highest priority
Performance and TuningDemo: ReportCaster Compression • Let’s see a live demo of how we can have a scalable distribution server by using ReportCaster compression. • Run request with embedded graphical images and distribute in uncompressed PDF format to Report Library. • Check to see what the original file size is in the BOTLIB table and make sure it was not flagged as compressed in the BOTSCHED table. • Column AUDITOR in table BOTSCHED has a flag to indicate if data is compressed. • Column REPORTSIZE in table BOTLIB has file size before compression. • Column LIBFIELD1 in table BOTLIB has compressed file size. • Clone and schedule the same request and distribute in compressed PDF format to Report Library. • Check the file sizes. • View both reports from Report Library
Performance and TuningDemo: ReportCaster Compression • You can distribute the same report via EMAIL and use the ZIP option to minimize space allocation. • You can also ZIP and distribute Active Reports for your users and they can slice and dice that data without being connected. • We now have Active Reports in Connected mode but more details in another presentation that we will be doing.
Performance and TuningConclusion • Questions and Comments.