automated capacity planning and support for enterprise applications n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Automated Capacity Planning and Support for Enterprise Applications PowerPoint Presentation
Download Presentation
Automated Capacity Planning and Support for Enterprise Applications

Loading in 2 Seconds...

play fullscreen
1 / 22

Automated Capacity Planning and Support for Enterprise Applications - PowerPoint PPT Presentation


  • 85 Views
  • Uploaded on

Automated Capacity Planning and Support for Enterprise Applications. Dharmesh Thakkar School of Computing, Queen’s University, Canada. Performance Activities in The Waterfall SDLC.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Automated Capacity Planning and Support for Enterprise Applications' - chrissy


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
automated capacity planning and support for enterprise applications

Automated Capacity Planning and Support for Enterprise Applications

Dharmesh Thakkar

School of Computing, Queen’s University, Canada

performance activities in the waterfall sdlc
Performance Activitiesin The Waterfall SDLC

Verification: Performance test need to be conducted to verify that the required performance objectives are met

performance activities in sdlc
Performance Activitiesin SDLC

Maintenance: Continuous monitoring, capacity planning and tuning need to be done to ensure that the system continues to meet the performance objectives

overview of thesis
Overview of Thesis

Challenge: The goal of performance testing is not to find bugs, but to establish benchmarks

Build a capacity calculator based on the performance model

Challenge: Load test and stress test workloads need to be compared against the customer workloads

Modify the workload or the deployment scenario to put excessive stress on one or more system resources

The capacity calculator helps customer determine required hardware resources to support the anticipated workload

Run the application for long periods under high workloads

  • Customers engage the vendor’s support analyst to resolve the issues with system
  • Challenge: The support analyst needs to troubleshoot the customer deployment
  • Performance issues arise in customers’ production environment, which need troubleshooting
overview of thesis our contributions
Overview of Thesis:Our Contributions

A framework for building performance model based capacity calculator

Presented at the Workshop on Software and Performance (WoSP 2008) Princeton, NJ.

Acceptance rate: 38%

A technique for helping troubleshoot performance issues by retrieving relevant report from a customer engagement repository

Presented at the International Conference on Software Maintenance (ICSM 2008) Beijing, China.

Acceptance rate: 26%

performance modeling challenges
Performance Modeling Challenges
  • Large number of tests to be executed
  • Limited time for performance modeling
  • Manual process of setup, execution and analysis
  • Risk of error and repeating the full modeling process
addressing the challenges of performance modeling
Addressing the Challenges of Performance Modeling
  • We created the framework to:
    • Automate the process
    • Speed up the process
    • Focus research on specific areas
framework for building model based capacity calculator
Framework for Building Model based Capacity Calculator
  • Case Studies:
    • Dell DVD Store
    • A large enterprise application
retrieving relevant reports
Retrieving Relevant Reports
  • State of Practice:
    • No systematic techniques to retrieve and use information for future engagements
    • Keyword searching is limited:
      • depends on the search skills and experience of the analyst and peculiarity of the problem
customer support problem statement
Customer SupportProblem Statement
  • We want to find customers with similar operational and problem profiles
  • We can reuse prior solutions and knowledge

Other Customers

  • Heavy Email, Light Web, Light calendar
  • Light Email, Light Web, Light calendar
  • Light Email, Heavy Web, Light calendar
  • Heavy Email, Heavy Web, No calendar
  • Light Email, Light Web, Heavy calendar

New Customer Engagement

Compare

using logs for customer support
Using Logs forCustomer Support
  • Execution logs are readily available and contain
    • Operational Profile: usage patterns (heavy users of email from device, or to device, or light users of calendar, etc.)
    • Signature Profile: specific error line patterns (connection timeout, database limits, messages queued up, etc.)
  • Find the most similar profile
execution logs
Execution Logs
  • Contain time-stamped sequence ofevents at runtime
  • Readily available representatives of both feature executions and problems

<time> Queuing new mail msgid=ABC threadid=XYZ<time> Instant message. Sending packet to client msgid=ABC threadid=XYZ<time> New meeting request msgid=ABC threadid=XYZ<time> Client established IMAP session emailid=ABC threadid=XYZ<time> Client disconnected. Cannot deliver msgid=ABC threadid=XYZ<time> New contact in address book emailid=ABC threadid=XYZ<time> User initiated appointment deletion emailid=ABC threadid=XYZ

example
Example

Other Customers

Compare

case studies
Case Studies
  • Case Study I
    • Dell DVD Store open source application
    • Code instrumentation done for event logging
    • Built the execution log repository by applying synthetic workloads, changing the workload parameters each time
  • Case Study II
    • Globally deployed commercial application
    • More than 500 unique execution events
case study results
Case Study Results
  • Dell DVD Store
    • 100% precision and recall on both operational profile based and signature profile based retrieval
  • Commercial Application
    • 100% precision and recall for signature profile based retrieval
    • Results for operational profile based retrieval:
sources of errors
Sources of Errors
  • Events that do not correspond directly to a particular operational feature, such as idle time events, server health check events, startup and shutdown events
  • Imbalance in the event logging
summary our contributions
Summary:Our Contributions

A framework for building performance model based capacity calculator

Presented at the Workshop on Software and Performance (WoSP 2008) Princeton, NJ.

A technique for helping troubleshoot performance issues by retrieving relevant report from a customer engagement repository

Presented at the International Conference on Software Maintenance (ICSM 2008) Beijing, China.