220 likes | 599 Views
Where are we now?. Still Performance Test SpecialistsStill do performance testingRisk-based approach is working wellOur processes are matureMore ?take up', earlier engagementHave become ?consultants' as well as ?testers'Now moved into a Systems Management TeamInvolved in establishing a Busine
E N D
1. Establishing an Application Performance Management Framework Philip Pooch
Performance Test Specialist
2. Where are we now? Still Performance Test Specialists
Still do performance testing
Risk-based approach is working well
Our processes are mature
More ‘take up’, earlier engagement
Have become ‘consultants’ as well as ‘testers’
Now moved into a Systems Management Team
Involved in establishing a Business Process Monitoring & Alerting service for critical business applications
3. Agenda Application Performance Management
A Definition
Core Elements
Our current progress and challenges
Removing artificial constraints
A way to proceed
Changing mindsets
Questions
4. Application Performance Management– a definition A business-centric approach
for measuring application performance with the objective of maintaining it
at a level that meets or exceeds
end-user expectations
5. Core elements of APM Performance Risk Analysis
Business Objectives & End-user Requirements
Governance (Planning, Process, Documentation)
Business Process Monitoring
Application Status Visualization
Real-time and Historical Data Analysis
Availability & Response Time Exception Handling
Alerting
Analysis/Diagnosis
Remediation
Reporting
6. Our Current Progress Critical Applications List
Implementation process documented
Monitoring & Alerting agreement for each application
Automated business processes for each application
Basic application status displayed on NOC dashboard
Monitoring data stored centrally and available via intranet
Exception Handling
Availability and Response time alerting on NOC display
Analysis/Diagnosis by App/Infra Support Areas
Remediation by App/Infra Support Areas
Automatic daily reports published to the intranet
7. Challenges Can become a ‘blame game’ in silo’ed application and infrastructure teams
Requirements and targets set by IT rather than the end-user
Resourcing and Application owner commitment
Script creation & maintenance an intensive ongoing process
Tool limitations, vendor-driven, fragmentation of toolsets
Product focus to the neglect of Process and People
Ownership of exception handling
Focus on changing the statistics rather than improving the customer experience
8. Removing Artificial Constraints
9. Removing Artificial Constraints
10. Removing Artificial Constraints
11. Business Process Automation
12. A Way to Proceed– Establish a Framework
13. A Way to Proceed (Production)- First ‘Function’ then ‘Toolset’
14. A Way to Proceed (Production)- First ‘Function’ then ‘Toolset’
15. A Way to Proceed (Production)- First ‘Function’ then ‘Toolset’
16. A Way to Proceed (Pre-Production)
17. A Way to Proceed Establish an APM team independent of IT App Owners, and IT Infrastructure Owners.
Provide a pre & post-production application performance measurement service.
Define clear service boundaries, roles & responsibilities.
Focus on Process & Function over Product.
Move accountability for hardware/tool software setup & maintenance to an Infrastructure Support group.
Determine constraints, and work within them, but keep the goal in mind.
18. Changing Mindsets- APM is: First about business outcomes - not technical solutions.
About Process & People - not just Product.
A specialist discipline that requires adequate resources.
First Strategic, then Operational.
About business disruption management – not component downtime.
About improving the customer experience – not an IT blame game.
Only going to work when the business value of establishing it is perceived.
19. Questions
Questions?
Contact:
Philip Pooch - Performance Test Specialist
Infrastructure Services
Suncorp IT
e-mail: philip.pooch@suncorp.com.au