Atropos latency diagnostics tool
This presentation is the property of its rightful owner.
Sponsored Links
1 / 38

Atropos Latency Diagnostics Tool PowerPoint PPT Presentation


  • 40 Views
  • Uploaded on
  • Presentation posted in: General

Atropos Latency Diagnostics Tool. COMP 415, Spring 2008. Table of Contents. Problem Formulation Solution Features Solution Architecture Major Systems Project Timeline Conclusion. Problem Formulation. Problem Formulation Solution Features Solution Architecture Major Systems

Download Presentation

Atropos Latency Diagnostics Tool

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Atropos latency diagnostics tool

AtroposLatency Diagnostics Tool

COMP 415, Spring 2008


Table of contents

Table of Contents

  • Problem Formulation

  • Solution Features

  • Solution Architecture

  • Major Systems

  • Project Timeline

  • Conclusion


Problem formulation

Problem Formulation

Problem Formulation

Solution Features

Solution Architecture

Major Systems

Project Timeline

Conclusion


Problem formulation1

Problem Formulation

  • Messages Take Time To Travel Across a Network

  • How Can We Find Bottlenecks?

  • When Should We Cancel a Message?


Problem formulation basic solution

Problem Formulation | basic Solution

  • Catch Messages

  • Correlate

  • Store Associations

  • Retrieve Latencies

  • Display System Map


Solution features

Solution Features

Problem Formulation

Solution Features

Solution Architecture

Major Systems

Project Timeline

Conclusion


Solution features1

Solution Features

  • Relocate-Ready Components

  • Process Abstraction

  • Encapsulated Optimization Points

  • Variable Correlation

  • Multiple Visualizations


Solution architecture

Solution Architecture

Problem Formulation

Solution Features

Solution Architecture

Major Systems

Project Timeline

Conclusion


Solution architecture1

Solution Architecture

  • Data Flow

  • Scalability

  • Data Recipient

  • Correlation Engine


Data flow diagram

JPM Service

Controller

Database

Manipulation

View Client

Data Flow Diagram


Scalability diagram

Data Mining

Correlation

Database

Scalability Diagram


Data recipient diagram

Possibilities

Parsing

API Calls

Batching

Destinations

Data Recipient Diagram


Correlation engine diagram

Data Reader

Data Writer

Correlation Engine Diagram


Major systems

Major Systems

Problem Formulation

Solution Features

Solution Architecture

Major Systems

Project Timeline

Conclusion


Major systems1

Major Systems

  • Correlation

  • Messaging

  • View


Correlation

Correlation

  • A correlation engine holds sets of messages and performs matching between the sets.

Correlation Engine

Input Messages

Server Log

Data Reader

Output Messages

Association

Store

Correlation Rules

Input Messages

Server Log

Data Reader

Output Messages


Association graph

Association Graph

Server B

  • Xml Configuration File

    • Stores configuration of association graph

    • Information about correlation rules to use

    • Formats of data logs

In

Out

Server A

In

Out

Server C

In

Out


Design choices

Design Choices

  • In-memory correlation

    • Correlation Rules can create their own data structures to expedite their matching

  • Sliding Time Window

  • Features

    • Scalability

    • Flexibility

    • Efficiency


Messaging

Messaging

  • Components not colocated

  • Ensure recoverability

  • Handle large volumes of data


Atropos latency diagnostics tool

View

  • Eclipse RCP framework

  • External graphing package

  • Wireframes


View eclipse rcp framework

View | Eclipse RCP Framework

  • Integration with JPMorganChase

  • Modular design

  • Standardized system


View external graphing package

View | External Graphing Package


View wireframes

Multiple Server View

View | Wireframes


View wireframes1

Single Server View

View | Wireframes


Project timeline

Project Timeline

Problem Formulation

Solution Features

Solution Architecture

Major Systems

Project Timeline

Conclusion


Project timeline1

Project Timeline

  • Five Phases

    • Phase 1: Due February 1st

    • Phase 2: Due February 15th

    • Phase 3: Due March 1st

    • Phase 4: Due April 1st

    • Phase 5: Due May 1st

  • Front-Loaded

  • Early Integration


Project timeline2

Project Timeline

  • Phase I

  • Full Interface Skeleton

  • Stub Modules

  • Admin API (Control)

  • AddMessageAPI

  • Correlation (Default Rules)

  • View Path Latency

  • Phase II

  • Phase III

  • Phase IV

  • Phase V


Project timeline3

Project Timeline

  • Phase I

  • Phase II

  • Phase III

  • Phase IV

  • Phase V


Project timeline4

Project Timeline

  • Phase I

  • Admin Client (Control)

  • Correlation (Arbitrary)

  • Message Batching

  • Message Datastore

  • Association Datastore

  • Real-Time View

  • Phase II

  • Phase III

  • Phase IV

  • Phase V


Project timeline5

Project Timeline

  • Phase I

  • Phase II

  • Phase III

  • Phase IV

  • Phase V


Project timeline6

Project Timeline

  • Phase I

  • Engine Scheduling

  • Correlation Strength

  • Data Client Admin API

  • Graph Node Datastore

  • View Graph Latency

  • Phase II

  • Phase III

  • Phase IV

  • Phase V


Project timeline7

Project Timeline

  • Phase I

  • Phase II

  • Phase III

  • Phase IV

  • Phase V


Project timeline8

Project Timeline

  • Phase I

  • Zero & Many Correlation

  • Parsing Module

  • Single Message View

  • Phase II

  • Phase III

  • Phase IV

  • Phase V


Project timeline9

Project Timeline

  • Phase I

  • Phase II

  • Phase III

  • Phase IV

  • Phase V


Project timeline10

Project Timeline

  • Phase I

  • Re-Correlation

  • Recoverability Control

  • Path Datastore

  • Collapse Nodes (View)

  • Phase II

  • Phase III

  • Phase IV

  • Phase V


Conclusion

Conclusion

Problem Formulation

Solution Features

Solution Architecture

Major Systems

Project Timeline

Conclusion


Conclusion1

Conclusion

  • What to Solve

  • How to Solve It

    • Architecture

    • Concepts

  • When to Solve It


Atropos cut through the tangled web

AtroposCut through the tangled web…

Thank You For Listening!


  • Login