Atropos latency diagnostics tool
This presentation is the property of its rightful owner.
Sponsored Links
1 / 38

Atropos Latency Diagnostics Tool PowerPoint PPT Presentation


  • 43 Views
  • Uploaded on
  • Presentation posted in: General

Atropos Latency Diagnostics Tool. COMP 415, Spring 2008. Table of Contents. Problem Formulation Solution Features Solution Architecture Major Systems Project Timeline Conclusion. Problem Formulation. Problem Formulation Solution Features Solution Architecture Major Systems

Download Presentation

Atropos Latency Diagnostics Tool

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


AtroposLatency Diagnostics Tool

COMP 415, Spring 2008


Table of Contents

  • Problem Formulation

  • Solution Features

  • Solution Architecture

  • Major Systems

  • Project Timeline

  • Conclusion


Problem Formulation

Problem Formulation

Solution Features

Solution Architecture

Major Systems

Project Timeline

Conclusion


Problem Formulation

  • Messages Take Time To Travel Across a Network

  • How Can We Find Bottlenecks?

  • When Should We Cancel a Message?


Problem Formulation | basic Solution

  • Catch Messages

  • Correlate

  • Store Associations

  • Retrieve Latencies

  • Display System Map


Solution Features

Problem Formulation

Solution Features

Solution Architecture

Major Systems

Project Timeline

Conclusion


Solution Features

  • Relocate-Ready Components

  • Process Abstraction

  • Encapsulated Optimization Points

  • Variable Correlation

  • Multiple Visualizations


Solution Architecture

Problem Formulation

Solution Features

Solution Architecture

Major Systems

Project Timeline

Conclusion


Solution Architecture

  • Data Flow

  • Scalability

  • Data Recipient

  • Correlation Engine


JPM Service

Controller

Database

Manipulation

View Client

Data Flow Diagram


Data Mining

Correlation

Database

Scalability Diagram


Possibilities

Parsing

API Calls

Batching

Destinations

Data Recipient Diagram


Data Reader

Data Writer

Correlation Engine Diagram


Major Systems

Problem Formulation

Solution Features

Solution Architecture

Major Systems

Project Timeline

Conclusion


Major Systems

  • Correlation

  • Messaging

  • View


Correlation

  • A correlation engine holds sets of messages and performs matching between the sets.

Correlation Engine

Input Messages

Server Log

Data Reader

Output Messages

Association

Store

Correlation Rules

Input Messages

Server Log

Data Reader

Output Messages


Association Graph

Server B

  • Xml Configuration File

    • Stores configuration of association graph

    • Information about correlation rules to use

    • Formats of data logs

In

Out

Server A

In

Out

Server C

In

Out


Design Choices

  • In-memory correlation

    • Correlation Rules can create their own data structures to expedite their matching

  • Sliding Time Window

  • Features

    • Scalability

    • Flexibility

    • Efficiency


Messaging

  • Components not colocated

  • Ensure recoverability

  • Handle large volumes of data


View

  • Eclipse RCP framework

  • External graphing package

  • Wireframes


View | Eclipse RCP Framework

  • Integration with JPMorganChase

  • Modular design

  • Standardized system


View | External Graphing Package


Multiple Server View

View | Wireframes


Single Server View

View | Wireframes


Project Timeline

Problem Formulation

Solution Features

Solution Architecture

Major Systems

Project Timeline

Conclusion


Project Timeline

  • Five Phases

    • Phase 1: Due February 1st

    • Phase 2: Due February 15th

    • Phase 3: Due March 1st

    • Phase 4: Due April 1st

    • Phase 5: Due May 1st

  • Front-Loaded

  • Early Integration


Project Timeline

  • Phase I

  • Full Interface Skeleton

  • Stub Modules

  • Admin API (Control)

  • AddMessageAPI

  • Correlation (Default Rules)

  • View Path Latency

  • Phase II

  • Phase III

  • Phase IV

  • Phase V


Project Timeline

  • Phase I

  • Phase II

  • Phase III

  • Phase IV

  • Phase V


Project Timeline

  • Phase I

  • Admin Client (Control)

  • Correlation (Arbitrary)

  • Message Batching

  • Message Datastore

  • Association Datastore

  • Real-Time View

  • Phase II

  • Phase III

  • Phase IV

  • Phase V


Project Timeline

  • Phase I

  • Phase II

  • Phase III

  • Phase IV

  • Phase V


Project Timeline

  • Phase I

  • Engine Scheduling

  • Correlation Strength

  • Data Client Admin API

  • Graph Node Datastore

  • View Graph Latency

  • Phase II

  • Phase III

  • Phase IV

  • Phase V


Project Timeline

  • Phase I

  • Phase II

  • Phase III

  • Phase IV

  • Phase V


Project Timeline

  • Phase I

  • Zero & Many Correlation

  • Parsing Module

  • Single Message View

  • Phase II

  • Phase III

  • Phase IV

  • Phase V


Project Timeline

  • Phase I

  • Phase II

  • Phase III

  • Phase IV

  • Phase V


Project Timeline

  • Phase I

  • Re-Correlation

  • Recoverability Control

  • Path Datastore

  • Collapse Nodes (View)

  • Phase II

  • Phase III

  • Phase IV

  • Phase V


Conclusion

Problem Formulation

Solution Features

Solution Architecture

Major Systems

Project Timeline

Conclusion


Conclusion

  • What to Solve

  • How to Solve It

    • Architecture

    • Concepts

  • When to Solve It


AtroposCut through the tangled web…

Thank You For Listening!


  • Login