Atropos Latency Diagnostics Tool

AtroposLATENCY DIAGNOSTICS TOOLCOMP 415, Spring 2008

TABLE OF CONTENTS

1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion

PROBLEM FORMULATION1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion

PROBLEM FORMULATION

Messages Take Time To Travel Across a Network

How Can We Find Bottlenecks? When Should We Cancel a

Message?

PROBLEM FORMULATION | BASIC SOLUTION

Catch Messages Correlate Store Associations Retrieve Latencies Display System Map

SOLUTION FEATURES1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion

SOLUTION FEATURES

Relocate-Ready Components Process Abstraction Encapsulated Optimization Points Variable Correlation Multiple Visualizations

SOLUTION ARCHITECTURE1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion

SOLUTION ARCHITECTURE

Data Flow Scalability Data Recipient Correlation Engine

DATA FLOW

DIAGRAM

o JPM Service

o Controller

o Database

o Manipulation

o View Client

SCALABILITY DIAGRAM

o Data Mining

o Correlation

o Database

DATA RECIPIENT DIAGRAM

o Possibilitieso Parsingo API Calls

o Batching

o Destinations

CORRELATIO

N EN

GINE

DIAGRAM

o Data Reader

o Data Writer

MAJOR SYSTEMS1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion

MAJOR SYSTEMS

Correlation Messaging View

Correlation Engine

CORRELATION A correlation engine holds sets of messages and

performs matching between the sets.

Data Reader

Input Messages

Output Messages

Server Log

Data Reader

Input Messages

Output Messages

Server Log

Correlation Rules

AssociationStore

ASSOCIATION GRAPH

Xml Configuration File Stores configuration of association graph Information about correlation rules to use Formats of data logs

Server A

Server B

Server C

In Out

In Out

In Out

DESIGN CHOICES In-memory correlation

Correlation Rules can create their own data structures to expedite their matching

Sliding Time Window Features

Scalability Flexibility Efficiency

MESSAGING

Components not colocated Ensure recoverability Handle large volumes of data

VIEW

Eclipse RCP framework External graphing package Wireframes

VIEW | ECLIPSE RCP FRAMEWORK

Integration with JPMorganChase Modular design Standardized system

VIEW | EXTERNAL GRAPHING PACKAGE

VIEW | W

IREFR

AMES

MULTIPLE SERVER VIEW

VIEW | W

IREFR

AMES

SINGLE SERVER VIEW

PROJECT TIMELINE1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion

PROJECT TIMELINE

Five Phases Phase 1: Due February 1st

Phase 2: Due February 15th Phase 3: Due March 1st

Phase 4: Due April 1st

Phase 5: Due May 1st

Front-Loaded Early Integration

PROJECT TIMELINE

Full Interface Skeleton Stub Modules Admin API (Control) AddMessage API Correlation (Default Rules) View Path Latency

Phase I

Phase IIPhase IIIPhase IVPhase V

PROJECT TIMELINE

Phase I

Phase IIPhase IIIPhase IVPhase V

PROJECT TIMELINE

Admin Client (Control) Correlation (Arbitrary) Message Batching Message Datastore Association Datastore Real-Time View

Phase IPhase II

Phase IIIPhase IVPhase V

PROJECT TIMELINE

Phase IPhase II

Phase IIIPhase IVPhase V

PROJECT TIMELINE

Engine Scheduling Correlation Strength Data Client Admin API Graph Node Datastore View Graph Latency

Phase IPhase IIPhase III

Phase IVPhase V

PROJECT TIMELINE

Phase IPhase IIPhase III

Phase IVPhase V

PROJECT TIMELINE

Zero & Many Correlation Parsing Module Single Message View

Phase IPhase IIPhase IIIPhase IV

Phase V

PROJECT TIMELINE

Phase IPhase IIPhase IIIPhase IV

Phase V

PROJECT TIMELINE

Re-Correlation Recoverability Control Path Datastore Collapse Nodes (View)

Phase IPhase IIPhase IIIPhase IVPhase V

CONCLUSION1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion

CONCLUSION

What to Solve How to Solve It

ArchitectureConcepts

When to Solve It

AtroposCUT THROUGH THE TANGLED WEB…

Thank You For Listening!