Upload
others
View
18
Download
0
Embed Size (px)
Citation preview
OPENMAMA AS A MIDDLEWARE STANDARD:
ENSURING USER CHOICE IN MESSAGING SYSTEMS
FEARGAL O’SULLIVAN – NYSE TECHNOLOGIES
The Linux Foundation Enterprise End User Summit
- April 30, 2012
Agenda
Introduction to NYSE Technologies
Message Oriented Middleware (MOM) Primer
OpenMAMA Overview
Use Case: Solace Systems
Use Case: NYSE Technologies Data Fabric
Summary
Q&A
2
3
The commercial technology arm of NYSE Euronext
Our mission is to
“reduce trading friction”
NYSE Technologies
3
Enabling a Global Market Place…
Frankfurt Toronto São Paulo Mahwah Basildon
Institutional Investors
Equities
Additional Venues
Broker-Dealers Derivatives
FX Systematic Traders
Fixed Income
Market Operators
ATSs / MTFs
Chicago Tokyo
4
4
Focus on the Liquidity Center
Platform As A Service (PAAS)
REAL-TIME MARKET DATA MANAGED TRANSACTIONS TICK HISTORY
Infrastructure As A Service (IAAS)
COMPUTE ON DEMAND PHYSICAL
COMPUTE ON DEMAND VIRTUAL
CO-LOCATION (MIS)
Systematic Traders Broker-Dealers
Institutional Investors
Market Operators
Reduce Costs, Gain Agility and Trade New Markets
5
What is Message Oriented Middleware?
• MOM provides a means for applications to send
information to each other, without establishing explicit
connections, and with little-to-no knowledge of each other
• Two common paradigms: publish/subscribe and queuing
• Topic based naming for routing of messages
• A messaging API is typically proprietary to its own
messaging service
6
Why Message Oriented Middleware?
7
Market Gateway
Feed Handler
Algo
Cache
Quote
Conflation Cache
Desktop Traders
M
o
n
i
t
o
r
i
n
g
Historical Tick
Capture
Trade
Custom FX Rates
Consolidated Feed
Market Gateway
Market Gateway
Algo Algo
The Alternative
8
Market Gateway
Feed Handler
Algo
Cache
Quote
Conflation Cache
Desktop Traders
M
o
n
i
t
o
r
i
n
g
Historical Tick
Capture
Trade
Custom FX Rates
Consolidated Feed
Market Gateway
Market Gateway
Algo Algo
Other Use Cases
High Performance Computing Job distribution
Service Oriented Architecture systems Decoupled ‘objects’
Scalable web database queries Multiple app servers to multiple databases
Transactional applications Multi-phase commits
9
What is OpenMAMA?
OpenMAMA is:
Open Middleware Agnostic Messaging API
Supports a variety of MOM platforms
A consistent abstraction layer
High performance
Open Source
Hosted by the Linux Foundation
Governed by a group of industry stakeholders
10
How does OpenMAMA ensure user
choice?
MamaCache SuperFeed Feed
Handler Feed
Handler Algo Cache Monitoring
Feed Handler
Feed Handler
Feed Handler
Informatica LBM
Let’s say you want to change your middleware to take advantage of new innovations…
LBM API
11
Developed by NYSE Technologies
Developed by Third Party Vendor
Open Source
MamaCache SuperFeed Feed
Handler Feed
Handler Algo Cache Monitoring
Feed Handler
Feed Handler
Feed Handler
TIBCO Rendezvous
Without OpenMAMA: • Each application needs to be written to a new API • Which is time consuming and expensive • And locks you into yet another vendor specific API
RV API
12
Developed by NYSE Technologies
Developed by Third Party Vendor
Open Source
How does OpenMAMA ensure user choice?
MamaCache
OpenMAMA
SuperFeed Feed
Handler Feed
Handler Algo Cache Monitoring
Feed Handler
Feed Handler
Feed Handler
Informatica LBM
Leveraging OpenMAMA: • OpenMAMA lets you code your apps once
13
Developed by NYSE Technologies
Developed by Third Party Vendor
Open Source
How does OpenMAMA ensure user choice?
Data Fabric 6
MamaCache
MultiVerb
RDMA LDMA TCP
OpenMAMA
SuperFeed Feed
Handler Feed
Handler Algo Cache Monitoring
Feed Handler
Feed Handler
Feed Handler
Leveraging OpenMAMA: • OpenMAMA lets you code your apps once • Easily upgrade your Middleware or Applications
Developed by NYSE Technologies
Developed by Third Party Vendor
Open Source
14
How does OpenMAMA ensure user choice?
Leveraging OpenMAMA: • OpenMAMA lets you code your apps once • Easily upgrade your Middleware or Applications • Support multiple middlewares with multiple applications
Data Fabric 6
MamaCache
TIBCO
Rendezvous
Avis
Mu
ltiV
erb
RD
MA
LD
MA
TC
P
OpenMAMA
Informatica LBM
SuperFeed Feed
Handler Feed
Handler Algo Cache Monitoring
Feed Handler
Feed Handler
Feed Handler
15
Developed by NYSE Technologies
Developed by Third Party Vendor
Open Source
How does OpenMAMA ensure user choice?
Data Fabric 6
MamaCache
T
IBC
O
Re
nd
ezvo
us
Avis
Mu
ltiV
erb
RD
MA
LD
MA
TC
P
OpenMAMA In
form
atica
L
BM
SuperFeed Feed
Handler Feed
Handler Algo Cache Monitoring
IBM
W
ebS
phe
reM
Q
So
lace
Syste
ms
AM
QP
Feed Handler
Feed Handler
Feed Handler
As an Open Solution OpenMAMA: • Enables anyone to write a middleware bridge • 3rd Party applications can support OpenMAMA out of the box • Applications and middleware become pluggable / interchangeable
16
Developed by NYSE Technologies
Developed by Third Party Vendor
Open Source
How does OpenMAMA ensure user choice?
Result is flexibility and user choice
OpenMAMA
Feed Handler
Algo
Conflation Cache
NYSE Technologies Data Fabric 6.0
Next Gen Cache
Desktop Traders
M
o
n
i
t
o
r
i
n
g
Historical Tick
Capture
Trade
Custom Feed
handler SuperFeed
Market Gateway
Market Gateway
Algo Algo
OpenMAMA TIBCO RV
OpenMAMA LBM
Feed Handler
MAMA Cache
NYSE Technologies Data Fabric 6.0
AMQP
NYSE Technologies Data Fabric 6.0
NYSE Technologies Data Fabric 6.0
Solace Systems
Market Gateway
AMQP
Quote Quote Quote Quote
Developed by NYSE Technologies
Developed by Third Party
Open Source
Ke
y
Who is on the Steering Committee today?
A Major NY based
Hedge Fund 18
How to participate in OpenMAMA?
Participation is open to any developer,
corporation or entity
Use OpenMAMA in your applications –
encourage standardized access to other
proprietary middleware systems
All industries are encouraged to join
Join the Steering Group, Technical Group or just
contribute new features and code
If you want to get involved or have questions please reach out through the OpenMAMA development
mailing list: [email protected]. Alternately if you are considering joining our
steering committee or want to learn more complete the application form or contact Mike Woster at
19
Presented by: Shawn McAllister
Use Case: Solace Systems
Solace Simplifies Real-Time Information Sharing
Hardware Datapath - Highest throughput, lowest latency
- Consolidation and low TCO with built-in virtualization
Unified Messaging Platform
- Any data, anywhere, any QoS, all with one system
Turnkey Appliance - “Rack and run” deployment speeds time to market
- Integrated HA, Management, Security, Monitoring
Within Datacenters
Across Datacenters Web and Mobile Apps
Across Datacenters Web and Mobile Apps
Typical Solace Use Cases
Across Industries
○ Enterprise Messaging / ESB
○ Mobile Application Communication Infrastructure
○ Distributed Data Synchronization
○ Collection/Routing of Sensor Readings
Solace as an OpenMAMA Transport
Why does Solace see value in
OpenMAMA?
Removes API lock-in and drives innovation to create best of breed
Reduces barriers for adoption of best of breed technologies
Mix & match 3rd party applications – feedhandlers, gateways, Tick DB, Entitlements AND messaging
Isolates custom apps from underlying transport technology – gateways, algos, OMS, desktops
Allows creation of hybrid transport infrastructures that remain uniform as viewed by applications
Potential for usage outside FSI especially in high performance applications
Trading Platform
Today’s Trading Platform
Many Messaging Systems & APIs
Gateway
Algo
Gateway
Messaging Exchanges
Client Orders
Middle/Back Office
Messaging
Market Data FH
Reference Data
Messaging Messaging
Market Data
Cache
Market Data
Entitlements
Tick Data
Capture
With OpenMAMA
Fewer Messaging Systems & APIs, More 3rd Party Apps
Gateway
Algo
Gateway
Messaging Exchanges
Client Orders
Middle/Back Office
Messaging
Market Data FH
Reference Data
Messaging Messaging
Market Data
Cache
Market Data
Entitlements
Tick Data
Capture
Trading Platform
OpenMAMA Enables:
Multiple Transports, Single API, Single Data Model
Peer-to-Peer over Infiniband or Ethernet
WAN
Feed Handlers
Cache Algos
DataFabric Transport
ULL
Solace Transport LAN/WAN
Algos
Tick DB
Entitlements
Cache
Conclusion
Open interface standards change the landscape by
reducing lock-in which promotes competition and
innovation
This is the value Solace sees in OpenMAMA
Presented by: Brian Doherty
Use Case: NYSE Technologies Data
Fabric
Data Fabric MultiVerb
30
• Hardware accelerated, kernel bypass, multicast messaging middleware
• Single-digit microsecond transport latency with scalable fan-out distribution
• No exotic components required – operates on industry standard hardware
Send once - network replicates packets
Publisher
Application
Data Fabric MultiVerb
Interrupt/Copy Boundary
Memory Region
Application
Data Fabric MultiVerb
HCA
Memory Region
Interrupt/Copy Boundary
Application
Data Fabric MultiVerb
HCA
Memory Region
Interrupt/Copy Boundary
Application
Data Fabric MultiVerb
HCA
Memory Region
Interrupt/Copy Boundary
Application
Data Fabric MultiVerb
HCA
Memory Region
Interrupt/Copy Boundary
InfiniBand / 10 Gigabit RoCE
HCA
MultiVerb Performance
Intel® CRT Datacenter
Test Details
• 300 servers equipped with dual Intel Westmere X5670s
• 1:1000 publisher-to-consumer application ratio
• Throughput set to 1 million, 200-byte messages per
second
31
Results • Average latency: 4.5 µs • 99.99% latency: 19 µs • Aggregate rate of 1 billion
messages per second over a 7 hour period
Open Platform
Open Platform
Open Platform
Open Platform
Feed Handler
Algo
Conflation Cache
NYSE Technologies Data Fabric 6.0
Next Gen Cache
Desktop Traders
Mo
nito
ring
Historical Tick
Capture
SDK built Feed
Handler
TickerPlant HD
Market Gateway
Market Gateway
Algo Algo
TIBCO RV
LBM
SuperFeed
MAMA Cache
NYSE Technologies Data Fabric 6.0
AMQP
NYSE Technologies Data Fabric 6.0
NYSE Technologies Data Fabric
NYSE Technologies Data Fabric
Market Gateway
NYSE Technologies Data Fabric
Developed by NYSE Technologies
Developed by Third Party
Open Source
Key
Smart Order Router
Solace Systems
32
Vendor neutral, standard messaging API
33
Existing pain points ▪ Market Data Growth
▪ Increasing complexity
▪ No standardization
▪ Vendor Specific API’s
▪ Costly and slow to Market
The Result • Eliminate vendor lock-in • Leverage best of breed technology • More flexibility and customer choice • Reduced TCO and time to market • Community contributions • Industry standardization
Industry standard data normalization model
Creating a Neutral, Open Platform
Enabling Flexibility and further standardization
Driving Product Innovation
OpenMAMA
Open Market Data
Model
Next
Generation Offerings
Feed Handler
SDK
Open Platform enabling the
Capital Markets
Community
Summary
NYSE Technologies contributed OpenMAMA to
encourage innovation and promote the Capital
Markets Community Platform
OpenMAMA simplifies the development and
deployment of applications that use Message
Oriented Middleware
It is hosted by The Linux Foundation under an LGPL
2.1 License
Widespread industry participation is highly
encouraged
34
Questions?
http://www.openmama.org