Upload
doanthu
View
223
Download
8
Embed Size (px)
Citation preview
© 2008 Hewlett-Packard Development Company, L.P.The information contained herein is subject to change without notice
Grid for Financial ServicesOpenGridForum, Cambridge, Massachusetts USA27 February, 2008
Lee FisherHP Worldwide FSI-HPC Solutions & Alliances
3 2008
FSI-HPC Challenge in Capital Markets –faster is never fast enough!
Orders/Cancellations
Traders
Manual Trades
Charts/Ratios
Buy/Sell/Hedge
Order Execution
Updates
Analyze/Simulate/Decide
Analysis
Other MarketData
Ticker Data
Receive/Normalize/Distribute
Market Data
Match Buy/Sell Orders
Exchanges
4 2008
HP’s Grid Strategy• Develop mission critical HPC platforms for customer grids
− c-Class BladeSystem for improved power, cooling, management− Engineered Systems for ideal configuration & faster deployment− HP middleware (e.g. CMU) for efficient provisioning & monitoring
• Work best w/ Independent Software & Hardware Partners − Test/validate Grid middleware on HP – Platform, DataSynapse − Choice of accelerators certified on HP for speed boost
• Drive technology through HP Labs and HPC Engineering − Build expertise around low-latency InfiniBand and 10GbE− Data center smart cooling, Converged fabrics, Services delivery
• Offer Flexible Compute Service− Capacity on demand with flexible pricing to match business need
5 2008
New words; same challenges
2004 2005 2006 2007
What is the business model, the delivery model, the security model?What is the performance impact?What are the people and process issues?
6 2008
Grid/HPC for Financial Services1. Develop mission critical HPC platforms for
customer grids2. Work best with Independent Software &
Hardware Partners 3. Drive technology through HP Labs and HPC
Engineering 4. Offer Flexible Compute Service
7 2008
Grid evolves towards Next Generation Data Center
Fixed Income Line of BusinessEquity Line of Business
Commodities Line of Business
Fixed Income Line of Business
Equity Line of Business
Commodities Line of Business
Cluster SW Cluster SW Cluster SW
1 2Fixed Income Line of BusinessEquity Line of Business
Commodities Line of Business
Fixed Income Line of BusinessEquity Line of Business
Commodities Line of BusinessCommodities Line of Business
Fixed Income Line of Business
Equity Line of Business
Commodities Line of Business
Cluster SW Cluster SW Cluster SW
Fixed Income Line of Business
Equity Line of Business
Commodities Line of Business
Cluster SW Cluster SW Cluster SW
1 2Enterprise Grid Service
Equity Commodities Fixed IncomeFixed Income Line of Business
Equity Line of Business
Commodities Line of Business
Line of Business Grid Service
Compute Cycle Market:Commercial Grade Utility &
Scavenging
43Enterprise Grid Service
Equity Commodities Fixed Income
Enterprise Grid Service
Equity Commodities Fixed IncomeEquity Commodities Fixed IncomeFixed Income Line of Business
Equity Line of Business
Commodities Line of Business
Line of Business Grid Service
Fixed Income Line of Business
Equity Line of Business
Commodities Line of Business
Line of Business Grid Service
Compute Cycle Market:Commercial Grade Utility &
Scavenging
43
• Chargeback Model• Centralized Shared Services• Service Level Agreement• Federated Security• Meta-Scheduler • Time Zones• Administrative Hierarchy• Security Policy
• Standalone Clusters• Load Balancing in cluster• Admin Domain / cluster• Security domain / cluster• Fault Tolerant• Disaster Recovery
• Linked Clusters• Some Resource Sharing• Single Admin Domain • Multiple security domains
8 2008
Power, Space & Cooling• C-class blades
− HP Thermal Logic− Parallel Redundant Scaleable
Cooling Architecture
• HP Modular Cooling System− 30Kilowatts/rack
• Dynamic Smart Cooling Service− Up to 40% power savings− Liebert & STULZ
516 September 2007
From rack-mount to blade
BladeSystem AdvantagePower: 32% saving
Floor space: from 8 racks to 5 racks
Network cables: up to 78% less
And excellent manageability!
Example configuration:
256-node cluster
w/ InfiniBand
New metric for IT procurement: messages/watt
9 2008
HP Grid Infrastructure Management
• BladeSystems management tools−On-Board Administrator for enclosure management− Insight Control to provision, manage, recover blades
• HP’s CMU Cluster Management Utility−Scalable cluster management for Linux
• Standard operating system & open source tools• Emerging option: WindowsCCS
10 2008
Scaleable Data Management• High Speed File Systems−Scalable File Share (Lustre)−Enterprise File Services - Clustered Gateway
• Shared Cache Products−Tangosol−Gemstone−Gigaspace
• High performance File System cache−HP Labs
Client Client Client Client
SANFabric
LAN
HP Clustered Gateway Nodes
SAN Storage
Client Client Client Client
SANFabric
LAN
HP Clustered Gateway Nodes
Client Client Client Client
SANFabric
LAN
Client Client Client Client
SANFabric
LAN
HP Clustered Gateway Nodes
SAN Storage
11 2008
Grid/HPC for Financial Services1. Develop mission critical HPC platforms for
customer grids2. Work best with Independent Software &
Hardware Partners 3. Drive technology through HP Labs and HPC
Engineering 4. Offer Flexible Compute Service
12 2008
Grid Technology Stackfor Financial Services
Cluster Platforms
OS Extensions
Operating System
Scaleable Data Management
Grid Middleware(Resource Mgt, Scheduling, Memory Cache, …)
Grid Infrastructure Management
Grid-enabled Applications Dev/Test Portfolio
Data CenterUtility Computing
14 2008
Example Financial Service Partners using Grid Technology• Algorithmics: provider of enterprise risk management software• Calypso Technology Inc.: integrated processing solutions for financial institutions• Reuters (Kondor Risk Management)• Murex• Microsoft (Excel)• MathWorks (MATLAB)• Interactive SuperComputing (Star-P)• Sierra (GL Trade/FNX)• Misys (Summit)• MoSes (Tillinghast)• Adaptiv (Sungard)• Profit (Sungard)• Many batch components can be scheduled using grid software with minimal or no
change
15 2008
HP Hardware Accelerator Program• GPGPUs, FPGAs & acceleration cards promise tremendous
speed & density at low power consumption• The reality is more complicated
− Programming them is hard− Best for selected calculations− A niche, not a panacea
• HP strategy: enable accelerator choices in standard servers− Test goals – power/cooling? BIOS? Software? Validate claims− We expect accelerators to be adopted in niche applications
• general purpose computers to do most of the work for the foreseeable future
16 2008
Grid/HPC for Financial Services1. Develop mission critical HPC platforms for
customer grids2. Work best with Independent Software &
Hardware Partners 3. Drive technology through HP Labs and HPC
Engineering 4. Offer Flexible Compute Service
17 2008
HP Leadershipin Latency Benchmarking
See HP Reports at:www.STACresearch.com/hp
HP Contact:
Anne Ambrose
WW Director Brokerage Trading & Investment Mgmt
18 2008
Benchmarked: IB delivers on the low-latency capability of RMDS v6
Latency Profile up to 450K updates/secHP c‐Class with Voltaire Drivers in Traditional RMDS topology
0
0.2
0.4
0.6
0.8
1
1.2
1.4
‐ 50,000 100,000 150,000 200,000 250,000 300,000 350,000 400,000 450,000
Updates per Second
Mean latency (m
illisec)
All Ethernet IB with Ethernet from publisher to RMDS All IB
Benchmark: rfaconsumerperf client application
45% improvement with InfiniBand
Source: www.STACresearch.com/hpNovember, 2007
Message size: 74 bytes (RWF) At 300K updates, IB for RMDS reduces latency by 30%
and an all-IB infrastructure reduces latency by 45%
© 2008 Hewlett-Packard Development Company, L.P.The information contained herein is subject to change without notice
High-PerformanceEthernet-Based Communicationsfor Future Multi-Core Processors
Michael Schlansker, Erwin Oertli†, Richard J. Carter , Jayaram Mudigonda, Nathan Binkert, Norman Jouppi
Hewlett-Packard Labs - Advanced Architecture Lab
Nagabhushan Chitlur, Paul M. Stillwell Jr, Linda Rankin, Dennis BradfordIntel Corporation - Corporate Technology Group
(† currently with VmWare)
Presented at Supercomputing 2007 (11/07 Reno)
20 2008
JNIC: A Research Vision for In-Data-Center Communications
• JNIC (Joint Network Interface Controller) − Joint HP/Intel research project
• Low-cost NIC for high-performance networks− On-chip & small die area for compact glueless scaleout
• Hardware and Software for:− Future chip multi-processor− Converged fabric Ethernet
• Ethernet - the future killer fabric− Close-attached NICs within future commodity systems− Performance approaches expensive fabrics− Exploit commodity advances: switches, cables, optics
21 2008
Grid/HPC for Financial Services1. Develop mission critical HPC platforms for
customer grids2. Work best with Independent Software &
Hardware Partners 3. Drive technology through HP Labs and HPC
Engineering 4. Offer Flexible Compute Service
20082008 2222
loading OS
Nodesneededby the
workorder
Firewall
Quote &Res Sys
Mstr 0rch Process
Local 0rch Process
Pool of Available Nodes
Pool of Available Nodes
MOSInstall PostInstall VLANtoolCustomer A Customer A
Customer B Customer B
Customer C Customer C
Status
Customization
VLAN Modifications
Status Status
PI Work orderVLAN Work orderOS Work order
HP’s new install toolset can provision 128 servers in less than 30 minutes