Embed Size (px)
Citation preview
DataStax EnterpriseField Notes: DSE in PracticeCaroline [email protected]
Company Confidential© 2016 DataStax, All Rights Reserved.
What are all the other banks doing?
What do you mean SSDs?
What’s the difference with [MongoDB]?
How many nodes will I need?
How do I load data from [Oracle]?
What are all the other banks doing?
DSE
Company Confidential© 2016 DataStax, All Rights Reserved.
About Me
Company Confidential© 2016 DataStax, All Rights Reserved.
Global Merchants Transactions
Use Case• 100TB of credit card charges
• Move to distributed REST Web Services
• Migrate off mainframe / DB2
• Reduce cost
Why DSE
• 100% up time• Scalability as business grows
Company Confidential© 2016 DataStax, All Rights Reserved.
Challenge #1: Hardware
1. Private Cloud• 4-core CPU• 16 GB RAM• 600 GB Attached SAN
2. AWS• i2.2xlarge• 8-core CPU• 64 GB RAM• 2 x 800 GB SSDs
3. Final Hardware• Cisco C240• 12-core CPU• 64 GB RAM• 8 x 400 GB SSDs
Company Confidential© 2016 DataStax, All Rights Reserved.
Challenge #2: Data ModelQueries
• Credit card charges for a merchant for a date range• Credit card charges details equal to a specific amount for a merchant • Credit card charges by charge reference number
Approach2-step Look up
Company Confidential© 2016 DataStax, All Rights Reserved.
Global Payments
Use Case
• Replace dependency on Exadata
• Ingestion of payment data at a rate > 5,000 tps
• Support schema evolution
Why DSE
• No down time
• Projected growth: 100TB
• Scalability as data retention increases
Company Confidential© 2016 DataStax, All Rights Reserved.
Challenge #1: Data Model
Queries• Payments by status [for a date range]• Payments by credit value date• Payments by payment ID• Payments by currency• Payments by region• Completed payments• Cancelled payments• Processed payments…
Approach1. DSE Search
2. Partition by time bucket wide partitions cfstats
Company Confidential© 2016 DataStax, All Rights Reserved.
Global Billing
• Move off Oracle Coherence
Why DSE
• Scale to bring B2B customers onboard
Use Case
• Aggregate usage data in 15 min intervals
• 3 million records every 15 mins
• Send alerts if customer exceeds thresholds
Company Confidential© 2016 DataStax, All Rights Reserved.
Workflow
Company Confidential© 2016 DataStax, All Rights Reserved.
Challenge #1: New Technologies
Technologies
Approach1.http://academy.datastax.com2.Onsite training3.Consulting4.Github
Company Confidential© 2016 DataStax, All Rights Reserved.
Global Customer 360
Use Case• Scale as they bring more
data points onboard• Centralized repo of customer activity
Why DSE
• Fast ingestion rate• Better customer interaction
• 22 million clients / 2,400 branches / 4,700 ATMs
• Personalization
Company Confidential© 2016 DataStax, All Rights Reserved.
Architecture
● New account on-boarding ● Recommendation/
personalization ● Omnichannel● Cross-selling● Fraud detection● Single source of truth
● Cloud applications● Web services● Microservices● Mobile● Lambda architecture
Analytics
Operational
Search
Company Confidential© 2016 DataStax, All Rights Reserved.
Challenge #1: Internal Politics
Politics• Infrastructure• Onboarding new technology• Coordinating across business lines• Budget
Approach• Involve Infrastructure/Security/DBAs early• COE
Company Confidential© 2016 DataStax, All Rights Reserved.
Who else?
15
