Upload
ing-it
View
594
Download
1
Embed Size (px)
Citation preview
There and back again, ING’s Cassandra Tale
Datastax Summit 2016
Gary Stewart, @Gaz_GandAChristopher Reedijk, @creedijk
London, April 19, 2016
Market leaders Benelux
Growth markets
Commercial Banking
Challengers
2
European map
Full-service bankVery strong European baseIT is something ING doesLargest bank of NL150+ Squads20+ use cases in production
Engineer / Architect Engineer / Chapter Lead
3
a little bit about us
Gary Stewart Christopher Reedijk
#DataStaxSummit
4
the contract … #DataStaxSummit
5
an unexpected party #DataStaxSummit
De
vO
ps
En
gin
ee
rs
Ma
na
ge
rs
Infr
a E
ng
ine
ers
6
an unexpected journey #DataStaxSummit
Financial Fit
7
#DataStaxSummit
the trolls of data modeling
8
#DataStaxSummit
Think about the queries first!
Sometimes storing JSON in text is best
saved by …
9
#DataStaxSummit
Lonely Planet
10
#DataStaxSummit
11
the goblins of data querying #DataStaxSummit
Don’t do table scans
Think about Read pathi.e. avoid increasing sequential reads as data grows
Do performance tests even for small use-cases!
12
saved by … #DataStaxSummit
iDeal
13
#DataStaxSummit
14
the riddles of Gollum #DataStaxSummit
What could go wrong this time ….
NTP killed the happy flowCustomers couldn’t go to next page
the riddles of time
15
#DataStaxSummit
NTP killed the happy flowCustomers couldn’t go to next page
Versioning to the rescue
saved by …
16
#DataStaxSummit
Experiments API
17
#DataStaxSummit
Aggressive distributedRead-after-Write, causing read-repair-blocking
18
the spiders of 99 percentile #DataStaxSummit
Be careful with read-after-write
Always check the functionality of the framework you’re using
19
saved by … #DataStaxSummit
Cached Data
20
#DataStaxSummit
SizeTieredCompactionStrategy
Default, compact after 4 sstables
20GB data needs 100GB+ storage
the loss of storage
21
SST1 SST1 SST2 SST1 SST2 SST3 SST1 SST2 SST3 SST4 SST5
FLUSHFLUSH
FLUSH FLUSH
COMPACT
#DataStaxSummit
Data space required is now around 50% less!
Attention to details can save i/o and disk space
saved by …
22
SST1 SST1 SST2 SST3
FLUSHFLUSH
COMPACT
#DataStaxSummit
Fraud Investigation
23
#DataStaxSummit
Bad performance and nodes dying constantly
Network and GC issuesHinted handoffs going crazyVery long GC-pauses causing nodes to freeze
Never ending compactions
24
the wood elves of network #DataStaxSummit
Take a step back
Upgraded to 4.8.5with G1GC (default when using Java 8)4.7.3 is way too chatty
Increased heap and new to 16GB and 8GB
for coordinator nodes, which in our case are all
25
saved by … #DataStaxSummit
Incoming Traffic
26
the desolation of smaug #DataStaxSummit
Think top-down – queries first
Talk about failuresExperimentation – SandboxEnvironment that is safe to fail
Take a step backunderstand the architecture
flow of dataensure you are understanding the problem
27
desolated by … #DataStaxSummit
28
the battle of 5 armies #DataStaxSummit
29
the battle of 5 armies #DataStaxSummit
Infr
a E
ng
ine
ers
De
vO
ps
En
gin
ee
rs
Arc
hit
ect
s
???
Ma
na
ge
rs
Each time we ventured out therewith new insights ready to take on new epic challenges
And each time we came backBit bruised but never broken More willing to shareAnd rolled out into PRD
30
there and back … #DataStaxSummit
again and again and again …
31
#DataStaxSummit
Thank you
[email protected]@creedijk
[email protected]@Gaz_GandA
visuals by Isabelle Hörl:www.isabellehorl.com | @IsabelleHorl
we are hiring!
Follow us to stay a step ahead
ING.com
YouTube.com/ING
SlideShare.net/ING@ING_News LinkedIn.com/company/ING
Flickr.com/INGGroupFacebook.com/ING
ING Group’s Annual Accounts are prepared in accordance with International Financial Reporting Standards as adopted by the European Union (‘IFRS-EU’).
In preparing the financial information in this document, the same accounting principles are applied as in the 2014 ING Group Annual Accounts. All figures in this document are unaudited. Small differences are possible in the tables due to rounding.
Certain of the statements contained herein are not historical facts, including, without limitation, certain statements made of future expectations and other forward-looking statements that are based on management’s current views and assumptions and involve known and unknown risks and uncertainties that could cause actual results, performance or events to differ materially from those expressed or implied in such statements. Actual results, performance or events may differ materially from those in such statements due to, without limitation: (1) changes in general economic conditions, in particular economic conditions in ING’s core markets, (2) changes in performance of financial markets, including developing markets, (3) consequences of a potential (partial) break-up of the euro, (4) the implementation of ING’s restructuring plan to separate banking and insurance operations, (5) changes in the availability of, and costs associated with, sources of liquidity such as interbank funding, as well as conditions in the credit markets generally, including changes in borrower and counterparty creditworthiness, (6) the frequency and severity of insured loss events, (7) changes affecting mortality and
morbidity levels and trends,(8) changes affecting persistency levels, (9) changes affecting interest rate levels, (10) changes affecting currency exchange rates, (11) changes in investor, customer and policyholder behaviour, (12) changes in general competitive factors, (13) changes in laws and regulations, (14) changes in the policies of governments and/or regulatory authorities, (15) conclusions with regard to purchase accounting assumptions and methodologies, (16) changes in ownership that could affect the future availability to us of net operating loss, net capital and built-in loss carry forwards, (17) changes in credit ratings, (18) ING’s ability to achieve projected operational synergies and (19) the other risks and uncertainties detailed in the Risk Factors section contained in the most recent annual report of ING Groep N.V. Any forward-looking statements made by or on behalf of ING speak only as of the date they are made, and, ING assumes no obligation to publicly update or revise any forward-looking statements, whether as a result of new information or for any other reason.
This document does not constitute an offer to sell, or a solicitation of an offer to purchase, any securities in the United States or any other jurisdiction. The securities of NN Group have not been and will not be registered under the U.S. Securities Act of 1933, as amended (the “Securities Act”), and may not be offered or sold within the United States absent registration or an applicable exemption from the registration requirements of the Securities Act.
www.ing.com
Disclaimer
34