37

Webperfdays2014 movistar tv

Embed Size (px)

Citation preview

Page 1: Webperfdays2014 movistar tv
Page 2: Webperfdays2014 movistar tv

Who are we?

Almudena Vivanco (@MrsDaehin)

From .net developer to tester. 10 years

of experience as performance engineer.

Now working in Telefónica I+D as

“Performance Jedi”.

Active member of the web performance

community in Barcelona.

Gaming, Music and Maths are my

passion

My motto: Games don’t cause violence,

Lag does!

Page 3: Webperfdays2014 movistar tv

Guide to survive a World Wide Event

Page 4: Webperfdays2014 movistar tv

The Challenge

Build the best Video Platform to help Telefonica to become a

Video Company

Page 5: Webperfdays2014 movistar tv

The golden rule

• PASSION - If it was OK, they will be back

• DON’T MISS THE TARGET – The audience go away

• WILL START WITHOUT YOU - The soccer game will start at the date/time

The Golden Rule

Page 6: Webperfdays2014 movistar tv

The Users

Page 7: Webperfdays2014 movistar tv

The Passion

Page 8: Webperfdays2014 movistar tv

- Do you know what

you are missing?

- Know how to act?

- Have the relevant

info?

Don’t miss the target

Page 9: Webperfdays2014 movistar tv

The Behaviour

Page 10: Webperfdays2014 movistar tv

The Team

Page 11: Webperfdays2014 movistar tv

Our Goal

Page 12: Webperfdays2014 movistar tv

Scalability

Page 13: Webperfdays2014 movistar tv

Spain - Brazil- Argentina

Page 14: Webperfdays2014 movistar tv

Many Devices

And MANY more ….

Page 15: Webperfdays2014 movistar tv

The Jungle

Page 16: Webperfdays2014 movistar tv

Change of Strategy

Page 17: Webperfdays2014 movistar tv

Global Video Platform Squads

Page 18: Webperfdays2014 movistar tv

Continuous ... wait ... what?

Automated Tests in .NET

PREPROD Environment

Stable Environment

Page 19: Webperfdays2014 movistar tv

Front End Engineering

WHO Ops Networking,

Performance and Security Eng.

WHAT Avalanche Control

Concurrent Session Control

HOW Firewall Policies, Smart

Probes, MongoDB

Page 20: Webperfdays2014 movistar tv

MongoDB Issues

Page 21: Webperfdays2014 movistar tv

NAS issues

Page 22: Webperfdays2014 movistar tv

Performance

Load Analysis

and Simulation

Cache, DB Tuning

Scalability, Resilience

Page 23: Webperfdays2014 movistar tv

Deployment

Page 24: Webperfdays2014 movistar tv

Stable Testing Environment

Page 25: Webperfdays2014 movistar tv

Latency

Page 26: Webperfdays2014 movistar tv

In House CDN

Page 27: Webperfdays2014 movistar tv

GraphiteAudience

Web Servers (FE/API)

Cache Layer

Databases

Virtualization

Storage (SAN/NAS)

Networking

Don’t miss the target

Page 28: Webperfdays2014 movistar tv

Old Approach New Approach

• Monitoring resolution 5 minutes

• 11 tools to monitor performance

• Monitoring resolution 15 seconds

• Centralized in 1 tool to monitor performance

Don’t miss the target

Page 29: Webperfdays2014 movistar tv

2nd half begins

match begins

1st half ends 2nd half

ends

Introducing: The Soccer Game

Don’t miss the target

Page 30: Webperfdays2014 movistar tv

BE PREPARED FOR THE PEAK

Simulate your workload and know

your bottleneck

Don’t miss the target

Page 31: Webperfdays2014 movistar tv

It is better know the bad things when you have time to solve it !!!!

Don’t miss the target

Page 32: Webperfdays2014 movistar tv

Don’t do queries with full tables scans

Show and give access

SELECTOBJECT_NAME(S.[OBJECT_ID]) AS [OBJECT NAME],I.[NAME] AS [INDEX NAME],USER_SEEKS,USER_SCANS,USER_LOOKUPS,USER_UPDATES

FROM SYS.DM_DB_INDEX_USAGE_STATS AS SINNER JOIN SYS.INDEXES AS ION I.[OBJECT_ID] = S.[OBJECT_ID]AND I.INDEX_ID = S.INDEX_ID

Don’t miss the target

Page 33: Webperfdays2014 movistar tv

1 Index Creation 1 Query change

Don’t miss the target

Page 34: Webperfdays2014 movistar tv

The soccer game will start if you are ready or not.

Get your team ready. They have to know what to do.

It will start without you

Page 35: Webperfdays2014 movistar tv

It will start without you

Page 36: Webperfdays2014 movistar tv

Questions

Page 37: Webperfdays2014 movistar tv

Thank you!!!