11/25/2013

1

Delivering Large Scale WebRTC

Richard Tworek Principal WebRTC Strategies rtworek@webrtcstrategies.com Twitter: rmtworek

11/25/2013

2

STRATEGIES

WebRTC

Panelists

• Michal Raz – Vice President, Business Development

– Vidyo

• Jim Donovan – Director, Product Management

– Oracle Communications

• Arnaud Budkiewicz – CEO

– Bistri

11/25/2013

3

Trend

• WebRTC deployments anticipate large numbers of users

• Two Outcomes

– Actual WebRTC event is with a small group of users

– Webcasting, gaming, virtual reality, education and a multitude of other applications will require large to very large groups of users to be in actual real-time simultaneously.

11/25/2013

4

WebRTC Market Trends

http://webrtcstats.com/webrtc-forecasts-upgraded-mobile-support-accelerating/

• Widespread adoption by

expected by 2016 – 3.9b devices

• 1 billion device threshold

crossed in Q1 2014

• Active user base (individuals) for

WebRTC to exceed 1.5b people

by end-2016

• Market trends drive significant

scaling requirements

WebRTC Apps Require Significant Scale

Session

This session will examine the issues and potential solutions for using WebRTC for these level deployments

Michal Raz Vice President, Business Development Vidyo

Scaling webRTC Deployments

11/25/2013

9

• WebRTC enables real-time video communications in every browser

• Potential explosion of millions of endpoints

• Requires robust video communication backend solution for:

– Multipoint

– Scalability

– Manageability/SLA

– Interoperability

– Error resilience

• Transcoding bridge (MCU) will not do the job

11/25/2013

10

MCU Architecture Challenge Hardware fixed to a given location = under utilized assets

1 MCU 100 Ports

2 MCU 200 Ports

3 MCU 300 Ports

Duplicated capacity per geography used just 8 hours per day!

11/25/2013

11

Solution = Scalable Video Coding Architecture Support any device on any network

High Resolution - High Frame Rate

Medium Resolution – Medium Frame Rate

High Resolution – High Frame Rate

Low Resolution – Low Frame Rate

Base Layer

High Resolution Layer

500 Kbps

Base Layer

High Resolution Layer

Base Layer

2 Mbps

High Resolution Layer

3G/4G – Low Bandwidth

Base Layer

Source

All Resolutions Delivered With Minimal Latency

Consistent quality at any bandwidth

Scales to Support Large Deployments

Example Customer: CERN- CERN Usage Traditional MCU: 125U (DSP)

VidyoRouter: 6U (x86)

General Purpose IP Network No QoS Required

VidyoRouter™ Localizes Video Traffic

Up to 70% reduction in WAN traffic through localization

• Scalable coding solves fundamental problems in real-time video – Error resilience and localization – Rate matching – Personalized layout – Low delay for multipoint – Cascading – Low cost

• VidyoRouter makes multipoint video similar to any other network-based application

• VP9 with scalability will make massive multipoint deployment possible

Meet face to face with whoever you want, whenever you need to, with a single click

Any time, any where, any device Visit Vidyo Booth #407, Tweet @Vidyo and #webRTCexpo

Jim Donovan Director, Product Management Oracle Communications

Most WebRTC Apps Require Significant Scale

Scalability Challenges

• Many WebRTC sessions won’t be P2P – Interworking with PSTN & mobile

– Large scale conferencing

– Regulatory (lawful intercept, call recording, etc.)

• Media encryption interworking

• NAT traversal (TURN & alternatives)

• Similar problems as once seen with SIP-based networks

Scalability via WebRTC Signaling & Media Control

• Intelligent & dynamic media release for improved scale & bandwidth savings

• Highly-scalable SRTP media termination

• Distributed signaling & media architecture for max. scalability

• High availability architecture

Web App Web App

WebRTC Media Control

WebRTC Media Control

WebRTC Media Control

WebRTC Media Control

WebRTC Signaling Control

P2P vs. anchored

media

Scalability via Overload Protection

• Prevents overload of the edge & back-end service at scale

• DoS attack prevention

• Traffic prioritization maintains normal service to valid users

• Efficiently handles encryption keys & network authentication

WebRTC Signaling & Media

Control

Recommendations for Addressing WebRTC Scaling Challenges

• Consider utilizing a purpose-built WebRTC signaling & media control architecture in the network

• Provides these key features: – High scalability for signaling & media – Maximum reliability – Interoperability – Security

WebRTC Signaling & Media

Control

Arnaud Budkiewicz CEO Bistri

Large Scale Challenges: client

11/25/2013

23

• Frictionless

– Simple: a Permanent link to be reached

– Any browser: WebRTC & Flash >> the same UX, features

based on 1 million minutes of video call /month

Chrome App

• Open: No registration, no need to be friend

>> the right signaling protocol: XMPP

>> to build a Guest mode

>> and Gateways to G+, FB, Y!, VK… with SSO

11/25/2013

24

• Add Full-time Presence to the Web

>> Android Native App

Large Scale Challenges: client

11/25/2013

25

• Cross-platform WebRTC video calls: >> all implementations, all devices – Firefox, Chrome, Chrome OS Devices

– Android Mobile Web & Native app, Google Glass

from a QRcode

to a video call

in a mobile browser

Large Scale Challenges: client

• Video & Audio Quality, Battery life: Codecs

– OPUS & VP8: software

– H264

• Firefox started H264 integration

• Could help leverage WebRTC

11/25/2013

26

Large Scale Challenges: client

• Security

– WebRTC flows 256-bit AES encrypted

– other communications => HTTPS

– First VP8 devices • Google Nexus 5 • Kindle Fire HDX

11/25/2013

27

• Multi-party WebRTC Conferencing: pushing the limits

– 1 permanent link per user: Dedicated signaling

– 4 parties video conferencing

• High CPU usage on the client

• Mesh network: no MCU

– Chat without Chat server: Data channels

– Screen sharing, Chrome only

Large Scale Challenges: client

11/25/2013

28

Network communications

• Flexible, interoperability

– REST/JSON

WebRTC standard does NOT

include the signaling

• XMPP over HTTP

• LibJingle

92%

• NAT, Firewalls, 3G/4G

– WebRTC => STUN/TURN

– Flash => RTMP, RTMPT

Large Scale Challenges: net

Large Scale Challenges: backend

11/25/2013

29

Server side

• Automated, Scalable, Elastic Cloud based on AWS EC2

• Gateways: make the contact list run fast 1 gateway activated by 1 user

get list & presence ALL his contacts

+200 Million contacts => Cache Redis

• Geo-localize: to be close to the user => DB sharding, TURN clustered

Large Scale Challenges: APIs

11/25/2013

30

• Easy to integrate WordPress, JS, Widgets SDK Android

• Flexible – XMPP? => Dedicated signaling – Presence management => Websocket Clustered

• Secure => Api Token /application, domain locked

• Scalable architecture – Socket.io + Nodejs + Redis + pub/sub + MemCache

Questions

Questions

1. What are the scaling challenges you have observed in early WebRTC deployments?

2. How do the scalability challenges with WebRTC differ from those found in SIP-based networks?

3. Do you envision most WebRTC apps operating in a P2P or network anchored mode?

4. Today’s webRTC with VP8 has some scalability, what is missing?

5. What is the significance of this for Web Developers? 6. Is SVC an adopted technology?

11/25/2013

34