Netflix Open Connect Network BR December 2012 v1

  • Upload
    -

  • View
    220

  • Download
    3

Embed Size (px)

Citation preview

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    1/21

    NetflixOpen Connect NetworkPTT Forum December 2012 Flavio Amaral (South America Network Strategy)

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    2/21

    Overview

    ! Introduction to Netflix

    !

    Netflix in Brazil! Peering and Plans for 2013

    ! Open Connect, the Netflix Content Delivery Network

    !

    Embedded ISP Caches (Open Connect Appliances)

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    3/21

    Introduction to Netflix

    ! Internet television

    !

    Subscription service (R$14,99/ms)! A catalog of movie and television shows

    ! Personalized recommendations

    !

    Support for wide variety of platforms, including compubased players, game consoles, mobile, set top boxesand smart televisions

    ! HTTP adaptive bitrate video delivery with custom

    intelligent client software

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    4/21

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    5/21

    Netflix in Brazil

    ! Service Launched in September 2011

    !

    Streaming millions of hours of entertainment each wee! Also available across the rest of the Americas and par

    of Europe

    ! Bitrate limits on some ISPs to avoid low usage basedbilling caps

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    6/21

    Peering

    ! Present at PTT-BR IX in Sao Paulo

    !

    First PoP activated in August 2012! Second PoP being activated this month.

    ! More than 20 Gbps of peak traffic and growing

    ! Also serving content via IPv6, more than 10 Mbps

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    7/21

    ISP Time Weighted Bit Rate for Netflix

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    8/21

    ISP Time Weighted Bit Rate for Netflix

    0

    500

    1000

    1500

    2000

    2500

    3000

    3500

    4000

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    9/21

    Netflix in Brazil 2013

    ! Bring content closer to the users

    !

    Go outside of Sao Paulo! Peering at other PTT IXs

    ! Embedded ISP Caches

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    10/21

    The Netflix Open Connect Appliance (OCA)

    ! Developed in response to ISP requests to help scale Netflixtraffic efficiently

    ! Reduces ISP cost by serving Netflix traffic from the local ISdatacenter, rather than upstream network interconnects

    ! Speeds up internet access for consumers to all third-partyinternet sites, because Netflix traffic is no longer a source omiddle-mile or backbone congestion

    ! Netflix bears the capital and maintenance costs, not ISP

    ! ISP provides space, power and a network port

    !

    An OCA is a component of the Netflix CDN(vs a transparencache)

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    11/21

    Why Deploy a Netflix OCA?

    ! Netflix data is a significant percentage of ISP traffic in tmarkets we serve

    ! Serve 90% of Netflix traffic from the local ISP datacent

    ! Remaining traffic can be served by upstream OCAs, peering

    ! Saves on transit, transport and other upstream scaling costs

    ! Provided free of charge to participating ISPs

    ! ISPs with >= 3 Gbps of Netflix traffic

    ! ISP provides rack space, power, 10 Gbps optical port(s)

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    12/21

    OCA Operation

    ! Used exclusively for Netflix content

    !

    Completely integrated with the Netflix content delivery syst

    ! Greater effectiveness than transparent or proxy caches (90% wit

    Netflix OCA, versus 20-50% with other caches)

    ! Efficient content fill mechanisms

    ! Outside peak times (ISP selected time and BW per OCA)

    ! OCA offline during fill, staggered fill recommended.

    ! Fill can source from neighboring, peer or transit OCAs

    ! ~5TB fill per day (i.e ~4Gb/s for ~2.5 hrs)

    ! OCA must be reachable by end users (port 80)

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    13/21

    OCA Hardware

    Space optimized: 4U high-density storage

    Power optimized for low power/cooling requirements (500W)

    Redundant 10GE opticalnetwork interfaces

    Redundant power supplies (ACor DC)

    Software:

    FreBSD 9.0

    NGINX HTTP server

    BIRD BGP

    Detailed specification on ourproject website

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    14/21

    OCA Provisioning

    ! Preconfigured: ISP unpacks and racks unit, plugs inpower and network

    ! OCA are shipped with pre-loaded content, immediatelydeliver network offload

    ! The appliance you receive is the same field- proven

    appliance Netflix uses in its own data centers andpeering locations.

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    15/21

    Directing Clients to OCAs

    Netflix Control Serve

    Broadband ISP

    3. Client connects to local OCA

    4. Local OCA delivers video stream

    User routing is done byNetflix control servers,not dependent on client

    DNS configuration

    Request is routed to thenearest available OCA

    Working sets of populacontent deliver up to 90

    network offload

    Netflix OCA

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    16/21

    Network Positioning

    ! OCAs are installed close to aggregations of end use

    !

    Netflix works with ISPs to determine proper locationand user-to-OCA mapping

    ! ISP Controls Traffic Flow

    !

    End-user netblocks are associated with OCA via BGP advertisemen

    ! OCAs only serve content to netblocks provided by ISP

    ! ISPs choose peak throughput each OCA is allowed to generate

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    17/21

    Scaling/Redundancy

    ! Typical configuration includes N+1 redundancy

    !

    Netflix works with ISP capacity planning to ensuredesired upstream network savings are achieved

    ! Peering and Neighbor failover

    !

    IX peering recommended for fill, overflow and failover! Open Connect System designed as carrier class ISP

    do not need to keep significant headroom on transit linto handle OCA failure.

    !

    Multiple OCAs can store some similar (popular) andsome different content to increase offload %

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    18/21

    OCA Maintenance and monitoring

    ! Monitored and supported by Netflixs 24x7 NOC

    !

    Engineered to be highly resilient

    ! Appliance-style software management: OS andapplications are firmware, updated automatically

    !

    No field service required

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    19/21

    OCA DRM

    ! Worry-free for all types of networks

    !

    The content stored is encrypted with industry-standardDigital Rights Management (DRM) technology

    ! Obtaining keys to unlock the DRM content requires retime interaction with our control servers

    !

    Only authorized subscription accounts can authenticato the control servers to obtain license keys to playcontent

    ! Our DRM systems have been reviewed and approved

    our content licensors

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    20/21

    Not only movies!

    ! Technology

    ! Technical blog: http://techblog.netflix.com/

    ! Eureka

    ! Hystrix

    ! Edda

    ! Asgard

    !

    Chaos Monkey

    ! Open Connect details: https://signup.netflix.com/openconnect

  • 8/9/2019 Netflix Open Connect Network BR December 2012 v1

    21/21

    Questions?

    Contact:[email protected]

    Additional information, includingpeering and caching information:http://openconnect.netflix.com/