22
© 2013 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc. Big TV Means Big Infrastructure and Big Data Jacques Louvet, Charlie Hammell, Comcast November 13, 2013

Big TV Means Big Infrastructure and Big Data (ENT304) | AWS re:Invent 2013

Embed Size (px)

DESCRIPTION

To support their advanced Xfinity X1 platform and provide services to millions of customers, Comcast maintains physical data centers, but the company is increasingly relying on AWS as well; it plans to maintain both going forward. AWS supplies Comcast with resources on demand so that capacity issues in its brick-and-mortar sites can be more readily managed as part of its high-availability strategy. Comcast also employs AWS as a flexible, cost-effective platform for development and prototyping. Finally, AWS also helps Comcast make effective tactical and strategic use of the huge data streams generated by its customers’ use of its services. In this talk, we trace how Comcast uses AWS to mitigate risk and to open up new technical capabilities.

Citation preview

  • 1. Big TV Means Big Infrastructure and Big Data Jacques Louvet, Charlie Hammell, Comcast November 13, 2013 2013 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc.

2. The X1Platform from XFINITY2 3. The X1Platform from XFINITY (Video) http://platformuniv-p.edgesuite.net/dynamic/Comcast_Corp_Site/X1_Platform_-_Arc_showcase_-_Comcast_Cable__682582.mp43 4. Comcast Core Backbone4 5. Comcast Private Clouds5 6. X1 Leased CPEX1 Platform Set Top Box RampTargetJan6FebMarAprMayJunJulAugSepOctNovDec 7. Big Data 8. Millions of STBs DC 1 Head End DC 2 Head End DC 3Head EndDC n 9. Millions of STBs Backbone NetworkCloud Services 10. Log MB per 48 hrs. 2,500,0002,500,000MB per 48 hrs2,000,0001,500,0001,000,000 9,500 500,0000 AprilJanuary 11. Millions of X1 Set Top BoxesFile ServersBI Tools 12. Cost 13. STB Logging: No Constraints X1 Set Top BoxesS3Hadoop (EMR)S3Data Warehouse OracleNodeOracle NodeOracle NodeOracle NodeNode Amazon RedshiftBI Tools 14. No Constraints: Ingest and Storage 15. No Constraints: ProcessingHadoopMap/ Reduce ScriptS3S3Map Worker NodebucketsbucketsReduce Worker NodebucketsJob ControllerMap Worker NodebucketsReduce Worker Node bucketsbucketsMap Worker Nodebucketsbuckets 16. No Constraints: QueryingAWSComcast DCs ETLData Warehouse OracleS3 OraclebucketsOraclebucketsOraclebucketsAmazon RedshiftbucketsBI Tools 17. What Did We Learn? 18. 60% Savings 19. What about You? 20. Please give us your feedback on this presentationENT304 As a thank you, we will select prize winners daily for completed surveys!