Building video applications on Windows 8 with Windows Azure Media ServicesMingfei YanProgram manager (yanmf@Microsoft.com)Microsoft3-035

mingfeiy

Agenda

What is Windows Azure Media Services

Architecture and Features SDK and REST API

Evolution of online video

Victoria’s Secret fashion show 1999First major online broadcast28.8 kbps

1999 2004 2007 2008 2009 2012 Future

Evolution of online video

1999 2004 2007 2008 2009 2012 Future

<1Gps

Evolution of online video

1999 2004 2007 2008 2009 2012 Future

<1Gps

Evolution of online video

2,200 hours of live and 4,400 hours of VOD150 million viewers for live streaming237 million views for on-demand

1999 2004 2007 2008 2009 2012 Future

<1Gps

Evolution of online video

1999 2004 2007 2008 2009 2012 Future

<1Gps

444Gbps

Evolution of online video

1999 2004 2007 2008 2009 2012 Future

<1Gps

444Gbps

Evolution of online video

<1Gps

444Gbps

3,500 hours of live coverage102.6 million videos 15M unique mobile usersFirst live streaming event in the cloud

1999 2004 2007 2008 2009 2012 Future

>1Tbps

ChallengesInfrastructure costsManaging costsMonetizing contentsDigital Rights Management Security

Multiple formats, multiple bitrates

High Quality videos for any device

Anywhere and Anytime

What Media Services could help?Your Choice of Components for Building Custom Media Workflows in the

CloudWindows Azure Media Services

Ingestion

Pre-encrypt files prior to uploading(AES 256)Secure HTTPS uploadNetwork level peering for fast HTTP into AzureFast upload using UDP with AsperaBulk ingest support

Ingestion

What Media Services could help?Your Choice of Components for Building Custom Media Workflows in the

Cloud

Encoding& Conversion

Windows Azure Media Services

Ingestion

Windows Azure Media EncoderSupports encoding to H.264 or VC-1 videoEncodes audio to AAC-LC, HE-AAC, Dolby DD+, WMAPackages to MP4, HLS, Smooth Streaming, HDS, WMVPartner SDK for enabling ‘build-in’ encoders

Encoding& Conversion

What Media Services could help?Your Choice of Components for Building Custom Media Workflows in the

Cloud

Encoding& Conversion

Windows Azure Media Services

Content Protectio

nIngestio

n

Windows Azure Media EncryptorSources from Smooth Streaming or Apple HLSEncrypts with PlayReady, Common Encryption, AES

Content Protectio

n

What Media Services could help?Your Choice of Components for Building Custom Media Workflows in the

Cloud

Encoding& Conversion

Windows Azure Media Services

Content Protectio

n

On-DemandStreaming

Ingestion

Windows Azure Media OriginManaged streaming service… it just works!Guaranteed bandwidth. Auto recovery/redundancy. High AvailabilityIntegrated Azure CDN supportDynamic Remux support for standard MP4 files

On-DemandStreaming

Analytics & Advertising

LiveStreaming

Architecture

REST APIs

“Build-On” Media Partners and Customers

Azur

e CDN

Media Services

Adaptive StreamingPorting Kits

Partn

er C

DNs

Origin

Caching

Secure Media Ingest

Media Job Scheduling

Encoding

ContentProtection

On-DemandOrigin

Live Origin

Analytics Identity Management

“Build-In”Partner Media Processors

Live Ingest

Live Encoding

Client Libraries

Silverlight

HTML 5Advertising

Flash

XBOX 360

WindowsPhone

iOS

Demo: Windows Azure Media Services workflow

Windows Azure portal for media services

Media Services APIs and SDKs REST API for all platforms, using OData 3.0

Simple to write your own client libraries using REST API and standard HTTP verbs (GET, POST, PUT, DELETE)

Link: http://msdn.microsoft.com/en-us/library/hh973618

.NET library available now in PreviewLink: http://www.windowsazure.com/en-us/develop/net/how-to-guides/media-services/Nuget package: https://nuget.org/packages/windowsazure.mediaservices

Future - JAVA library available in FallOpen Libraries available with source code (Apache 2 license) on GitHub

Demo: Learn how to connect to Media Services using .NET SDK

Using .NET SDK for Media Services

Quick and EasyMedia Services enable content companies and solution providers to quickly and easily build end-to-end media workflows

Open and FlexibleMedia Services provide pre-built, ready-to-use, first-and third-party technologies that enable custom solutions to create, manage, and distribute content for all the devices and platforms you care about.

Powerful and Cost-EffectiveMedia Services provide a scalable, reliable and cost-effective infrastructure allowing you to focus on your core business and the valuable features that differentiate your products.

Windows Azure Media Services Value

Reach StoryMedia Players

Microsoft End Points

Non-Microsoft

End Points

Flash (Smooth,

DASH)

iOS (Smooth,

HLS)(Smooth,

DASH)

XBOX (Smooth,

DASH)

Silverlight(Smooth,

DASH)

Windows Phone

(Smooth, DASH)

Android (HLS & 3rd

party)

Porting Kit for

Devices (Smooth,

DASH)

Smooth Streaming in Windows 8Player Applications

(Customer’s app)

Player Frameworks(HTML5/XAML Player Framework)

Client SDK(SS Extension SDK)

Media Pipeline(Windows 8 MF)

Platform(Windows 8)

Primary media delivery platform for Windows 8Light up support for video element in modern style applicationsHTML 5 Modern style applicationsXAML Modern style applicationsC++ Modern style applicationsProvide an easy way to Consume Smooth Streaming and other formats in future (e.g., MPEG-DASH)Port existing video apps to windows 8Monetize apps with in-built Ad support and rich AnalyticsGet started with VS templates and client frameworksEarly developer bits already available

Smooth Streaming Extension SDK

Decoder Renderer Decrypter(DRM)

Media foundationInterface

Media Engine in Windows 8 platform

PLAYBACK PIPELINE

Native codec support: H.264, WMV, VC-1 and etc.

Application with Smooth Streaming Sourceurl : …/manifest

Smooth StreamingExtension SDK

Application with video sourceurl : …/a.mp4

Player FrameworksShipped as Open source at playerframework.codeplex.comBuilds on capabilities of Smooth Streaming ClientAvailable for multiple platform

Windows 8 Player• HTML/JavaScript Modern style applications• XAML/C# Modern style applicationsHTML5 player for browserSilverlight & Windows Phone player

Well established player frameworkPlugin Architecture – import what you need

Player Applications(e.g., NBC, Comcast)

Player Frameworks(e.g., MMPPF, HTML5 framework)

Client SDK / Porting Kits(e.g., SSME, SSPK)

Media Pipeline(e.g., Silverlight,

GStreamer)

Platform(e.g.,

Windows/ Linux)

Windows 8 Features

Smooth Streaming (VOD and live)

Closed captioningAdvertising

LoggingProgressive Video

Player styling

DVR controls

PlayReady DRMAnalytics

Offline

Multiple Audio MPEG-DASH

Trick Play

Demo

hello world video application

Advertising DefinitionLinear Ads: presented before, between or after video content. Linear Ad takes over the full view of video.

Advertising DefinitionNon-linear Ads: runs parallel to the video content so the user still has the option of viewing the content.It could be text, graphical banner/buttons or video overlays

Advertising DefinitionCompanion Ad: Pairing with Linear Ad or Non-Linear AdIt offers sustained visibility of the sponsor throughout the video content

After 5 sec when linear ad is over

Advertising StandardsVAST (Video Ad Serving Template) 3.0 / 2.0

It tells video player what to playRecommended by IABBased on XMLServed by majority of ad serversFive Ads formats:

Skippable Linear AdsAd Pods (a sequenced group of ads)Linear AdsNon-linear AdsLinear Ads with Companions

Advertising StandardsVAST (Video Ad Serving Template) 3.0 / 2.0<VAST version=“3.0”>

<Ad><InLine><AdSystem>My Ad Server</AdSystem><AdTitle>Car Company</AdTitle><Impression>...</Impression>

<Creatives><Creative>

<Linear>...</Linear></Creative><Creative>

<CompanionAds>...</CompanionAds></Creative>

</Creatives></InLine>

</Ad></VAST>

Advertising Standards<Creative id="video" sequence="0" AdID=""><Linear>

<Duration>00:00:32</Duration><TrackingEvents>...</TrackingEvents><VideoClicks>...</VideoClicks><MediaFiles>

<MediaFile apiFramework="Windows Media" id="windows_progressive_200" maintainAspectRatio="true" scaleable="true" delivery="progressive" bitrate=“200” width="400" height="300" type="video/x-ms-wmv"><![CDATA[

http://smf.blob.core.windows.net/samples/ads/media/XBOX_HD.wmv]]>

</MediaFile></MediaFiles>

</Linear>

VAST (Video Ad Serving Template) 3.0 / 2.0

Demo

What to play - VAST

Smooth Streaming for Windows 8

I am a Developer: Tell Me How it’s DoneDownload Microsoft Media Platform Player frameworkhttp://playerframework.codeplex.com/releases/view/96091

Install Smooth Streaming client SDKhttp://visualstudiogallery.msdn.microsoft.com/04423d13-3b3e-4741-a01c-1ae29e84fea6?SRC=Home

Install Microsoft PlayReady Client SDK http://visualstudiogallery.msdn.microsoft.com/e02ccac7-f3eb-4b53-b11a-c657d5631483

Where to get started:Download MMPPF sample app and learn from sample code

http://playerframework.codeplex.com/releases/view/92745

Getting to know about Windows Azure Media Serviceshttps://www.windowsazure.com/en-us/home/features/media-services/

All the sessions materials are available at : http://mingfeiy.com/

Q&A

• Follow us on Twitter @WindowsAzure

• Get Started: www.windowsazure.com/build

Resources

Please submit session evals on the Build Windows 8 App or at http://aka.ms/BuildSessions

© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.