73
Digital Video Class Digital Video Class Spring 2006 Internet2 Spring 2006 Internet2 Member Meeting Member Meeting Larry Amiot Larry Amiot Northwestern University Northwestern University [email protected] [email protected] And And Dave Devereaux-Weber Dave Devereaux-Weber University of Wisconsin at Madison University of Wisconsin at Madison [email protected] [email protected]

Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University [email protected] And Dave Devereaux-Weber University

Embed Size (px)

Citation preview

Page 1: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Digital Video ClassDigital Video ClassSpring 2006 Internet2 Spring 2006 Internet2

Member MeetingMember Meeting

Larry AmiotLarry AmiotNorthwestern UniversityNorthwestern [email protected]@northwestern.edu

AndAndDave Devereaux-WeberDave Devereaux-Weber

University of Wisconsin at MadisonUniversity of Wisconsin at [email protected]@doit.wisc.edu

Page 2: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

AgendaAgenda

• Analog/Digital VideoAnalog/Digital Video• Digital Video ABCsDigital Video ABCs• Digital Video ApplicationsDigital Video Applications• BreakBreak• Digital Academic Television Network Digital Academic Television Network • Program GuideProgram Guide• Question and AnswerQuestion and Answer• DemonstrationsDemonstrations

Page 3: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Video – Analog and DigitalVideo – Analog and Digital

• AnalogAnalog

• Original broadcast television was black Original broadcast television was black & white& white

• 262 ½ odd and 262 ½ even lines 262 ½ odd and 262 ½ even lines (fields) are interlaced to conserve (fields) are interlaced to conserve bandwidthbandwidth

• 60 fields per second60 fields per second

• 15,750 lines per second15,750 lines per second

Page 4: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

National Television System National Television System CommitteeCommittee (NTSC) (NTSC)

• A committee appointed by the A committee appointed by the Federal Communications CommissionFederal Communications Commission

• Set standards for US televisionSet standards for US television

Page 5: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Composite VideoComposite Video

• Video and synchronizing pulses on Video and synchronizing pulses on the same wirethe same wire

• 1 volt peak-to-peak1 volt peak-to-peak

• 100 IRE 100 IRE (Institute of Radio Engineers)(Institute of Radio Engineers) units of videounits of video

• 40 IRE units of sync40 IRE units of sync

Page 6: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

NTSC does ColorNTSC does Color

• Backwards compatible with B&WBackwards compatible with B&W

• Color information added with a Color information added with a subcarriersubcarrier

• Saturation represented by subcarrier Saturation represented by subcarrier amplitudeamplitude

• Hue represented by subcarrier phaseHue represented by subcarrier phase

Page 7: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

RGBRGB

• 3 connections: red, green & blue3 connections: red, green & blue

• Full bandwidth, full resolution, full Full bandwidth, full resolution, full detaildetail

Page 8: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Digital VideoDigital Video

• Over the air in the US, the standards Over the air in the US, the standards body for digital is the Advanced body for digital is the Advanced Television Systems Committee Television Systems Committee http://www.atsc.org/http://www.atsc.org/

• One family of digital video encoders & One family of digital video encoders & decoders (codecs) is MPEGdecoders (codecs) is MPEG

• Named from the Moving Pictures Named from the Moving Pictures Experts GroupExperts Group

• http://www.mpeg.org/http://www.mpeg.org/

Page 9: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Digital VideoDigital Video

• DVB is a standard for digital vide DVB is a standard for digital vide broadcastingbroadcasting

• Originally European, now used Originally European, now used around the worldaround the world

• http://www.dvb.orghttp://www.dvb.org

Page 10: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Digital VideoDigital Video

• DVDV

• Standard used by Sony, Avid, Apple Standard used by Sony, Avid, Apple Microsoft, othersMicrosoft, others

• (Doesn’t use MPEG)(Doesn’t use MPEG)

Page 11: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

IP, Codecs & Business ModelIP, Codecs & Business Model

• Codecs include Intellectual Property Codecs include Intellectual Property (IP)(IP)

• IP often protected by patentsIP often protected by patents

• Need to license patented IPNeed to license patented IP

Page 12: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

IP, Codecs & Business ModelIP, Codecs & Business Model

• Windows Media (Microsoft), user cost is Windows Media (Microsoft), user cost is free, subsidized by sale of Microsoft free, subsidized by sale of Microsoft softwaresoftware

• Quicktime (Apple Computer), user cost Quicktime (Apple Computer), user cost is free, subsidized by sale of Apple is free, subsidized by sale of Apple ComputersComputers

• Real Media player is free, server is paid, Real Media player is free, server is paid, no hardware or software to subsidizeno hardware or software to subsidize

Page 13: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

IP, Codecs & Business ModelIP, Codecs & Business Model

• License for MPEG-2 Player is $2.50 License for MPEG-2 Player is $2.50 eacheach

• MPEG-2 codec not included with MPEG-2 codec not included with Windows Media or QuicktimeWindows Media or Quicktime

• MPEG-4 codec included in Windows MPEG-4 codec included in Windows Media & QuicktimeMedia & Quicktime

Page 14: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

IP, Codecs & Business ModelIP, Codecs & Business Model

• VideoLAN VideoLAN http://videolan.org/http://videolan.org/ is free, is free, open sourceopen source

• Has codecs with IP issues (MPEG-2)Has codecs with IP issues (MPEG-2)

• Does not pay a license fee for IPDoes not pay a license fee for IP

• Use of VideoLAN may carry IP risk.Use of VideoLAN may carry IP risk.

Page 15: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Digital Video ABCsDigital Video ABCs

Page 16: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Understanding Digital Video Understanding Digital Video QualityQuality

• Three important factorsThree important factors– Image resolutionImage resolution– CompressionCompression– Bit rate of the compressed video streamBit rate of the compressed video stream

Page 17: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Image ResolutionImage Resolution

Page 18: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Image ResolutionImage Resolution

• What is a pixel?What is a pixel?– Tiny square or rectangular, colored Tiny square or rectangular, colored

picture elements on a LCD, plasma, DLP, picture elements on a LCD, plasma, DLP, or projection LCD monitoror projection LCD monitor

– Tiny round, color phosphor dots on a Tiny round, color phosphor dots on a CRTCRT

– A value (e.g. 8 bit or 24 bit) defining A value (e.g. 8 bit or 24 bit) defining color and luminescencecolor and luminescence

Page 19: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Image ResolutionImage Resolution

• What is resolution?What is resolution?– The number of pixels on an image or on The number of pixels on an image or on

a frame of a videoa frame of a video– The more pixels, the better the The more pixels, the better the

resolutionresolution– Usually expressed as the horizontal Usually expressed as the horizontal

pixels times the vertical resolutionpixels times the vertical resolution•E.g. 720x480E.g. 720x480

Page 20: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Image ResolutionImage Resolution

• Interlaced ScanInterlaced Scan– Draw odd lines first, then the even linesDraw odd lines first, then the even lines– Full motion video requires frames every Full motion video requires frames every

1/60 of a second1/60 of a second– The way NTSC does itThe way NTSC does it

• Progressive scanProgressive scan– Drawn top to bottomDrawn top to bottom– Full motion video is 30 frames per Full motion video is 30 frames per

secondsecond

Page 21: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Image ResolutionImage Resolution

• Standard Definition Television (SDTV)Standard Definition Television (SDTV)– A set of digital television standards with A set of digital television standards with

480 lines of resolution480 lines of resolution– At least as good if not better than NTSCAt least as good if not better than NTSC– A subset of the Digital TeleVision A subset of the Digital TeleVision

standards (DTV)standards (DTV)– All SDTV formats are interlacedAll SDTV formats are interlaced

Page 22: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Image ResolutionImage Resolution

• DTV standardsDTV standards– ATCS is the standard in North AmericaATCS is the standard in North America– All use MPEG2 compressionAll use MPEG2 compression– 18 digital formats covering:18 digital formats covering:

•Standard definitionStandard definition

•Enhanced definitionEnhanced definition

•High definitionHigh definition

Page 23: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

High Definition TV 1. 1920 x 1080 16:9 24p Square2. 1920 x 1080 16:9 30p Square3. 1920 x 1080 16:9 30i* Square4. 1280 x 720 16:9 24p Square5. 1280 x 720 16:9 30p Square6. 1280 x 720 16:9 60p* Square

Enhanced Definition TV - 480p7. 704 x 480 16:9 24p Rectangle8. 704 x 480 16:9 30p Rectangle9. 704 x 480 16:9 60p* Rectangle

10. 704 x 480 4:3 24p Rectangle11. 704 x 480 4:3 30p Rectangle12. 704 x 480 4:3 60p* Rectangle13. 640 x 480 4:3 24p Square14. 640 x 480 4:3 30p Square15. 640 x 480 4:3 60p Square

Standard Definition TV- 480i16. 704 x 480 16:9 30i Rectangle17. 704 x 480 4:3 30i*Rectangle18. 640 x 480 4:3 30i Square

* most popular formats

DTV FormatsDTV Formats

Page 24: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Image ResolutionImage Resolution

• CIFCIF– A video format widely used in A video format widely used in

videoconferencingvideoconferencing– Common Intermediate Format (CIF)Common Intermediate Format (CIF)

QCIF - Quarter CIF (resolution 176x144)QCIF - Quarter CIF (resolution 176x144)SQCIF - Sub quarter CIF (resolution 128x96)SQCIF - Sub quarter CIF (resolution 128x96)CIF- Full CIF (resolution (352x288)CIF- Full CIF (resolution (352x288)4CIF - 4 x CIF (resolution 704x576)4CIF - 4 x CIF (resolution 704x576)16CIF - 16 x CIF (resolution 1408x1152) 16CIF - 16 x CIF (resolution 1408x1152)

Page 25: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

CompressionCompression

Page 26: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

CompressionCompression

• Spatial RedundancySpatial Redundancy– Takes advantage of identical picture elements Takes advantage of identical picture elements

within a video framewithin a video frame• Temporal RedundancyTemporal Redundancy

– Takes advantage of identical picture elements Takes advantage of identical picture elements between framesbetween frames

– Takes advantage of the movement of identical Takes advantage of the movement of identical picture elements between frames (motion picture elements between frames (motion vector)vector)

• PsychovisualPsychovisual RedundancyRedundancy – Takes advantage of human eyes limited Takes advantage of human eyes limited

response to fine spatial detailresponse to fine spatial detail

Page 27: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

CompressionCompression

• Lossless compressionLossless compression– You can take the compressed data and You can take the compressed data and

uncompress it to obtain an identical copy of the uncompress it to obtain an identical copy of the original uncompressed dataoriginal uncompressed data

– E.g. TIFF imageE.g. TIFF image

• Lossy compressionLossy compression– You can not get the original data by You can not get the original data by

uncompressinguncompressing– Allows much greater compression than lossless Allows much greater compression than lossless

compressioncompression– E.g. MPEGE.g. MPEG

Page 28: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

JPEG CompressionJPEG Compression

• A standard of the Joint Photographic A standard of the Joint Photographic Experts Group Experts Group

• A lossy compression techniqueA lossy compression technique• Handles still imagesHandles still images• The degree of lossiness can be varied by The degree of lossiness can be varied by

adjusting compression parameters- trade adjusting compression parameters- trade quality for file sizequality for file size

• You can also trade off decoding speed You can also trade off decoding speed against image quality against image quality

Page 29: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

JPEG CompressionJPEG Compression

• A 24 bit per pixel color scheme as A 24 bit per pixel color scheme as compared to GIF which is 8 bitcompared to GIF which is 8 bit

• Can easily provide 20:1 compression of Can easily provide 20:1 compression of full-color data (about four times better full-color data (about four times better than GIF but slower to decode)than GIF but slower to decode)

• Motion JPEG (M-JPEG) provides a video Motion JPEG (M-JPEG) provides a video streamstream– but it is not a standardbut it is not a standard– Does not use inter frame compressionDoes not use inter frame compression

Page 30: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

MPEG CompressionMPEG Compression

• MPEG is recognized standard for MPEG is recognized standard for motion picture compressionmotion picture compression– Uses many of the same techniques as Uses many of the same techniques as

JPEG, but adds inter-frame compression JPEG, but adds inter-frame compression – Compresses by about a factor of 3 better Compresses by about a factor of 3 better

than M-JPEG except at very low frame than M-JPEG except at very low frame ratesrates

– Takes more computation than JPEG to Takes more computation than JPEG to compresscompress

– Difficult to edit on a frame by frame basisDifficult to edit on a frame by frame basis

Page 31: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Intra Frame Encoding-Intra Frame Encoding-I FramesI Frames

• Every frame is encoded separatelyEvery frame is encoded separately

• Easy to editEasy to edit

• Fast to decodeFast to decode

• Lost frame produces small artifactLost frame produces small artifact

II III III

Page 32: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Inter Frame Encoding-Inter Frame Encoding-I and P FramesI and P Frames

• Forward predicted from the last I-frame or Forward predicted from the last I-frame or P-frameP-frame

• Better compressionBetter compression

• A little harder to decodeA little harder to decode

• More difficult to editMore difficult to edit

• More artifacts if a frame is lostMore artifacts if a frame is lost

• Buffering of previous frame requiredBuffering of previous frame required

• Frames sent in orderFrames sent in order

Page 33: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Inter Frame Encoding-Inter Frame Encoding-I, P, and B FramesI, P, and B Frames

• B-frames are both, forward predicted B-frames are both, forward predicted andand backward predicted from the last/next I-backward predicted from the last/next I-frame or P-frame frame or P-frame

• Best compressionBest compression• Hardest to decodeHardest to decode• Most difficult to editMost difficult to edit• More artifacts with lost framesMore artifacts with lost frames• More buffering requiredMore buffering required• Frames not sent in orderFrames not sent in order

Sent IPBBBPBBB

Page 34: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

So what’s a GOP?So what’s a GOP?

• A set of frames, typically between 4 A set of frames, typically between 4 and 20, is called a Group Of Picturesand 20, is called a Group Of Pictures

• At most one frame in the GOP can At most one frame in the GOP can contain a reference to a frame in contain a reference to a frame in another GOPanother GOP

• Some GOPs do not reference any Some GOPs do not reference any other GOPother GOP– E.g. E.g. IBBPBBP IBBPBBP

Page 35: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

MPEG CompressionMPEG Compression

• Three defined standardsThree defined standards– MPEG1MPEG1– MPEG2MPEG2– MPEG4MPEG4

Page 36: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

MPEG1MPEG1

• Optimized to work at video Optimized to work at video resolutions of 352x240 pixels at 30 resolutions of 352x240 pixels at 30 frames/sec and 1.5 Mbpsframes/sec and 1.5 Mbps

• May go as high as 4095x4095 at 60 May go as high as 4095x4095 at 60 frames/sec frames/sec

• Progressive scan onlyProgressive scan only

Page 37: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

MPEG2MPEG2

• Target bit-rate was raised to between 4 Target bit-rate was raised to between 4 and 9 Mbpsand 9 Mbps

• Commonly used at 720x480 resolution Commonly used at 720x480 resolution video at 30 frames/sec, at bit-rates up to video at 30 frames/sec, at bit-rates up to 15 Mbps15 Mbps

• Also used for HDTV resolution of Also used for HDTV resolution of 1920x1080 pixels at 30 frame/sec, at a bit-1920x1080 pixels at 30 frame/sec, at a bit-rate of up to 80 Mbpsrate of up to 80 Mbps

• Can do interlaced Can do interlaced

Page 38: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

MPEG4MPEG4

• Originally optimized for very low bit Originally optimized for very low bit rate communication at rates less rate communication at rates less than 64 Kbpsthan 64 Kbps

• Currently used in videoconferencing Currently used in videoconferencing for HD at speeds up to 4 Mbpsfor HD at speeds up to 4 Mbps

Page 39: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Videoconferencing VideoVideoconferencing Video

Page 40: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

H.323-based H.323-based VideoconferencingVideoconferencing

• An International Telecommunications An International Telecommunications Union (ITU) umbrella standard for Union (ITU) umbrella standard for videoconferencing across IP networksvideoconferencing across IP networks

• Includes protocols for:Includes protocols for:– Video (i.e. H.261, H.263, and H.264)Video (i.e. H.261, H.263, and H.264)– Audio (G711, G722, etc)Audio (G711, G722, etc)– Control (H.245, etc)Control (H.245, etc)

Page 41: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

H.261 CompressionH.261 Compression

• Part of the H.323 videoconferencing set of Part of the H.323 videoconferencing set of standardsstandards

• Originally for two way communication over Originally for two way communication over ISDN lines- now over the InternetISDN lines- now over the Internet

• Supports intra and inter frame Supports intra and inter frame compressioncompression

• Resolutions supportedResolutions supported– QCIF(144x176 pixels) QCIF(144x176 pixels) – CIF(288x352) CIF(288x352)

Page 42: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

H.263 CompressionH.263 Compression

• Part of the H.323 videoconferencing set of Part of the H.323 videoconferencing set of standardsstandards

• Based on H.261 but with enhancements to Based on H.261 but with enhancements to improve video qualityimprove video quality

• Resolutions supportedResolutions supported– QCIF(144x176) QCIF(144x176) – CIF(288x352) CIF(288x352) – SQCIF (128x96) SQCIF (128x96) – 4CIF (704x576) 4CIF (704x576) – 16CIF(1408x1152) 16CIF(1408x1152)

Page 43: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

H.264 CompressionH.264 Compression

• Part of the H.323 videoconferencing set of Part of the H.323 videoconferencing set of standardsstandards

• H.264, MPEG4, & AVC (Advanced Video Coding) are H.264, MPEG4, & AVC (Advanced Video Coding) are related codecs for achieving very high compressionrelated codecs for achieving very high compression

• Adds B frames to compressionAdds B frames to compression• Ultra-efficient technology that gives you excellent Ultra-efficient technology that gives you excellent

results across a broad range of bandwidths, from results across a broad range of bandwidths, from 3G for mobile devices to iChat AV for video 3G for mobile devices to iChat AV for video conferencing to HD for broadcast and DVD conferencing to HD for broadcast and DVD

• Used in QuickTime 7Used in QuickTime 7

Page 44: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

H.264 CompressionH.264 Compression

• H.264 delivers the same quality as MPEG-2 H.264 delivers the same quality as MPEG-2 at a third to half the data rate at a third to half the data rate

• H.264 Part 10 delivers up to four times the H.264 Part 10 delivers up to four times the frame size of MPEG-4 Part 2 at the same frame size of MPEG-4 Part 2 at the same data rate data rate

• Resolutions supportedResolutions supported– SQCIF (128x96)SQCIF (128x96)– 720p HD (1280x720)720p HD (1280x720)– 1080 HD (1920x1088)1080 HD (1920x1088)

Page 45: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

DV and MiniDVDV and MiniDV

• A format developed by several manufacturers A format developed by several manufacturers for recording on cassettes for recording on cassettes

• 500 line horizontal resolution500 line horizontal resolution• Utilizes the IEEE 1394 digital interface Utilizes the IEEE 1394 digital interface

(Firewire)(Firewire)• Bit rate of 25 MbpsBit rate of 25 Mbps• The sampled video is compressed using a The sampled video is compressed using a

Discrete Cosine Transform (DCT), the same Discrete Cosine Transform (DCT), the same sort of compression used in motion-JPEG sort of compression used in motion-JPEG

• 5:1 intraframe compression only5:1 intraframe compression only

Page 46: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Bit Rate of StreamBit Rate of Stream

Page 47: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Bit RateBit Rate

• The quality of the video is directly The quality of the video is directly related to the bit rate of the streamrelated to the bit rate of the stream

• Low compression streams require Low compression streams require more bandwidthmore bandwidth

• Many codecs dynamically adjust the Many codecs dynamically adjust the quality (compression) according to quality (compression) according to the amount of bits that are producedthe amount of bits that are produced

Page 48: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Bit RateBit Rate

• Variable bit rateVariable bit rate– Number of bits produced by the codec and sent Number of bits produced by the codec and sent

varies according to the redundancy and motion varies according to the redundancy and motion being compressed at any momentbeing compressed at any moment

• Fixed bit rateFixed bit rate– Bits to be transferred are bufferedBits to be transferred are buffered– If the codec starts producing information faster If the codec starts producing information faster

than the buffering can handle, feedback to the than the buffering can handle, feedback to the codec reduces the quality (compression) and codec reduces the quality (compression) and thus the number of bits producedthus the number of bits produced

Page 49: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Bit RateBit Rate

• The quantization (Q) level of an MPEG The quantization (Q) level of an MPEG stream is a measure of the amount of data stream is a measure of the amount of data the encoder throws away to bring the bit the encoder throws away to bring the bit rate down rate down

• Higher Q values mean the encoder threw Higher Q values mean the encoder threw away a lot of data, implying a low bit rate, away a lot of data, implying a low bit rate, but also low visual quality but also low visual quality

• A low Q level implies a high bit rate, and A low Q level implies a high bit rate, and high visual fidelity high visual fidelity

• You can keep a constant bit rate by You can keep a constant bit rate by varying the Q levelvarying the Q level

• Alternatively, you can keep a constant Q Alternatively, you can keep a constant Q level and allow the bit rate to varylevel and allow the bit rate to vary

Page 50: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Compression Trade OffsCompression Trade Offs

High CompressionHigh CompressionLess video qualityLess video qualityMore buffering requiredMore buffering requiredMore latencyMore latencyLess bandwidth requiredLess bandwidth requiredMore complex hardwareMore complex hardwareLess storage requiredLess storage requiredMore susceptible to More susceptible to

packet losspacket lossMore difficult to editMore difficult to edit

Low CompressionLow CompressionBetter video qualityBetter video qualityLess buffering requiredLess buffering requiredLess latencyLess latencyMore bandwidth More bandwidth

requiredrequiredLess complex hardwareLess complex hardwareMore storage requiredMore storage requiredLess susceptible to Less susceptible to

packet losspacket lossLess difficult to editLess difficult to edit

Page 51: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

High Definition VideoHigh Definition Video

Page 52: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Broadcast High Definition Broadcast High Definition TVTV• Breathtaking quality on home monitorsBreathtaking quality on home monitors

– PlasmaPlasma– LCD and projection LCDLCD and projection LCD– Projection DLPProjection DLP

• Several carrier typesSeveral carrier types– Through the airThrough the air– CableCable– Satellite dishSatellite dish

• More and more HD programming More and more HD programming becoming availablebecoming available

• Downside- watch too much television!Downside- watch too much television!

Page 53: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

High Definition VideoHigh Definition Video

• Two High Definition FormatsTwo High Definition Formats– 720p720p

•1280x7201280x720•Progressive scanProgressive scan•Equivalent to 9CIFEquivalent to 9CIF

– 1080i1080i•1920x10801920x1080• Interlaced scanInterlaced scan

– Both 16x9 aspect ration compared to Both 16x9 aspect ration compared to 4x3 of SDTV4x3 of SDTV

Page 54: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

High Definition VideoHigh Definition Video

• Uncompressed 1080i HDUncompressed 1080i HD

1920x1080x24x30 ~ 1.5 Gbps1920x1080x24x30 ~ 1.5 Gbps

• HDVHDV– Defined by four companies, Canon Inc., Sharp Defined by four companies, Canon Inc., Sharp

Corporation, Sony Corporation, and Victor Corporation, Sony Corporation, and Victor Company of Japan, Limited (JVC)Company of Japan, Limited (JVC)

– Idea is to store high-def MPEG-2 video on Idea is to store high-def MPEG-2 video on standard DV media (DV or Mini DV cassette standard DV media (DV or Mini DV cassette tape), and stream it across standard FireWire / tape), and stream it across standard FireWire / IEEE 1394 interfaces IEEE 1394 interfaces

Page 55: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

High Definition VideoHigh Definition Video

• HDVHDV– The format supports MPEG-2 The format supports MPEG-2

compressed video at two 16:9 compressed video at two 16:9 resolutions:resolutions:•720p (1280 x 720, progressive), at

approximately 19 Mbps data rate

•1080i (1440 x 1080, interlaced), at approximately 25 Mbps data rate- assumes a pixel aspect ratio of 1.33

Page 56: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

High Definition High Definition VideoconferencingVideoconferencing

Page 57: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

H.323-based H.323-based VideoconferencingVideoconferencing

• Compression/decompression Compression/decompression architecturesarchitectures– Initially blurred and murky H.261 codecsInitially blurred and murky H.261 codecs– Major use today is H.263Major use today is H.263– Beginning to see H.264 (MPEG4)Beginning to see H.264 (MPEG4)

• Bandwidth requirements have been Bandwidth requirements have been low (typically 1 Mbps or less)low (typically 1 Mbps or less)

Page 58: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

H.323-based H.323-based VideoconferencingVideoconferencing

• Resolutions have been limitedResolutions have been limited– Typically CIF (352x288)Typically CIF (352x288)– Recent use of 4CIF (Recent use of 4CIF (704x576 )- e.g. the 704x576 )- e.g. the

Gigaconference requiring bandwidths of Gigaconference requiring bandwidths of 1 to 4 Mbps1 to 4 Mbps

• Aspect ratio of 4x3Aspect ratio of 4x3

• Several audio algorithms, but Several audio algorithms, but typically low quality at 64 Kbpstypically low quality at 64 Kbps

Page 59: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

High Definition H.323-based High Definition H.323-based VideoconferencingVideoconferencing

• High definition videoconferencing is High definition videoconferencing is becoming availablebecoming available

• H.323-based high definition video and H.323-based high definition video and audio provides the quality necessary audio provides the quality necessary for media rich collaborationfor media rich collaboration

• Being standards-based, it offersBeing standards-based, it offers– User simplicityUser simplicity– Promise of interoperability with other non-Promise of interoperability with other non-

high definition H.323 systemshigh definition H.323 systems

Page 60: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

LifeSize H.323-Based Room LifeSize H.323-Based Room UnitUnit

• Produces 720p high definition videoProduces 720p high definition video• Utilizing H.264 codecUtilizing H.264 codec• 16x9 aspect ratio16x9 aspect ratio• 9CIF quality9CIF quality• 1 Mbps bandwidth (can go at 2 Mbps 1 Mbps bandwidth (can go at 2 Mbps

point to point)point to point)

Page 61: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

LifeSize H.323-Based Room LifeSize H.323-Based Room UnitUnit

• Built-in 4 port MCUBuilt-in 4 port MCU

• Good acoustical qualityGood acoustical quality– omni-directional architectureomni-directional architecture– circular array of 16 microphonescircular array of 16 microphones– 100 Hz up to 22 kHz bandwidth100 Hz up to 22 kHz bandwidth

• High definition camera with 70 High definition camera with 70 degree field of viewdegree field of view

Page 62: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

What Are The HD Driving What Are The HD Driving Forces?Forces?

• Do you need high definition resolution?Do you need high definition resolution?

• How important is audio quality?How important is audio quality?

• Is aspect ratio importantIs aspect ratio important

• Do you have sufficient bandwidth?Do you have sufficient bandwidth?

• Do you need two way interaction Do you need two way interaction (conferencing)?(conferencing)?

• Is H.323 interoperability important?Is H.323 interoperability important?

• What can you afford?What can you afford?

Page 63: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Other High Quality Video Other High Quality Video Options Options

• MPEG2MPEG2– VBrick, StarValley, etc VBrick, StarValley, etc – High quality video in the 7 to 16 Mbps rangeHigh quality video in the 7 to 16 Mbps range– Used at Northwestern for remote venuesUsed at Northwestern for remote venues

• DVTSDVTS– Lot of work being done in the Big Video Lot of work being done in the Big Video

projectproject– Transports digital video over IP at 30 MbpsTransports digital video over IP at 30 Mbps– HDV over DVTS becoming availableHDV over DVTS becoming available

Page 64: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Other High Quality Video Other High Quality Video OptionsOptions

• Access Grid high definition Access Grid high definition experimentsexperiments

• Microsoft ConferenceXPMicrosoft ConferenceXP– MPEG4 compressed high definitionMPEG4 compressed high definition

Page 65: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

DV GuideDV Guide

Page 66: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

DemonstrationsDemonstrations

Page 67: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Display

VideoLAN Client

MPEG2 stream

VideoLAN MPEG2 Stream

Speaker

VideoLAN Client

DVD Player

Captu

re C

ard

Composite Video

Page 68: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Display

VideoLAN Client

MPEG2 stream

VideoLAN MPEG2 Stream

Speaker

VideoLAN Client

DVD

Page 69: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

DVD Player Display

VideoLAN Client

StarValley Encoder

Composite Video/Audio

7 Mbps (max) MPEG2 stream

StarValley MPEG2 Stream

Speaker

Page 70: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

DV Camera Display

DVTS Client (decode)

Firewire Stream 30 Mbps DVTS stream

DVTS Stream

Speaker

DVTS Client (encode)

Page 71: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

Camera Display

DVTS Client (decode)Composite Video

30 Mbps DVTS stream

DVTS Stream

Speaker

DVTS Client (encode)

Canopus A/D

Firewire

Page 72: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

HDV Camera Display

VideoLAN Client

Firewire Audio/video

MPEG2 stream

VideoLAN MPEG2 Stream

Speaker

VideoLAN Client

Page 73: Digital Video Class Spring 2006 Internet2 Member Meeting Larry Amiot Northwestern University amiot@northwestern.edu And Dave Devereaux-Weber University

URLsURLs

• DV GuideDV Guide

http://db.arts.usf.edu/dvguide/default.ahttp://db.arts.usf.edu/dvguide/default.aspsp

• VideoLANVideoLAN

http://www.videolan.org/http://www.videolan.org/

• DVTSDVTS

http://www.sfc.wide.ad.jp/DVTS/http://www.sfc.wide.ad.jp/DVTS/