(UAIPD #13-0020) Prioritized, high quality H.264 video transmission over wireless channels through cross-layer forward error correction scheme with

Raptor and RCPC codes Inventors: Fei Hu, Yeqing Wu, Sunil Kumar

May 6, 2013

What is this invention?• Significantly improve the real-time video quality

over unreliable, erroneous, wireless communication links;

• We are the first group to integrate (1) Raptor Codes, (2) Cross-layer design, and (3) Wireless, prioritized, multi-channel transmissions.

• This research is sponsored by DoD (Department of Defense)

History• Companies (such as Netflix, Comcast) needs to

deliver high-quality video to Wi-Fi or any mobile devices (such as iPAD, cell phone, laptop, etc.)

• However, existing H.264 video has low quality (such as jitter, delay, color distortion, etc.) under poor wireless links

• How do we guarantee high-resolution video services over poor wireless links?

Our Technology• Cross layered forward error

correction scheme to increase video quality of wireless connections

• Combines new raptor code with rate compatible punctured convolution

• Unequal error protection at application layer and physical layer

• Funded by DoD (total 3 grants!)

We are the first group to integrate 4 components into one network!

(Multi-channel transmission)

Sub-Innovation 1: UEP Raptor Codes in Application layer

Sub-Innovation 2: UEP RCPC Codes (in Physical Layer)

• For four priority groups of AL-frames, we have R1<=R2<=R3<=R4

Sub-Innovation 3: Cross-Layer UEP FEC

• Application layer and Physical layer share the same available channel bandwidth.

• For poor wireless link, conventional schemes assign a higher portion of the available redundancy to Raptor codes at AL. This may not improve the delivered video quality since almost all PHY-frames would be corrupted during transmission.

• We have found out that the RCPC code rate at PHY can be increased, and more channel bandwidth becomes available for Raptor coding at AL.

Goal:• Cross-layer optimization between AL FEC and PHY FEC to deliver a video

with the highest possible PSNR for a given channel bandwidth C and SNR.

Better than conventional schemes!

Our invention: Integrate raptor codes, cross-layer design, prioritized transmission and multi-channel ideas!

Conventional scheme 1: without using Raptor codes

Conventional scheme 2: without using cross-layer design

Conventional scheme 3: without using Prioritized transmission

Very promising applications!

• Prioritized, wireless, multimedia Transmission (VOD, Video conference, Online Movie, especially for wireless)

• High Priority Video data– Sequence Parameter Set– Picture Parameter Set– I/IDR Frame– Base Layer (H.264/SVC)

• Low Priority Video data– B Frame– Enhance layer (H.264/SVC)

Application example 1

High-quality movie delivery!

Application Example 2 - Teleconferencing

Application example 3 – Prioritized Video Transmission

• Prioritized Medical Image transmission

• High Priority Image data:– Region of Interest (RoI) that doctors care about. Like

• Low Priority Image data:– Background

05/02/2023 by Fei Hu 14

Application example 4: Remote Patient Monitoring

(using cameras)

• Fei Hu, "Functional Near-Infrared (fNIR) Spectroscopy for Auto-Rehabilitation Cyber-Physical Systems: Towards Intelligent Signal Processing for Training Progress Indication," Cyber-Physical Systems: Integrated Computing and Engineering Design, Publisher: Taylor & Francis LLC, CRC Press, to appear in May 2013.

• F. Hu, Chad Buckallew, Sarah Duncan, et. al., "Augmented Cognition for Intelligent Rehabilitation," (accepted) Cyber-Physical Systems: Integrated Computing and Engineering Design, Publisher: Taylor & Francis LLC, CRC Press, to appear in May 2013.

Market• Wireless Video Transmission

Technology (2010)• CAGR: 105.1%• 11.8 million global units sold• 28 million including smart phones• 241.1 million units in 2015• Growing Market• High demand for wireless video devices

Market Cont’d - teleconferencing

• Teleconferencing Service Providers (such as InterCall, Inc.)

• $61.4 million annual sales• 54% of employees use videoconferencing in

businesses with over 100 employees.

http://www.informationweek.com/smb/network/executives-demand-communications-arsenal/227501053

Potential Customers• Video conferencing companies• Internet TV (IPTV) companies (such as

Comcast, AT&T, QUALCOMM, etc.) • Netflix, Vidyo Inc., InterCall Inc., Qumu

Inc., Video Commnications Corp, LifeSize Inc., Cisco

• Wireless Video Transmission Technology Manufacturers

• Hewlett-Packard, Galaxy Microsystems Ltd., Vizio, Silicon Image

Literature Search

Patent SearchUSPTO.gov

Search TermsTerm 1 Term 2 Term 3 Number of Hits Relevant HitsRaptor Code 325 n/aunequal error protection 2724 n/aUEP FEC 61UEP video transmission 138 n/aUEP multi-layer 3 n/araptor multi-layer 9FEC raptor 71 n/aFEC raptor multi-layer 0 n/araptor cross-layer 2 n/a

Relecura(UEP)* multi-layer wireless channel n/a

(UEP)* multi-layer wireless channelwireless communication 2