Sep 18, 2017

SJ ChoiSystem IC CenterLG Electronics Inc

TV SoC Solutions for the Immersive Display & Intelligent Platform

LGE Internal Use Only

1 / 20

Contents

1. TV Overview2. Human Visual System 3. TV Technology Trends 4. TV SoC Overview5. LG TV SoC6. Tomorrow’s TV

LGE Internal Use Only

2 / 20

Audio

Digital STB

WirelessAccess Point

PVR1)

Home Server

BD Player

Gateway

PDA

Printer

Projector

Scanner

TV

Game Player Health Care

Camcorder

Camera

Note Book

MP3 Player Game Player

Personal ElectronicsConvergence into Cellular

Digital Convergence & Mobile/TV

Home ElectronicsConvergence into DTV

ISOCC`06 Keynote

1) PVR: Personal Video Recorder

‘06 Forecast

LGE Internal Use Only

3 / 20

TV as Entertainment Device- Immersive Display with Premium Contents

Digital Convergence & Mobile/TV

Mobile as Convergence Device- Combine All Functionalities

Social Finance

Shopping

Media

Game Health

Travel

Traffic

`17 Now

LGE Internal Use Only

4 / 20

l High-Definition TVl 16:9 Aspect Ratio

l 3DTV (w/t Glasses) l UHD TV

l Black and White TV l Color TV

l Wall Paper TV l Rollable TV l Hologram TV

Past and FutureTV Overview

Analog TV

Digital TV

Immersive TV

Future Technology

l Streaming l Premium Contents

Smart TV

LGE Internal Use Only

5 / 20

TV EvolutionTV Overview

LED TV (LED Back-light Control, Local Dimming)

UHD TV (Super Resolution, HD à UHD)

HDR TV (High Dynamic Range, SDR à HDR)

FHD 120Hz TV (Frame Rate Conversion, 60 à 120Hz)

OLED TV (Perfect Black, Color)Smart TV (Streaming & App, Computing Core)

LGE Internal Use Only

6 / 20

Human Vision (Eyes + Brain)

Human Visual SystemTV OverviewTV Reflects the Characteristics of the Human Visual System

Occipital Lobes

Left Right~65mm

u Black & White TV § [Human] Sensitive more to Luminance

Rod Cell, Cone Cell

u Digital TV § [Human] 16:9 Aspect Ratio is more Natural

4:3 à 16:9

u Immersive TV (UHDTV) § [Human] Wider View Angle à More Immersive

u Immersive TV (3DTV) § [Human] 3D Depth

TV & Human Factor

LGE Internal Use Only

7 / 20

Human Vision SystemTV Overview

u Bartleson-Breneman Effect § [Human]

Higher Contrast à Perceived Picture Brighter

u Helmholtz-Kohlrausch Effect § [Human]

Wider Color Gamut à Perceived Picture Brighter

TV Display à Higher Contrast and Wider Color Representation

LGE Internal Use Only

8 / 20

OLED: Ultimate Display Technology with Excellent Picture Quality

LCD vs OLEDTV Overview

Advantages of OLED TV

u Simple Structure § Self-emissive (no BLU1)) § Pixel Unit = Lighting Unit

u Ultimate Picture Quality § Real Black: Ultimate Contrast Ratio § Wide Color Gamut

u Innovative Form-Factor § Paper-slim Depth (~4mm)§ Light Weight § Curved & Flexible Display § Wall Paper Display

1) BLU: Back-Light Unit

LGE Internal Use Only

9 / 20

RGB OLED (Conventional) W-OLED + Color Filter (LG)

§ Color Sub-pixel: W-OLED + Color Filter- Color Filter: White + RGB- Tandem W-OLED (Multi-layer)à Improve Luminance

§ TFT: Oxide TFT

B

Cathode

Encapsulation

R G

Anode

Cathode

B

Anode

Encapsulation

R G B

GR

C/F

W-OLEDTandem (Multi-layer)

OLED

§ Color Sub-pixel: RGB-OLED§ Issues: Productivity

- Difficult Commercialization

OLEDTV OverviewLG OLED: White-OLED (Tandem) + Color Filter (RGBW)

LGE Internal Use Only

10 / 20

UHD TVTV Overview

u Detail with More Number of Pixels

Super Real

ABCD

LowResolution

High Resolution FHD(1,920x1,080)

UHD_4K(3,840x2,160)

UHD_8K(7,680x4,320)

Screen Size 55” 84”

View Angle 30˚ 60˚ 100˚

View Distance 3H: ~2M 1.5H: ~1.5M 0.75H: ~

30˚ 100˚

3xH

H

0.75xH

* Japan NHK Research

Full HD TV UHD TV (8K)

H

u Immersive with Larger Screen Size

Immersive

55” TV: D(~140cm), H(68.5cm), 3H(~2M)84” TV: D(~213cm), H(104cm), 1.5H(1.5M)

LGE Internal Use Only

11 / 20

u System S/W § Platform § BSP1)

§ Service/Contents§ HW/SW Optimization

u TV System Design §Architecture Design§ SoC Platform Design§ Global Broadcasting Technology§ Picture Engine§ Multimedia Service

u Design Infra § Foundry § Design Methodology§ Physical Design§ Low Power Design

System ICSystem IC Plays a Crucial Role for the Success of System

SoC (System-on-a-Chip)

SoC

TV

1) BSP: Board Support Package

LGE Internal Use Only

12 / 20

60s-70sIDMs

80s-00sFabless &Foundry

2010+Market-leading

Set Maker

System ICMarket-leading Set Maker develops its own SoC and Platform

Smart Phone

Now

TV

Past

Set Maker Fabless Set Maker Fabless

Overview

LGE Internal Use Only

13 / 20

TV SoC

CPU &Peripheral

DDR eMMC

Connectivity

Terrestrial

Memory

OLED

USBHDMI AnalogA/V

LCD

Cable/Satellite

RF

Streaming

App Service

Smart Feature

TV Panel

RemoteController

Contents

Immersive Picture

User Experience

TV Basic

GPU

Picture

EngineA/V Codec

Demodulator

Connectivity Sound

Memory Controller

TV SoC Overview

Trends

u Full HD à Ultra HD

u TV Platform § IP Delivery: TV à Mobile/Tablet§ Contents Delivery: Netflix, Amazon§ User Experiences: webOS, Tizen, Android

§ UHD Contents§ Broadcasting Technology § UHD Display§ LCD à OLED Technology§ HDR Technology

u Competitions § Japan vs Koreaà Korea vs China/Taiwan

§ Apple/Google

LGE Internal Use Only

14 / 20

Computing Unit

Broadcasting & Multimedia Connectivity & Mixed IP

Sound & Picture Engine

• CPU: ARM Cortex-A72/57• GPU: ARM Mali• DSP• Neural Engine (in Future)

• Global Demodulator: ATSC/DVB/ISDB-T/DTMB

• Multi-Standard Codec : MPEG-2/H.264/HEVC/VP9

• Audio Codec & Processing • Immersive Picture Engine• Display Panel Interface

• DDR3/4• HDMI2.0 • USB3.0/eMMC5.1• Ethernet • ADC/DAC/PLL

SoC Architecture & DesignTV SoC

LGE Internal Use Only

15 / 20

High-end

Mid-end

TV SoC(UHD)

TV SoC(FHD)

High-end

Mid-end

Stand-Alone

FRC3 3DDepth

L9

1st DTV SoC

`11

H13

`12

D13 D14

U14

H14

M14

webOS PlatformFHD Mass-Volume

4K HEVC2)

`13

M14+

H15

1st UHD SoC

`14

F16

M16

UHD Mass-Volume

4K/8K TV

`15

H15+

SR1) Engine

TV SoC

40nm 28nmProcess

1) Super Resolution (FHD à UHD High-Quality Conversion), 2) High Efficiency Video Coding

`16 `17

M16+

B17

Tyche16

EVE16

OLED UHD Controller

WallpaperInterface

ATSC3.0

LG Roadmap

LGE Internal Use Only

16 / 20

§ Process : TSMC 28nm (T28HPC+, 0.9V/2.5V)§ Package : 27x27 mm2 fcBGA

§ CPU - ARM Cortex A53 1.15GHz(x4, OD:0.95)- NEON, Trustzone- L1$ 32KB/32KB, L2$ 1MB

§ GPU/GFX- ARM MALI T820MP2@ 650MHz- OpenGL ES 1.1/2.0/3.0/3.1- OpenCL 1.2 full profile, DirectX 11.1- Renderscript for Google TV- Vivante GC520@300MHz Graphic Engine- DirectFB, AFBC

§ MFD (G1 Decoder) - FHD 30fps(x2) or FHD 60fps - VP8(1080p)- H.264-MVC Stereo High FHD (4K 30fps)- H.264 BP/MP & HP@L4.2- VC-1 SP/MP & AP@L3- MPEG-2 MP@HL & MPEG-4 SP/ASP- DivX 3~6, H.263 P0/P3- RV 8/9/10, AVS/AVS+ Guandian@L6.2- Sorenson Spark@L70- MJPEG Baseline, JPEG

§ G2 Decoder- 4K 10bit VP9 Decoder (60 fps)

§ HEVC Decoder- 4K 10bit HEVC Decoder (120 fps)

§ ATSC 3.0 Support- ATSC 3.0 TP - 4K SHVC Decoder (60 fps)

§ Encoder- H.264(VP8) 1080p@30fps MP@L5.1

§ Interface- Ethernet 100 Mbps Phy- Ethernet 100/1000Mbps MAC- USB2.0 x3, USB3.0 x1- HDMI 2.0b Rx. x4- PWMx3, I2Cx6, UARTx2

§ Audio/Sound DSP- HiFi EP Dual@600MHz, cache 32KB/32KB- DRA, Ogg Vorbis- DTS-M6n- DD, DD+, MP2, MP3, ADPCM, LDPCM,- AAC, HE-AAC, HE-AAC v2- WMA9(standard)/10(pro)/loseless, DDCO- HE-AAC/DD+ to DD- G.711, G.729- AC-4, MPEG-H, ATMOS

§ Picture Quality- 4K MEMC 120Hz. - HDR (Dolby, HLG, Technicolor)- 2Dto3D- Enhance SR- LED Local Dimming(HDR)- Wide Gamut

§ Security Engine - OTP, 3DES, AES, RSA, SHA, C2/CSA- Multi2, DVB-CSA- Trustzone- MD5, SHA-224- Secure Random Number Gen.- RSA 2048bit

§ Demodulator- VSB/QAM,DVB-T/C,ISDB-T- Analog Demod

§ Memory- Unified memory architecture- Up to DDR3/4 2133MHz 32x2- eMMC5.01

eMMC 5.01

SPI/Vsync

Transport Engine

BUS IF(CI+)

LAN PHY

JTAG

DDR I/F 2133 (32bit x2)

USB3.0x1I2S

UARTx2

PWMx3

SPDIF out

USB2.0x3

CPU:Cortex-A53

1.15GHz QuadL2$:1MB

GPU:ARM T820MP2

650MHz

MFD: 1080p@60fps

Encoder:480p@30fps

Audio DSP:HiFi EP

600MHz Dual

Security Engine

OTP ROM

Display Engine: HDR, SR

2Dto3D, Local/D

HDMI Rx. x4

2D Gfx:Vivnate520

M16+

Vx1/EPI Tx

LVDS Tx

TCON

A.Vid_in A.Aud_inA.Vid_out A.Aud_out

CLK Comp. ADCs

I2C x 6

GPIO

Demod :ATSC,

DVB-T/C,ISDB-T

4K HEVC Decoder4K SHVC Decoder

Analog Demod

4K MEMC 120Hz

4K VP9 Decoder

TV SoC M16+(`16)

LGE Internal Use Only

17 / 20

DTV Demod

VideoDecoder

AudioDecoderAnalog

Front-end&

A/V Interface Video

Encoder

Frame Rate

Converter

(FRC)

3D(2Dto3D,

3D Depth)

DisplayInterface

CPU GPUNetwork

&Connectivity

DDR/FlashController

USB/UART/I2C/SPI

HDMI/CVBS Out

DVR/Security

AudioEngine

DisplayEngine(Picture Quality)

Internal Bus

DDR3/4 DDR3/4

Technical Issues

u Total Memory Bandwidth § Full HD à Ultra HD § DDR Clock: 800MHzà 933 à 1,066 ৠBus Width: 16x4 (64bit) or 16x6 (96bit)

u Frame Buffer Compression § GPU: AFBC (ARM Frame Buffer Compression)§ Visually Lossless: 20/40/50%

u Real-time Constraints (QoS) § Real-time: Picture Engine, Display § Local Buffer § Scheduling

DDR Memory Interleaving

Reduce Bandwidth Loss

DDR Memory Bandwidth Utilization

Shorten a Latency of Memory Access

u Smart Memory Balancing § Video Encoder/Decoder § CPU/GPU

u CPU/GPU Performance § Dedicated CPU/GPU Bus

Memory BandwidthTV SoC

LGE Internal Use Only

18 / 20

Picture EngineTV SoC

TV Picture Engine

§ TV Panel: LCD/OLED q Picture Quality: TV Panel + Picture Engine

§ Up/down Resolution Scaling § De-interlacing: Interlaced à Progressive

q Format Conversion (Picture Engine)

§ Noise Reduction: Analog, MPEG§ Sharpness : Edge, Texture

q Noise and Sharpness (Picture Engine)

§ Contrast : Dynamic Range§ Color : Gamut§ Resolution : 4K, 8K

q Contrast and Color (TV Panel)

§ LCD Motion Blur: FRC 24/30/60 à 120Hz q Panel Characteristics

Spatial Resolution

BitResolution

TemporalResolution

ColorGamut

Dynamic Range

SDRBT.709

DCI

8bit10bit

12bit

SD

HD

2K

4K

8K

60Hz

240Hz120Hz

BT.2020 HDR

Real world HumanVision

109

108

106

104

102

100

10-2

10-4

10-6

~`16 `17~

휘도

Sundirect

Sunlight

Indoorlight

Moonlight

Starlight

0.1nit

400nit

0.001~0.1nit↓

700~1,500nit↑

HDMI

Sharpness

TNR/DNR

VideoStream

STBBDP

OTTBroadcasting

Deinterlace

Picture Engine

Scaler/SR

ColorContrast

WB

Local Dimming

VideoDecoder WCG

OLED

Input24/30/60/120Hz

25/50/100Hz

Output60/120Hz50/100Hz

OLED TVLCD TV

OSD SR

HDR

3D

FRC

Basic Differentiation Panel Specific

LGE Internal Use Only

19 / 20

§ Vivid and High Picture Quality § Immersive Ultra HD Screen § Feeling of “Being There”

u Immersive TV Screen

§ Premium Contents§ Contents Recommendation§ Personalized Screen (News/Advertisement)

u Contents & User Experiences

§ Display: TV Set Makers§ TV and Mobile Platform § Content Service

u Competitions

Home Entertainment Center & Personalized Screen

Tomorrow’s TVTV SoC

LGE Internal Use Only

20 / 20

Tomorrow’s TVTV SoCIntelligent Platform: Picture Engine

u Prevalence of Deep Learning § Big Data§ Computing Power§ Learning Skill

§ Pixel Improvement: Super Resolution, Noise Reduction§ Object-Centric Processing: Object Detection§ Picture Generation: Frame Rate Conversion

u Picture Quality

Alexnet : `12 ILSVRC (Image Classification Challenge) Winner

EDSR : `17 NTIRE_SR (Super Resolution Challenge) Winner

§ Input Analysis & Optimal Picture Tuning§ Watching & Learning

u Intelligent Picture Quality Tuning

Input PictureEngine

High QualityPicture

TV

Input Analysis

Self LearningDNN