Digital Video over Next Generation Internet Hyun-chul Kim hckim@cosmos.kaist.ac.kr Korea Advanced...

Digital Video over Next Generation Internet

Hyun-chul Kim

hckim@cosmos.kaist.ac.kr

Korea Advanced Institute of Science and Technology

2003.1.22(Wed)

Table Of Contents

The Networks Advanced Applications Digital Video : Future Killer Application ? Digital Video Technologies What are people doing with these technologies? Challenges and Opportunities Digital Video over Next Generation Internet APAN-KR Digital Video Network Concluding Remarks References

The Networks

APAN : Objectives [Chon 01B]

Advanced Networking for Asia-Pacific

Research & Development for Advanced Applications and Services

Advanced Networking Environment for Research Community

International Collaboration

Asia-Pacific Advanced Network [Chon 01B]

Current status2001(plan)

Europe

Australia

KoreaJapan

China

Thailand

Malaysia

Singapore Indonesia

STAR TAP(USA)

PhilippinesVietnam

Hong Kong

Sri Lanka

KOREN

Advanced Applications ?

Basic Service Advanced Service

EMail

File Transfer Transaction

Telnet Video/Audio

News

WWW

Applications [Chon 01A]

What’s the Killer Application for APAN/KOREN and Internet2 ?

“VisiCalc” electronic spreadsheets on PCs

“Mosaic” World Wide Web

“Napster” Peer-to-Peer Computing

“Digital Video in some form” expected to change ….How we teach, learn, collaborate, and conduct research in Higher education [Hanss 01]

Digital Video : The Situation [Hanss 01B]

Equipment is getting cheaper (production to delivery)

Hardware and software are getting easier to use Video quality is improving IP-based delivery focus (versus ATM) Many standards are still being resolved Best practices are emerging Range of options means there’s no one solution Significant international cooperation

Uses for Digital Video

Videoconferencing Streaming video

Live, Scheduled or On-demand

1-to-1 or 1-to-N

Digital Video Technologies

H.323 VRVS MPEG1, MPEG2, MPEG4 MJPEG IEEE1394 DV/Firewire Access Grid VIC/VAT/RAT

Technologies

H.323 Recommended for audio, video over best-effort

packet switched networks Emerged from the telecommunications industry Point-to-Point and Multipoint videoconferences Enables collaboration - shared whiteboard, etc TCP for control, UDP for audio, video, status

General ObservationsClient agnostic video conference system

Vic/rat, existing H.323 clients, Minerva MPEG2

Developed and started to be deployed in Physics community (CERN, Caltech, …)

Comparison to H.323Uses same video/audio codecs (at initial phase)

Software reflector versus hardware gatekeeper

Windows, Unix clients available, Mac receivers

Easily extensible (open source code)

VRVS (Virtual Rooms Videoconferencing System)

VRVS : example

General Observations1-2 Mbps, free streaming clients available for broadcast &

VODs from various vendors

Many PCs have built-in MPEG1 decoding capabilities

Appliances available

Comparison to H.323Video quality better than H.323, worse than VHS quality

video

Cost per sending station usually more than H.323

Some interoperability between products but no standards govern transport like H.323

MPEG-1

Screen Shot(1):MPEG1 Live Broadcast and VOD

MPEG1 Traffic Measurement Measured at SA Lab. Gateway (gw.kaist.kr.apan.net) ‘Daily’ Graph (2001.10.24)

MPEG1 Multicast

Traffic 1.5Mbps

• ‘Weekly’ Graph (2001.10.17~2001.10.24)

MPEG1 Multicast Traffic 1.5Mbps

General ObservationsBroadcast quality video with audio for high-quality video a

nd digital television

3-15 Mbps (@ Main Level)

No free streaming clients

Expensive Hardware ($10-$25K per node)

Interoperability between vendors non-existent

ComparisonsBetter than VHS quality

Camera Quality is VERY IMPORTANT with MPEG2

It’s wonderful when it works

MPEG-2

MPEG-2 Traveling Node (Internet2)

10Mbps MPEG2 Traffic Measurement• Measured at SA Lab. GW (gw.kaist.kr.apan.net)• ‘Daily’ Graph (2001.10.25)

• ‘Weekly’ Graph (2001.10.18~2001.10.25)

MPEG2 Multicast Traffic 10Mbps

MPEG2 Multicast Traffic 10Mbps

MPEG1 Multicast Traffic 1.5Mbps

6Mbps MPEG2 Traffic measurement KAIST MRTG graphKAIST MRTG graph

Daily Graph (10.31~11.1)

Weekly Graph (10.25~11.1)

Goal: to make low-bit rate multimedia data Good quality video/audio with lower bandwidth

Near-DVD quality at 700K~2 Mbps

Began July 1993 / Release February 2000 Apple Quicktime 6 and WMT 9 : based on MPEG4

MPEG-4

Screen shot : APAN-KR TV multicasting, 2002.11.20 (Korea vs Brazil Soccer A match)

• 640X480X30 fps, at 1.5Mbps, using (MPEG4-based WMT) + CastBox Overlay Multicast system• 300~400 clients for a few hours

General Observations5-10 Mbps, video quality similar to MPEG2

Cheap Hardware : but you gotta roll your own

Both software & hardware decoding clients are currently available from Berkeley

http://www.openmash.org

http://bmrc.berkeley.edu/~delco/rtpvb (RTPtv)

ComparisonsGreat video, inexpensive, multipoint support

Deployed today at Berkeley to support teaching

Still work-in-progress, requires bandwidth

MJPEG

IEEE1394 (Firewire) DV General Observations

Uses IEEE1394(Firewire) device interface 30Mbps, video quality better than MPEG2 No encoding/decoding delays at PCs SDTV-quality interact

ive DV system http://www.sfc.wide.ad.jp/DVTS

Promise of inexpensive high quality nodesCOTS(commercial off-the-shelf) : DV camera, player, firewire boarde

d PCs/Notebooks

Cheap Hardware, available on FreeBSD, NetBSD, Linux, MacOS X, and WindowsMulticasting ? Manual/Adaptive Frame Rate control? (full/half/quarter, depen

ding on available bandwidth)

Equipments for Firewire DV[Jung 01]

노트북 1394 port

1394 cable(4-1394 cable(4-6 pin)6 pin)

1394 card(FireBird EZ)

DV Transport System [Ogawa 01]

IEEE1394Cable

Consumer DV Camera

IEEE1394Cable

Internet

DV→Internet PC Internet →DV PC

Consumer DV Deck

DV Transport System

IEEE1394Cable

Consumer DV Camera

IEEE1394Cable

Internet

DV→Internet PC Internet →DV PC

Consumer DV Deck

DV Transport System

IEEE1394Cable

Consumer DV Camera

IEEE1394Cable

Internet

DV→Internet PC Internet →DV PC

Consumer DV Deck

DV/Firewire Experiments [Jung 01] IPv4 unicast test between Chonnam Univ. (Gwang-ju, abo

ut 250KM away from Daejeon) and KAIST(Daejeon) – 2001. 5 CNU DVTS sender -> KAIST receiver # dvsend –h 192.249.24.39 –I ohci0 # dvrecv

DV/Firewire on Windows [Sul 01]

Firewire DV Traffic measurement

KAIST MRTG graphKAIST MRTG graph

Access Grid [Hanss 01C] General Observations

Group to group collaboration, persistent electronic presence, “Internet Café”

4 Video inputs per node, virtual roomsMulticast required!! (10-20 Mbps for a meeting)COTS technology - @ $40K for a node

ComparisonsVideo/Audio quality about same as or better than H.323Continuous, Multipoint presence is useful!!

Mobile Access Grid Node

Source: Argonne National Laboratory

Access Grid “Look and Feel”

Source: Argonne National Laboratory

Access Grid “Look and Feel”

Source: Argonne National Laboratory

An Access Grid Room

Ambient mic(tabletop)

Presentermic

Presentercamera

Audience camera

Considerations include room size; projector, microphone, speakers, and camera placement; ambient noise

Source: Argonne National Laboratory

An Access Grid Room: Components

Digital Video

Digital Video

Digital Audio

NETWORK

MixerControl

Computer

NTSC Video

RGB Video

Analog Audio

Video Capture

Computer

DisplayComputer

AudioCapture

Computer

EchoCanceller

Source: Argonne National Laboratory

Access Grid “Look and Feel”

Source: Argonne National Laboratory

Internet HDTV Why Studio-quality HDTV over Internet?

“Because We Can! ;-)” Gbps-level High bandwidth application

Studio-quality compressed HDTV stream : 270Mbps (122GB/hour)

Fully Uncompressed HDTV stream : 1.5Gbps (675GB/hour) no encoding/decoding delays (interactive applications)

Jointly developed by Tektronix, USC ISI, and UW.http://www.researchchannel.org/tech/ihdtv.asp

270 Mbps Internet HDTV Demo.between Stanford and University of Washington (1999.9.22)

Digital Video : Technologies and ProductsH.323 MPEG-1

MJPEG,

MPEG4

MPEG2 1394 DV

(Typical) Resolution

352X288 352X240 640X480(VGA)

720X480(SDTV)

720X480(SDTV)

Bandwidth 128Kbps~1Mbps 1~2Mbps 2~15Mbps 30 Mbps

Appliances Polycom, RadVision, VCON, Zydracon, ..

($2,000~$15,000)

Provided by MPEG-2 products

Or in-between

Minerva,

CAMVision-2,

REIMAY BOX

($20,000~$60,000)

* 150~300ms Delay

N/A

Servers Multiple Control Unit

($15,000~$100,000)

Provided by MPEG-2 products

Or in-between

IBM VideoCharger

CISCO IP/TV•3~10 sec. Delay•$2,000(S/W only) ~ $200,000 (+H/W)

PC + DV Camera or DV Recorder Deck

$2,000~$5,000

For PCs USB-based PC Cameras ($20~$1,000)

, Free MS NetMeeting

Provided by MPEG-2 products

Or in-between

Optibase cards ($5,000~$20,000), Reimay + SDK ($10,000~, no delay)

No encoding cards, no delays

(no compression)

So, What Are People Doing withThese Technologies?

Digital Video Applications Video Conferencing and Streaming Remote Lecture/Seminar Music Teaching (Master Class) Virtual Concert (Halloween Concert) Virtual Conference (Megaconference) Remote Instrument Observation and Control (telescope, microscope, …) High-quality Internet TV/Video Portal

Research Channel C-SPAN Broadcasting APAN-KR TV and Video Archive

Visual History Foundation Animations and Immersive Environments Telecubicle (Office of the Future?) And A LOT more…..

APAN-KR Digital Video Network Goal

Experiment, Evaluate and Deploy Advanced Digital Video Technologies and Applications on Next Generation Internet in Korea/Asia-Pacific.

As a basis for Research/Engineering Cooperation/Collaboration among APAN(-KR) members

Technology/Knowledge Transfer Fill-up and make congestions on current high-bandwidth networ

k!! to justify and request higher-capacity domestic network backbone, as well

as international links,…. Say, “We need more bandwidth!!” ;-)

APAN-KR Digital Video Network : Major Appllications Video Conferencing Network

Tools testing, evaluation and deployment H.323-based clients and MCU VRVS clients and reflector Others (Mbone tools, Isabelle, …)

40Gbps backbone and Gbps Access Network Let’s move to Firewire DV, rather than H.323 from now on.

Distance Education MPEG-1/MPEG-2/Firewire DV Remote Seminar/Workshop/Class Experiments (2001 Fall~) Now considering/evaluating MPEG-4

Video Archive MPEG-1/MPEG-2/RealVideo

Others (being formed and proposed) “Cyber Performance Project”, Internet TV, …

Remote Lecture/Seminar KAIST CS540 Network Architecture

MPEG1 Live

Web Presentation

Virtual Classroom experiment(KAIST CS540 Network Architecture)

Live Broadcasting CISCO IP/TV, MPEG-1 (1Mbps) or MPEG-2 (10Mbps) 4~5 seconds of delay

Interactive Q&A H.323-based tools (Microsoft NetMeeting, …) 100ms < Delay < 500ms Mbone tools (vic, rat, wb, …) and VRVS

Presentation Material Upload at course homepage before lecture begins and let audience access it re

motely. VOD Archive

Low-bandwidth (200Kbps) : Real Video Server High-bandwidth (with CISCO IP/TV)

1.5 Mbps MPEG1 : 600MB/Hour 10Mbps MPEG2 : 5GB/Hour

400GB = 80 X 1-hour MPEG2 movies

SA Lab. GW

SAL Network

Thrunet…

GNG

1G

1G

1G

1G

1G

1G

1G

1G

CS Dept. C6509

Admin. Building C6509

EE Dept. C6509

CIRC GSR12012

KOREN

100M

100M CISCO IP/TV

Server ( VOD + Multicast Server)

CISCO IP/TV Content Manager

CISCO IP/TV Server (Encode and Unicast Live

Video feed )

CISCO IP/TV Viewer

CISCO IP/TV Viewer

(Chonnam Univ.)

CISCO IP/TV Viewer

CISCO IP/TV Viewer

155M

CS540 Class Live Broadcast System

CD Dept. Network

EE Dept. Network

KAIST Network

CS540 Lecture Room

CISCO IP/TV Viewer

UnicastMulticast

APAN-KR TV multicasting, 2002.11.20 (Korea vs Brazil A match)

• 640X480X30 fps, at 1.5Mbps, using (MPEG4-based) WMT + CastBox Overlay Multicast system• 300~400 clients for a few hours

WMT Server& Web Server CastBoxCombo

(Relay+ Manager)

SourceNetwork

Encoder

CastBoxRelay

EncoderCastBoxRelay

Encoder

CastBoxRelay

Encoder

KAIST SALAB

Chonnam Univ.Zooin Net

Chungnam Univ.

APAN-KR TV Multicasting Network (http://tv.kr.apan.net)IPTV

Server (?)

KORENCommodity

Internet

CommodityInternet

CastBoxRelay

Encoder

CastBoxRelay

Encoder

KJIST

APAN-KR TV homepage

“Cyber Performance Project (being formed and proposed)”

Joint Project between APAN-KR Overlay Multicast WG and Ewha Womans University’s Dance Performance Group.

SDTV/HDTV quality real-time multicasting on KOREN. MPEG4-based SDTV quality

(for lower-bandwidth users) Firewire DV (no delay, higher

bandwidth) HDTV (option)

Demonstration at APAN Busan Meetings? (2003 Aug.)

Neul-hwee dance performance group, Ewha Womans Univ.

Digital Video over Next Generation Internet [Hanss 01A]

Advanced networks like APAN and Internet2 provide testbeds for these innovative uses of digital video.

Colleges and universities are taking advantage of this opportunity by making significant investments in digital video applications.

Research, teaching, and learning can all benefit from the uses of digital video in both collaboration and information dissemination.

Although we cannot expect the technology to fully stabilize anytime soon, wise investments will lead to a better understanding of the future potential of video-based applications.

Concluding Remarks Great Environment for exploring the future

PerformanceCollaborationEducation

Opportunities for both content providers and hardware /software vendors.

Cooperation/Collaboration betweenUniversities, Internet Service Providers, Content Providers and Digital Video

Product Providers Domestic (APAN-KR) as well as International (APAN/Internet2) coop

eration/collaboration is compelling!!As the bandwidth of International links have increased to multi-Gbps level.Let’s Fill-up them and request more bandwidth proudly!!

References

[Hanss 01 A] Ted Hanss, “Internet2 Digital Video”, VIDOS Advisory Committee, Oxford University, Oxford, England, 2001.1.16

[Hanss 01 B] Ted Hanss, “Internet2 Killer App or Dilbert’s Nightmare?”, in EDUCAUSE Review Volume 36, Number 3, May/June 2001.

[Hanss 01 C] Ted Hanss, “Introduction to Access Grid”, in EDUCAUSE 2001, Indianapolis, IN, 2001.10.29

[Riddle 01] Bob Riddle, “Looking over the H.323 Hill”, 2001.5.9[Chon 01 A] Kilnam Chon, “Internet : Next Steps”, KRNET 2001, 2001.6.27[Chon 01 B] Kilnam Chon, “Asia-Pacific International Connections Updates”, CCIRN

2001, 2001.6.8-9[Ogawa 01] Akimichi Ogawa and Katsushi Kobayashi, “DV over IP”, APAN/NLANR/

I2 Joint Tech Workshop, 2001. Jan.[Jung 01] Kugsang Jung, “1394 Digital Video Reports”, APAN-KR 2001 Fall Meeting

s, 2001. 9.20[Sul 01] Hong-ki Sul, “1394 DV on Windows”, APAN-KR 2001 Fall Meetings, 2001.9.

20.[Ahn 03] Sang-joon Ahn, “Cyber Performance Project”, Cyber performance project kic

koff meeting, 2003.1.16.

References ViDe http://www.vide.net SURA http://www.sura.org ResearchChannel http://www.researchchannel.com VRVS http://www.vrvs.org NLANR http://www.nlanr.net DVTS http://www.sfc.wide.ad.jp/DVTS/ Internet2 DVI http://dv.internet2.edu DV over NGI http://cosmos.kaist.ac.kr/salab/project/hdtv APAN-KR Internet TV (Overlay Multicast WG) http://tv.kr.apan..net APAN-KR http://kr.apan.net

For more information on APAN-KR Overlay Multicast WG and Internet TV network,

please attend Multicast BoF (Thursday 14:00~15:30, Room A)or contact WG chair, Joonbock Lee (jblee@cosmos.kaist.ac.kr)