NSCE

13-Jan-04 1

Semantic HIFIWP 8 : HIFI System

January 13th, 2004

Koen De Vroede

NSCE

13-Jan-04 2

Agenda

• WP 8 definition• Various Sony ‘HIFI’ platforms• Different scenarios for a HIFI system• Short term next steps• NSCE’s involvement in other WPs

NSCE

13-Jan-04 3

WP 8: Definition

• Objectives: Development of the HIFI System (personal Intelligent listening system), user tests & documentation

• Description of work:– Identification of transferable modules & features

• Technology perspective• Market & User perspective (boundaries HIFI <> authoring)

– Development of dedicated software architecture & run time• Functional abstraction & plug-in architecture• Compatible & Interoperable with Authoring Tool,func modules

& sharing servers• Pragmatic & evolving : the architecture is not the goal, it is the

means to support functional innovation (e.g. we could envision a distributed architecture for the Home Network)

• May require SDK/PC simulation env

NSCE

13-Jan-04 4

WP 8: Definition (2)– Adaptation/optimization & integration of func modules from WP

1.2, 2, 3, 4 & 5– Development of dedicated UI: Experimentation with variants– User tests & doc

• Partners: everybody (assuming all functional modules end up in the HIFI system)– IRCAM, UPF, Sony CSL, FhG: adaptation of functional modules

(BGU is missing)– FhG: coordination Sharing Server dev– NI: coordination Authoring Application dev

• Milestones:– M1: Market & user requirements study– M6: Architecture implementation (PC emulation)– M7: Integration functional modules– M8: Final version + doc

NSCE

13-Jan-04 5

Sony ‘HIFI’ Systems

NSCE

13-Jan-04 6

Sony ‘HIFI’: Hard Disk Based Devices

• Hard Disk Audio recorder • ATRAC3 recording on Hard Disk • High-speed CD to HD recording (2x) • PC-Link kit supplied (USB connection to

PC) – Edit artist name & track titles on your PC

– remote control from PC

• CD Title/Track info from Internet DB• Search function for Album / Title / Artist

information

NSCE

13-Jan-04 7

Sony ‘HIFI’: PVR line of products

Cocoon: PVR – line of products for Japanese market:

•Networked•Linux platform•EPG•Various models (DVD recording, TiVo like functionality (discern taste),…)

PSX: PVR on PS2 platform•PVR functionality

•Time shifting•Record & watch other recording•Record & play game

•PS2 gaming•DVD burning (12x speed)•DVD/CD playback•Network Connection (firmware update)•Launched in Japan Dec 03, Europe 04?

NSCE

13-Jan-04 8

Sony ‘HIFI’: PC + Network Media Receiver

• Remote control with menus on TV• View videos & photos and listen to

music stored on your Vaio• Dedicated software needed on PC

(Gigapocket, SonicStage,…)• Possibility for wireless connection

between NMR & Vaio (802.11a)

NSCE

13-Jan-04 9

Sony ‘HIFI’: Vaio W1 line

• Compact All-In-One Design packed with features:

• Giga Pocket - Record and manage TV programs, VHS movies and DVDs on your PC

• Built-in 17.5-inch LCD wide aspect screen with integrated Stereo Speakers

• Featuring DVD-RW burner and Click-to-DVD(TM) to store all of your videos

• Digital music management • Digital photo management • Digital Video Editing• Foldable keyboard

NSCE

13-Jan-04 10

Sony ‘HIFI’: use of other platforms for HIFI

•PS2 gaming platform•Airboard platform•Airtact platform•…

NSCE

13-Jan-04 11

Scenario 1: HIFI = PC

• PC sound card is connected to HIFI system or to its own set of speakers

• limited work in terms of optimization/adaptation of functional modules

• HIFI application with dedicated UI to be developed• Vaio W1 platform (or its successors) good example/target

NSCE

13-Jan-04 12

Scenario 2: Remote controlled PC

• PC is an element of the Sony Home Network• HIFI application back end runs on PC• UI runs on other Sony device

– UI displayed on TV• Roomlink style of product (IR command)• PSX/PS2 (IR, gamepad, eyetoy,…)

– UI displayed on RC device (Clie, Smart Remote Control,…)

• PC sound card is connected to HIFI system/TV• Additional work compared to Scenario 1:

– Adapted UI (screen size, input control,…)– Communication protocol front end/back end– PC SDK/simulation? – How to do QbH?

NSCE

13-Jan-04 13

Scenario 3: Network Media Receiver

• Scenario 2 + Sony device connected to audio system instead of PC

• This requires streaming between PC and Sony device• Not or less suitable for mobile devices (Clie)• Additional work compared to Scenario 2:

– Streaming– How to do spatialisation in this set up?– More complex PC SDK/simulation

NSCE

13-Jan-04 14

Scenario 4: High End HIFI component

• No PC involved in the HIFI system• Sony HIFI platform provides all necessary functionalities

but likely in a limited fashion:– Limited resources (CPU/Memory/storage)– pJava or J2ME, no J2SE Java platform– Lack of third party libraries etc.

• Multiple variants possible– Device with own (touch) screen (airboard, airtact with control palet)– Device with display on TV (PS2, PSX,…)

• Additional work compared to scenario 1:– Serious porting/optimization effort– Adapted UI like in scenario 2 & 3 (but architecture may be

different)– SDK/Simulation more complicated than in scenario 3!

NSCE

13-Jan-04 15

Scenario 5: HIFI component + PC ‘CPU’ server

• If the HIFI component in scenario 4 doesn’t have the necessary calculation power etc. => number of operations such as indexing could be done in batch on a PC acting as server and the results would be integrated in the local database

• This will obviously limit the real-time functionalities of the HIFI system

• Further variant of Scenario 4/5 could be ‘low-end’ HIFI system:– Only small LCD or Crystal Display– No Java– …

NSCE

13-Jan-04 16

Short term objectives

WP 8 in principle only starts at M5 (m 18) but nevertheless we will:

• Get deeper knowledge on functionalities proposed by various parties as preparation towards Market & User Requirements study for such an intelligent HIFI system

• Explore possibilities/constraints of various HIFI scenarios– Scenario 1 & 2 seem most realistic within the project constraints

• Prototype on basis of CUIDADO Music Browser– Architecture– UI variants (see also activities planned by Sony CSL in WP3)

• Obtain architectural requirements from various functional working groups for platform architecture (input from WP 1.2 but also 2,3,4,5)

NSCE

13-Jan-04 17

NSCE’s involvement in other WPs

WP 1.2 (6m): participate in Specification & Architectural Design

WP 4 (6m): How to support spatialization on HIFI system

WP 7 (3m): Adaptation of sharing system to HIFI system & Sony Home Network