Music and video - Laneros.com

Developers guidelines

August 2007

Music and videoin Sony Ericsson phones

Developers guidelines | Music and video in Sony Ericsson phones

2 August 2007

This document is published by Sony Ericsson Mobile Communications AB, without any warranty*. Improvements and changes to this text necessitated by typographical errors, inaccuracies of current information or improvements to programs and/or equipment, may be made by Sony Ericsson Mobile Communications AB at any time and without notice. Such changes will, however, be incorporated into new editions of this document. Printed versions are to be regarded as temporary reference copies only.

*All implied warranties, including without limitation the implied warranties of merchantability or fitness for a particular purpose, are excluded. In no event shall Sony Ericsson or its licensors be liable for incidental or consequential damages of any nature, including but not limited to lost profits or commercial loss, arising out of the use of the information in this document.

These Developers guidelines are published by:

Sony Ericsson Mobile Communications AB, SE-221 88 Lund, Sweden

Phone: +46 46 19 40 00Fax: +46 46 19 41 00www.sonyericsson.com/

© Sony Ericsson Mobile Communications AB, 2006. All rights reserved. You are hereby granted a license to download and/or print a copy of this document.Any rights not expressly granted herein are reserved.

10th edition (August 2007)Publication number: EN/LZT 108 8835 R10A

Preface

Purpose of this document

This document covers the media parts of the Sony Ericsson mobile phones enabling media producers to get a quick overview of the media functionality of Sony Ericsson products, with emphasis on video.


3 August 2007

Sony Ericsson Developer World

On www.sonyericsson.com/developer, developers find documentation and tools such as phone White papers, Developers guidelines for different technologies, SDKs (Software Development Kits) and relevant APIs (Application Programming Interfaces). The Web site also contains discussion forums monitored by the Sony Ericsson Developer Support team, an extensive Knowledge base, Tips and tricks, example code and news.

Sony Ericsson also offers technical support services to professional developers. For more information about these professional services, visit the Sony Ericsson Developer World Web site.

Trademarks and acknowledgements

Symbian is a trademark or a registered trademark of Symbian Ltd.

IrDA is a trademark or a registered trademark of the Infrared Data Association.

Bluetooth is a trademark or a registered trademark of Bluetooth SIG Inc. and any use of such mark by Sony Ericsson is under license.

Real is a trademark or a registered trademark of RealNetworks, Inc. Real™ is included under license from RealNetworks, Inc. Copyright 1995-2007, RealNetworks, Inc. All rights reserved.

WALKMAN is a trademark or a registered trademark of Sony Corporation.

Memory Stick, Memory Stick Duo, Memory Stick PRO Duo, Memory Stick Micro and M2 are trademarks or registered trademarks of Sony Corporation.

MicroSD and Transflash are trademarks or registered trademarks of SanDisk Corporation.

Microsoft and Microsoft Windows are either registered trademarks or trademarks of Microsoft Corpora-tion in the United States and/or other countries.

MusicDJ and VideoDJ are trademarks or a registered trademarks of Sony Ericsson Mobile Communica-tions AB.

Java and all Java-based marks and logos are trademarks or registered trademarks of Sun Microsystems, Inc. in the U.S. and other countries. End-user license agreement for Sun Java platform, Micro Edition. Restrictions: Software is confidential copyrighted information of Sun and title to all copies is retained by Sun and/or its licensors. Customer shall not modify, decompile, disassemble, decrypt, extract, or other-wise reverse engineer Software. Software may not be leased, assigned, or sublicensed, in whole or in part.Export Regulations: Software including technical data, is subject to U.S. export control laws, including the U.S. Export Administration Act and its associated regulations, and may be subject to export or import reg-ulations in other countries. Customer agrees to comply strictly with all such regulations and acknowledges that it has the responsibility to obtain licenses to export, re-export, or import Software. Software may not be downloaded, or otherwise exported or re-exported (i) into, or to a national or resident of, Cuba, Iraq,

www.sonyericsson.com/developer


4 August 2007

Iran, North Korea, Libya, Sudan, Syria (as such listing may be revised from time to time) or any country to which the U.S. has embargoed goods; or (ii) to anyone on the U.S. Treasury Department's list of Specially Designated Nations or the U.S. Commerce Department's Table of Denial Orders. Restricted Rights: Use, duplication or disclosure by the United States government is subject to the restric-tions as set forth in the Rights in Technical Data and Computer Software Clauses in DFARS 252.227-7013(c) (1) and FAR 52.227-19(c) (2) as applicable.

Other product and company names mentioned herein may be the trademarks of their respective owners.

Document conventions

Products

Sony Ericsson mobile phones are referred to in this document using generic product names. Actual phone model names may also include one of the letters i, a or c, designating targeted market areas. For example, the phone referred to as K510 in this document, actually come in three models K510i, K510a and K510c each having slightly different features to match market requirements.

Note that most Sony Ericsson phones may be customized to fit requirements from operators who market and sell the phones. Thus, features implemented in the generic phone model, may not be working in the same phone model, purchased from a network operator.

Generic namesSeries

Sony Ericsson mobile phones

K310 K310i, K310c, K310a

K320 K320i, K320c

K510 K510i, K510c

K530 K530i

K550 K550i, K550c

K600 K600i, K608i

K610 K610i, K610c, K618i

K750 K750i, K750c, D750i

K770 K770i

K790 K790i, K790c, K790a

K800 K800i, K800c

K810 K810i, K818c

K850 K850i, K858c

M600 M600i, M608c


5 August 2007

P1 P1i, P1c

P990 P990i, P990c

S500 S500i, S500c

T650 T650i, T658c

V600 V600i

W200 W200i, W200c

W300 W300i, W300c

W550 W550i, W550c

W580 W580i, W580c

W600 W600i

W610 W610i, W610c

W660 W660i

W700 W700i, W700c

W710 W710i, W710c

W800 W800i, W800c

W810 W810i, W810c, W810a

W830 W830i, W830c

W850 W850i, W850c

W880 W880i, W888c

W900 W900i

W910 W910i, W908c

W950 W950i, W958c

W960 W960i

Z520 Z520i, Z520c, Z520a

Z525 Z525a

Z530 Z530i, Z530c

Z550 Z550i, Z550c, Z550a

Z558 Z558i, Z558c

Z610 Z610i

Z710 Z710i, Z710c

Z750 Z750i, Z750c

Generic namesSeries

Sony Ericsson mobile phones


6 August 2007

Abbreviations

3GPP 3rd Generation Partnership Project

AAC Advanced Audio Coding

AMR Adaptive Multi-Rate (NB = NarrowBand, WB = WideBand)

DRM Digital Rights Management

DVB-H Digital Video Broadcast - Handheld

EDGE Enhanced Data GSM Environment.

ETSI European Telecommunications Standards Institute

GPRS General Packet Radio Service

GSM Global System for Mobile communications

HTML Hypertext Markup Language

MIDI Musical Instrument Digital Interface

MIME Multimedia Internet Message Extensions

MMS Multimedia Messaging System

NF3 NetFront v3.x

OMA Open Mobile Alliance

OTA Over The Air

Pod Portable Device

PSS Packet Switched Streaming

RDS Radio Data System

RMF Rich Music Format

RSS Rich Site Summary or Really Simple Syndication

SDK System Developer Kit

SMIL Synchronized Multimedia Integration Language

SMS Short Message System

TFT Thin Film Transistor

UBC Ultra Bright Colour

UMTS Universal Mobile Telecommunications System

USB Universal Serial Bus


7 August 2007

Document history

xHTML Extensible Hypertext Markup Language

XML eXtensible Markup Language

Change history

2006-06-01 Version R1A First version published on Developer World

2006-07-12 Version R1B Revised edition. Minor changes

2006-07-13 Version R1C Revised edition. Codecs section updated

2006-08-31 Version R2A Second edition. Codecs section updated. Information about the K618i and the Z610 series added

2006-09-28 Version R3A Third edition. Information about W830, K320 and Z558 series, and the Z550a added

2006-11-24 Version R3B Third, revised edition. Codec parameters added

2007-01-08 Version R4A Fourth edition. Information about the W200 series added

2007-02-06 Version R5A Fifth edition. Information about the W880, K550, W610 and K810 series added

2007-03-13 Version R6A Sixth edition. Information about the W660 series added

2007-03-27 Version R7A Seventh edition. Information about the W580 and Z750 series added

2007-05-08 Version R8A Eighth edition. Information about the T650, S500 and P1 series added

2007-06-14 Version R9A Ninth edition. Information about the K530, K850, W910 and W960 series added

2007-08-21 Version R10A 10th edition. Information about the K770 series added


8 August 2007

Contents

Overview ......................................................................................................................9

General .......................................................................................................................10Media transfer and storage .....................................................................................11

OTA (Over The Air) ...............................................................................................11Local connectivity ................................................................................................12Streaming and downloading ................................................................................13DRM and Sony Ericsson ......................................................................................15

General media support in Sony Ericsson phones ...................................................16Browsers ..............................................................................................................16Media transfer over MMS ....................................................................................17Developing media applications with Java™ Platform, Micro Edition ..................18Developing media applications with C++ ............................................................18

Technical specifications ...........................................................................................20Mobile phones, technical data ................................................................................21

Hardware .............................................................................................................21Media software ....................................................................................................22Networks, local connectivity and external storage ..............................................22

Codecs ....................................................................................................................24Audio codecs supported in Sony Ericsson mobile phones .................................24Video codecs supported in Sony Ericsson mobile phones .................................26

Supported MIME types for MMS ............................................................................28Audio MIME types ...............................................................................................28

Video MIME types ...................................................................................................30Streaming video recommendations ........................................................................30

Wireless network limitations ................................................................................31Streaming server considerations .........................................................................31Configuration for firewall/NAT .............................................................................32


9 August 2007

Overview

Sony Ericsson offers the ultimate media phones. They are powerful entertainment machines which hold the latest in technology. This paper is aiming at giving content providers and media developers an over-view of the video functionality in Sony Ericsson mobile phones. The document is divided into two major parts, general and technical. The general part contains for example transfer modes, browsers, RSS-feeds, MMS (Multimedia Messaging), DRM (Digital Rights Management), in addition to Mobile TV and Java. There is also an overview of the Sony Ericsson specific media applications.

In the technical part, media developers get a quick overview of what MIME types, codecs and file formats are supported by the phones covered in the document.


10 August 2007

General

The general part of the document is intended to give an overview of the technologies and tools used to transfer video from producers to consumers and allow phone users to enjoy them.


11 August 2007

Media transfer and storage

Sony Ericsson phones offer several ways to send and receive media files and streaming media, both via global networks and via locally connected computers or networks.

OTA (Over The Air)

The network used for phone calls may also be used for data traffic in general, which also implies that it can be used to transfer media to the phone. Depending on phone model, different mobile network sys-tems can be used.

GSM/GPRSGSM (Global System for Mobile communication) is a digital mobile telephone system that is widely used in Europe and other parts of the world. GSM digitizes and compresses data, then sends it down a channel with two other streams of user data, each in its own time slot. It operates at either the 850 MHz, 900 MHz, 1800 MHz or 1900 MHz frequency band.

GPRS (General Packet Radio Services) provides a virtual constant connection to the Internet and the speed needed for satisfactory Internet usability, 56 Kbps. It also allows for simultaneous voice and data communication, so the user can still receive incoming calls or make outgoing calls while in the midst of a data session.

EDGEEDGE (Enhanced Data GSM Environment), a faster version of the GSM (Global System for Mobile) wire-less service, is designed to deliver data at rates up to 384 Kbps and enable the delivery of multimedia and other broadband applications to mobile phone and computer users.

UMTS (3G)The third generation mobile telephone system, 3G, gets the user an Internet connection resembling broadband connection, with speeds up to 384 Kbps when a device is stationary or moving at pedestrian speed, 128 Kbps in a car, and 2 Mbps in fixed applications. This enables streaming video and the users to be connected to the Internet at all times. The technique is called UMTS (Universal Mobile Telecommunica-tions System).

Examples of 3G services are:

• LBS (location-based service) providing device location using A-GPS (assisted-global positioning ser-vice)

• Media-on-Demand which includes streaming and downloading of audio and video content• Application Downloading facilitating wireless downloads of applications to mobile devices• Video calls where users can see and hear each other in real or near real time• Peer-to-Peer messaging applications such as Instant Messaging (IM) and MMS (Multimedia Messag-

ing System)• Internet and Business connection that allow users to connect to Internet in general as well as connec-

tion to Business key applications behind the company firewall.


12 August 2007

Local connectivity

Bluetooth™ wireless technologyBluetooth™ wireless technology is a short-range radio technology that lets you connect devices without cables. It has been implemented, in the form of a Bluetooth chip and related software, into most Sony Ericsson phones and many accessories. The technology enables a secure wireless mini network between different Bluetooth devices, within a standard range up to 10 meters, but the long range is up to 100 meters. The data transfer rate is 1 Mbps. Unlike IR (Infrared port) connection the devices do not need to be in line of sight with each other.

Bluetooth wireless technology is also used for sharing game play between several phones and accessing external devices like the Sony Ericsson MMV-series. Many Sony Ericsson phones also support remote control of certain Microsoft® Windows® applications via Bluetooth wireless technology.

IR (Infrared port)Most Sony Ericsson mobile phones, laptops, PDAs and other handheld units have an IR port. IrDA (Infra-red Data Association) is a point-to-point communication link between two infrared ports. The IR port is used to transfer and exchange pictures and other files with another IR port equipped device. The IR port is also often used when the mobile phone is used as a modem connecting, for example, a laptop to the Internet. Just like Bluetooth wireless technology, IR is a short-range radio technology, with the difference that the infrared beam has to be directed towards the target infrared port and as long as the two infrared ports are within sight and range, the devices can exchange data.

USB (Universal Serial Bus) transfer and mass storageA USB cable allows easy connection of the mobile phone to a computer. Via the USB connection, syn-chronization of address books, updating and downloading applications to the mobile phone and transfer-ring media files like pictures and music is enabled.

Some mobile phones can also be charged via the USB port. Most mobile phones covered in this docu-ment supports plug and play when connected to a computer and if the phone has a memory card this will show as a mass storage device on the computer.

USB has different transfer rates:

• Low Speed - up to 1,5 Mbps• Full Speed - up to 12 Mbps• Hi-Speed - up to 480 Mbps

USB 1.1 maximum transfer rate is up to 12 Mbps, and USB 2.0 maximum transfer rate is up to 480 Mbps.

Wireless LANWireless LAN is available in the P1, P990 and W960 series.

Wireless Local Area Network (WLAN) is a network access technology becoming increasingly common around the world. It allows users with portable computers and wireless devices to access network resources wirelessly, at the office, in the home, or in public spaces.

WLAN may be used as an alternative to any of the other types of network connection, such as USB, GSM, UMTS, Bluetooth™ connectivity or infrared.


13 August 2007

The WLAN functionality in the P1, P990 and W960 series is compliant with IEEE 802.11b (11 Mbps), and works simultaneously with the GSM, UMTS, Bluetooth connectivity and infrared interfaces.

Memory Stick™Many Sony Ericsson phones are equipped with a Memory Stick™ slot to allow flexible extra memory to be used. Depending on phone model, Memory Stick Duo™, Memory Stick Pro Duo™ and Memory Stick Micro™ (M2™) are all used to store pictures, music, games and other data. These Memory Stick models are compatible with other Sony Memory Stick compatible consumer products, for example Sony digital cameras, camcorders, portable music players, TVs, photo printers and computers. They are developed especially for mobile phones and built-in applications like the Walkman™ player can access media directly from Memory Sticks.

Sony Ericsson mobile phones follow the file system layout that is recommended by the Memory Stick organisation for pictures and sound. This ensures interoperability with all devices following the same standard. Connecting a phone equipped with a Memory Stick Duo, Memory Stick PRO Duo or Memory Stick Micro™ (M2™) to a computer makes the phone visible as an external drive. The Memory Stick PRO Duo can store up to 4GB of data and the Memory Stick Micro™ (M2™) stores up to 2GB of data when used in Sony Ericsson phones.

Streaming and downloading

Streaming mediaStreaming is a method for making music, video, radio and other multimedia available in real-time or near real-time, in different types of networks. Streaming to computers has been used for a number of years. With the introduction of faster mobile networks such as GPRS, EDGE and 3G, streaming has also been utilized in mobile phones.

The name "streaming" refers to the technique it is based on. Previously it was necessary to download an entire file to a computer hard disk or a mobile phone memory, and then play it. Through streaming, the user can begin to watch or listen to the contents of a requested media file after only a short delay. The data in the file is split into small packets that are sent in a continuous flow, a stream, to the end user com-puter or mobile phone. The user can begin viewing or listen to the contents in the first packets, while the rest of them are still being transferred. The short delay at the start is due to the time it takes for the client to buffer a small amount of data. The data buffer also makes it possible for the client to play the video or sound without interruption, even if the rate of received data varies slightly.

Applications for streaming services can be divided into "live" and "on-demand" information delivery appli-cations. The live information delivery applications are broadcast in a specific time frame, whereas the on-demand service is sent when the user initiates it. Receiving of radio and television broadcasting are exam-ples of the first category. Examples of the second category are music and video, news-on-demand appli-cations, and on-demand instructional material.

Sony Ericsson supports the architecture, protocols and codecs of PSS (Packet Switched Streaming) within the 3GPP (3rd Generation Partnership Project) system, as well as supporting all ongoing standardi-zation activities within 3GPP. Sony Ericsson works constantly to follow standards and to ensure interoper-ability between business solutions, while at the same time endeavouring to meet additional market requirements within this area. The relevant 3GPP specification is TS 26.234, "Transparent end-to-end packet switch streaming service (PSS)". The PSS includes media codecs for video, still images, bitmap graphics, text, audio, and speech.


14 August 2007

Downloaded mediaWhereas streamed media is aiming at making media available in real-time, downloaded media allows the user to bring and enjoy the media wherever. The media is stored locally on the mobile phone, in the built-in memory or on a memory card. Downloaded media has also a much wider range than streamed media, since it could be still pictures, themes, ringtones, as well as video or audio.

Transfer method selection is more flexible for downloading than for streaming. Downloaded files could be transferred to the phone via all the different connectivity modes explained earlier this document. This gives the user greater possibilities to choose the preferred or most suited transfer method. There are cases though when this is limited by the media provider.

Note: The K600, K750, V600, W700, W800, W810, Z520 and Z525 series of phones support the WTP pro-tocol, which limits the size of downloaded files to ~300 kB. This limitation can be avoided by setting an Internet profile using the HTTP protocol instead, in which case the size of downloaded files is limited only by available user memory in the phone. All other phones in this document do not support the WTP proto-col and use HTTP by default, therefore allowing unlimited download file sizes. However, gateways and proxy servers may also limit the maximum size of downloaded files, due to operator or service provider settings.

Downloaded files often have a need to be copyright protected and might have other copyright issues. Sony Ericsson has a DRM (Digital Rights Management) solution defined by the OMA (Open Mobile Alli-ance), described in the DRM and Sony Ericsson section of this document.

Progressive downloadNote: The K600, K750, M600, P1, P990, V600, W700, W800, W810, W950, W960, Z520 and Z525 series of phones do not support progressive download.

Downloading large media files can take quite long time. For the user to be able to start listening to/viewing the media as soon as possible, progressive download may be used in many Sony Ericsson phones. Dur-ing download, playback can start as soon as a certain amount of data has been buffered in phone mem-ory. This way the user may, for example, watch a video while it is still being downloaded.

When downloading starts from the Netfront 3.3 or 3.4 Web browser in Sony Ericsson phones, and the MIME type of the media file to download supports it, progressive download is automatically used.

Java applications can also be designed for progressive download via the File Connection API (JSR-75) when MMAPI (JSR-135) is used for media playback. For more information see “Developers guidelines Java ME CLDC (MIDP 2)”, found on Sony Ericsson Developer World.

Note: The progressive download technique is similar to the one used for streaming media. The main dif-ference is that downloaded media is contained in a file which is saved in the phone when downloading is complete, which is not the case with streaming media.

PodcastingPodcasting is the distribution of audio and video files, such as radio programs or music videos over the Internet for listening or viewing on mobile devices. A subset of Podcast is Vodcast (Video on demand), which refers to distribution of video files. The term podcast can refer to both the content and the method of delivery. The subscription feed is what distinguishes a podcast from a simple download or real-time streaming. Usually a podcast features one show with new episodes at sporadic or planned intervals.

http://developer.sonyericsson.com


15 August 2007

The subscription and download is implemented with RSS (Really Simple Syndication) feeds. RSS is described later in this document and is a part of two of the Web browsers used in Sony Ericsson mobile phones, NetFront ver. 3.3-3.4 and Opera 8. Podcasting via RSS is supported in Sony Ericsson phones with the NetFront ver 3.4 browser.

Mobile TVCurrently, only the K530, K550, K770, K810, K850, S500, T650, W580, W610, W660, W710, W830, W850, W880, W910, Z710, Z750, and late releases of the K790 and K800 phones support Mobile TV. In these phones, the NetFront browser allows a web page to contain an embedded window where a video can be viewed.

Sony Ericsson phones with NetFront browser version 3.4 also support podcasts, using RSS feeds for sub-scription and delivery.

In the future other options will be available for watching TV and video on the mobile phone.

• Video can be streamed to the phone in which case no data will be stored in the phone.• Another alternative is called IP Datacasting, referring to the one transmitter to many receivers technol-

ogy, where any digital content can be delivered over broadcast networks to large audiences at the same time. Several different methods are under development and testing, for example DVB-H (Digital Video Broadcast - Handheld), which is based on the technology used for TV broadcasting over the dig-ital terrestrial net. DVB-H will require designated receivers in the mobile phones, since it is not using of the GSM, EDGE or UMTS networks.

DRM and Sony Ericsson

DRM (Digital Rights Management), is a technology that enables secure distribution, promotion and sales of digital music and other media. The purpose of DRM is to make it possible to protect digital content by the means of limited usage and DRM is one of the success factors for 3G, in which operators and content providers need a method to sell content that cannot be freely distributed between devices. The type of DRM described in this document is that defined by the Open Mobile Alliance (OMA) standards.

Sony Ericsson is actively focusing on technology standardization for the DRM concept and is fully com-mitted to open standard solutions in the mobile environment. This will ensure the interoperability of mobile terminals in the DRM area and also result in a strong, competitive DRM standard at the earliest possible stage. An open standard will limit a fragmented market where manufacturers support different DRM solu-tions. Non-standard solutions, where content providers and operators have to develop parallel infrastruc-tures that support different DRM solutions, will slow down the market development. It will also create interoperability issues for content providers. The OMA DRM standards will limit the need to support multi-ple DRM solutions.

The scope of OMA DRM is to enable the controlled consumption of digital media objects by allowing con-tent providers to express usage rights, for example, the ability to preview DRM content, to prevent down-loaded DRM content from being illegally forwarded (copied) to other users, and to enable super distribution of DRM content. Any image or theme in the phone can be sent to another phone by selecting the Send option on the object.

Using DRM, usage rights can be defined for all types of content. Different rights can be applied to the same content for different users. Here are some examples of rights that can be controlled with DRM:

• the number of times it can be used, for example, a game can be played five times


16 August 2007

• the period it can be used, for example, until 31st December 2004• the length of time it can be used, for example, two weeks or one day.

This control enables content providers to create sophisticated subscription and pay-per-use models. This is clearly a benefit for content creators (for example the graphic designer that creates a new wallpaper), content providers (who make the content available to the user), network operators, and everyone else involved. It will also stimulate the mobile content based services. Sony Ericsson DRM solutions have been developed with these success factors in mind.

OMA DRM versions 1.0 and 2.0There are two versions of DRM implementation in the Sony Ericsson mobile phones; OMA v1.0 and OMA v2.0. The differences between the versions are the security level in DRM content transportation, receiving rights objects and the constraints set on the content by the provider. Another difference that affects the user is the possibility to share DRM content between different media devices.

All phones in this document fully support OMA DRM, v1.0. Parts of the OMA DRM v2.0 specification (ROAP protocol and content format) are supported in K530, K550, K770, K850, S500, T650, W580, W610, W660, W710, W830, W850, W880, W910, Z610, Z710 and Z750 phones.

Sony Ericsson DRM PackagerThe Sony Ericsson DRM Packager, is a PC software tool which enables third party content providers/developers to protect their content. This tool focuses only on the packaging capability of content protec-tion. The DRM Packager comes in two versions:

• A graphical stand-alone application for Windows® and Mac OS® X• A command line utility for Windows, Mac OS X, Linux and Solaris.

The platforms supported are Windows 2000/XP, Mac OS X 10.3, Linux libc6 and Solaris 8.

General media support in Sony Ericsson phones

Browsers

Sony Ericsson browser 4.0-4.2The Sony Ericsson browser is using standard web technologies such as HTML (Hypertext Markup Lan-guage) and CSS (Cascading Style Sheets). It also allows media download services using the OMA Down-load standard.


17 August 2007

NetFront™ v3.3 and v3.4 browserThe NetFront™ (NF3) browser engine includes support for WAP 2.0, WML, HTML 4.01, XHTML and CSS2. The browser uses Rapid-Render™, which is an incremental rendering technology that significantly accel-erates the presentation of Web pages, and Smart-Fit Rendering™, a rendering technology that intelli-gently renders Web pages to fit the screen width of mobile devices, eliminating the need for horizontal scrolling.

Opera 8 browserWith the Opera 8 browser, users of Sony Ericsson Symbian™ 9 / UIQ 3 phones can surf the full Internet from their devices. This version of Opera includes well-known features such as tabbed browsing, a pass-word manager and URL auto-completion, made popular in the Opera desktop browser. Advanced fea-tures such as SSR (Small-Screen Rendering) technology, plus its speed and ability to access the full Internet, make Opera the ideal solution for browsing on the go.

Browsers in Sony Ericsson phones

For more information on the Sony Ericsson and NetFront browsers, see the browsing Developers guide-lines, found at http://developer.sonyericsson.com/site/global/docstools/browsing/p_browsing.jsp.

RSSRSS (Really Simple Syndication) is a XML (eXtensible Markup Language) based format that has been standardized for on-line subscriptions. For example, a Podcast is a subscription of media files that can be fulfilled via RSS. Podcast media files are specifically created for portable media devices, like mp3-players or modern mobile phones.

In Sony Ericsson mobile phones, the NetFront v3.3 - v3.4 and Opera 8 browsers support RSS. In phones using the Sony Ericsson browser v. 4.0-4.2, an additional RSS reader is used where RSS is supported.

Media transfer over MMS

MMS is intended not only for phone users to send messages to other people. It can also be used for dis-tribution of newsflashes, music, video clips or other media to Sony Ericsson mobile phone users. Using the Wireless Application Protocol (WAP) as bearer technology, MMS (Multimedia Messaging System) allows content providers to send media straight to the users.

MMS messages may include any combination of text, graphics, photographic images, speech and music clips or video sequences. High-speed transmission technologies EDGE, GPRS and UMTS enable power-ful messaging applications. An MMS message consists of a "slide show" style presentation that can include images, video clips, text and sound.

Browser Phone series

Sony Ericsson browser K600, K750, V600, W800, Z520, Z525

NetFront™ v 3.3 K310, K320, K510, K530, K550, K610, K770, K790, K800, K810, S500, T650, W200, W300, W550, W580, W600, W610, W660, W710, W810, W830, W850, W880, W900, Z530, Z550, Z558, Z610, Z710

NetFront™ v 3.4 K850, W910, Z750

Opera 8 M600, P1, P990, W950, W960

http://developer.sonyericsson.com/site/global/docstools/browsing/p_browsing.jsp


18 August 2007

MMS messages can be composed using the mobile phone, a PC, or any other device with the appropriate MMS software. MMS messages can also be automatically generated by a service or content provider.

MMS is implemented on top of WAP 1.2.1, but WAP 2.0 is required in the phone for sending MMS over http. Most mobile phones on the market, including all Sony Ericsson mobile phones in this document, support MMS messages up to at least 100 kByte (for many newer phones more than 300 kByte), including header information and payload. Note, however that network limitations may also restrict the maximum message size.

MMS messages use a subset of the SMIL (Synchronized Multimedia Integration Language), an XML pro-tocol, as presentation language. SMIL can control both timing and layout of the MMS message. The actual appearance of the presentation depends on the characteristics of the receiving device, just like a HTML page can appear differently on different browsers and on different computers.

Due to limitations in backwards compatibility, support for more advanced SMIL presentation in MMS is limited to the MMS SMIL subset specified by OMA when sending MMS from Sony Ericsson phones. For received messages, the SMIL functionality in most Sony Ericsson phones has been extended to allow more advanced presentations to be received and presented.

For more information on the MMS implementation and functionality in Sony Ericsson phones, study the MMS Developer guideline, found at http://developer.sonyericsson.com/site/global/docstools/messaging/p_messaging.jsp.

Developing media applications with Java™ Platform, Micro Edition

Java™ ME offers great possibilities for end-users, network operators and content providers. There is vir-tually no limit to the content that can be supplied and downloaded.

To help developers to adapt applications for a multitude of phones, Sony Ericsson has adopted a Java platform strategy for its mobile phones. There are two main Java platform paths for Sony Ericsson Java™ ME enabled phones, one for its Symbian OS based phones and another one for its feature and mass-mar-ket phones, that is, the non-Symbian OS based phones. Each platform version is used in several phone models, which is presented in the more technical part of this document and you find the platforms pre-sented and descriptions of the platform features in the Java ME Developers guidelines, at http://developer.sonyericsson.com/.

Java ME can be used to create applications handling various media-oriented tasks, for example, connec-tion to networks (global or local), downloading and playing audio and video. The Java ME Developers guidelines gives a number of examples of these features and how to implement them in Java applications for Sony Ericsson phones.

Developing media applications with C++

Symbian 9 based Sony Ericsson phones also provides a native C++ application development platform.

For development of media applications, the C++ development platform provides the MMF (Multi Media Framework). The MMF client API implements several interfaces that encapsulate a lightweight plugin framework for manipulation of audio and video features.

http://developer.sonyericsson.com/site/global/docstools/messaging/p_messaging.jsp

http://developer.sonyericsson.com/site/global/docstools/messaging/p_messaging.jsp

http://developer.sonyericsson.com/


19 August 2007

For detailed information about the C++ programming environment in Symbian 9 / UIQ 3 phones, see the documentation included with the UIQ 3 SDK, available for download from http://developer.sonyericsson.com/.

MMF provides the following interfaces:

• Audio playing, recording and conversion.This interface consists of three classes, CMdaAudioPlayerUtility, CMdaAudioRecorderUtil-ity and CMdaAudioConvertUtility providing methods to create, play and manipulate audio data stored in files, descriptors and URLs.

• Audio streaming. The two classes CMdaAudioInputStream and CMdaAudioOutputStream provide methods for recording and playing audio streams, for example, audio from a web address.

• Tone playing.The single class CMdaAudioToneUtility provides methods for playing and configuring single and sequenced tones as well as DTMF (Dual Tone Multi-Frequency) strings.

• Video playing and recording. This interface consists of two classes CVideoPlayerUtility and CVideoRecorderUtility pro-viding methods to create, play and manipulate video clips, with or without audio tracks, stored in files, descriptors and URLs.

http://developer.sonyericsson.com/


20 August 2007

Technical specifications

In this section, specifications for the media support in Sony Ericsson phones are listed.


21 August 2007

Mobile phones, technical data

Hardware

Screen colours

Display Phones

65,536 colour UBC (ultra bright colour) K310, K320, W200

65,536-colour TFT Z520, Z530

262,144-colour TFT K510, K530, K550, K600, K610, K750, K770, K790, K800, K810, K850, M600, P1, P990, S500, T650, V600, W300, W550, W580, W600, W610, W660, W700, W710, W800, W810, W830, W850, W880, W900, W910, W950, W960, Z525, Z550, Z558, Z610, Z710, Z750

Screen resolutions

Resolution Phones

128x160 pixel K310, K320, K510, W200, W300, Z530

176x220 pixel K510, K530, K550, K600, K610, K750, V600, W550, W600, W610, W660, W700, W710, W800, W810, Z520, Z525, Z550, Z558, Z610, Z710

240x320 pixel K770, K790, K800, K810, K850, M600, P1, P990, S500, T650, W580, W830, W850, W880, W900, W910, W950, W960, Z750

Polyphonic ringtones

Voices Phones

Polyphonic Sound 40 voices K310, K320, K510, K750, W200, W550, W600, W700, W800, W810, Z520, Z525, Z530, Z550, Z558

Polyphonic Sound 72 voices K530, K550, K600, K610, K770, K790, K800, K810, K850, S500, T650, V600, W580, W610, W660, W710, W830, W850, W880, W900, W910, Z610, Z710, Z750


22 August 2007

Media software

Networks, local connectivity and external storage

Internet browser

Browser version Phones

Sony Ericsson 4.2 K600, K750, V600, W700, W800, Z520, Z525

NetFront v. 3.3 K310, K320, K510, K530, K550, K610, K770, K790, K800, K810, S500, T650, W200, W300, W550, W600, W610, W660, W710, W810, W830, W850, W880, W900, Z530, Z550, Z558, Z610, Z710

NetFront v. 3.4 K850, W910, Z750

Opera 8 M600, P1, P990, W950, W960

Music and video software

Software Phones

Walkman™ Player W200, W300, W550, W600, W580, W610, W660, W710, W800, W810, W830, W850, W880, W900, W910, W950, W960

PlayNow™ K310, K320, K510, K530, K550, K600, K610, K750, K770, K790, K800, K810, K850, M600, P1, P990, S500, T650, W200, W300, W550, W580, W600, W610, W660, W710, W800, W810, W880, W900, W910, W950, W960, Z520, Z530, Z550, Z558, Z610, Z710, Z750

PlayNow Games™ K530, K550, K770, K790, K800, K810, K850, S500, T650, W580, W600, W610, W660, W880, W900, W910, Z750

VideoDJ™ K530, K550, K610, K770, K790, K800, K810, K850, S500, T650, V600, W300, W550, W600, W610, W660, W710, W800, W810, W830, W850, W880, W900, W910, Z530, Z550, Z558, Z610, Z710

MusicDJ™ All phones

Networks

Band Phones

GSM/GPRS Sony Ericsson phones within the scope of this document are either triple-band phones 900/1800/1900 MHz or 850/1800/1900 MHz depending on targeted market area, or quad-band phones 850/900/1800/1900 MHz, intended for all market areas.


23 August 2007

EDGE K550, K790, S500, W300, W580, W600, W610, W710, W810, W830, Z710, Z750 series, and the K858c and W908c models

UMTS K600, K610, K770, K800, M600, P1, P990, W660, W850, W900, W950, Z610 and Z750 series, and the K810i, K850i, T650i, W880i and W910i phone models (note that the K818c, K858c, T658c, W888c and W908c models are not UMTS phones).Note: K850i, W910i and Z750 also support HSDPA.

Local connectivity

Feature Phones

Bluetooth Wireless Technology K320, K510, K530, K550, K600, K610, K750, K770, K790, K800, K810, K850, M600, P1, P990, S500, T650, V600, W300, W550, W580, W600, W610, W660, W700, W710, W800, W810, W830, W850, W880, W900, W910, W950, W960, Z520, Z525, Z530, Z550, Z558, Z610, Z710, Z750

Infrared K310, K320, K510, K550, K600, K750, K790, K800, K810, M600, P1, P990, V600, W200, W300, W550, W600, W610, W700, W710, W800, W810, W830, W850, W900, W950, W960, Z520, Z525, Z530, Z550, Z558, Z710

WLAN (Wireless Local Area Network)

P1, P990, W960

External storage

Memory cards supported Phones

Memory Stick PRO Duo W800 (512 MB included), W810 (512 MB included), W830 (1GB included), W850 (1GB included), W900 (512 MB included)

Memory Stick Micro™ (M2™) K530, K550, K610 (64MB or 256 MB included), K770 (256 MB included), K790, K800, K810 (128 MB included), K850 (256 MB included), M600, P1 (512 MB included), P990, S500, T650, W200 (128 MB included), W300 (256 or 512 MB included), W580 (512 MB included), W610 (512 MB included), W660, W710 (512 MB included), W880 (1GB included), W910 (1GB included), Z530, Z550, Z558, Z610 (64MB included), Z710 (64MB included), Z750 (128 MB included)

SanDisk microSD™/Transflash™ memory card

K850


24 August 2007

Codecs

A codec (enCOder/DECoder or COmpressor/DECompressor) is a program that compresses and decom-presses audio or video data. The reason for using codecs is to reduce the size of audio and video data to speed up transmission and reduce the needed storage space.

Most codecs are lossy, that is, some of the original data is lost in the compression process, and can not be restored when decompressing. There are lossless codecs as well, but they are mostly used for interme-diate storage when data is to undergo more processing.

There is always a balance between the size of the compressed data and the quality loss that can be accepted. However when working with media to be used in mobile phones, some loss of quality always has to be accepted, due to the limited transfer speeds and storage size in the phones.

Data compressed with a codec is stored in a container file, holding not only the encoded/compressed data, but also metadata, for example specifying what codec is used, and settings parameters needed for decompression.

A container format is a computer file format that can contain various types of data, compressed in a man-ner of standardized codecs. The container file is used for identification and interleave setting (a value specifying how often the audio and video streams are "synchronized"). Examples of containers are: WAV (RIFF file format), AVI (the standard Microsoft Windows container), ASF (standard container for Microsoft WMA and WMV) and MOV (standard QuickTime container).

Audio codecs supported in Sony Ericsson mobile phones

Y = Yes (Decoding), N = No

Codec Description K600, K750, V600, W800, Z520

K310, K320, K510, W200, W300, W550, W600, W810, W900, Z530, Z550, Z558

K530, K550, K610, K770, K790, K800, K810, S500, T650, W580, W610, W660, W710, W830, W850, W880, Z610, Z710

M600, P1, P990, W950, W960

K850, W910, Z750

WAV Wave format, PCMUp to 1536 kbit/s

Y Y Y Y Y

AAC / AAC LC Advanced Audio CodingLocal + streaming: up to 192 kbit/s, CBR and VBR

Y Y Y Y Y

AAC+ Local + streaming: up to 128 kbit/s, CBR and VBR

N YK310, K320, K510=N

Y Y Y


25 August 2007

eAAC+ enhanced AAC+Local + streaming: up to 128 kbit/s, CBR and VBR

N N Y Y Y

MP3 MPEG-1 layer 3,MPEG-2 layer 3,MPEG-2.5 layer 3Local only: up to 320 kbit/s, CBR and VBR

Y Y Y Y Y

WMA 8 Windows Media Audio 8Local + streaming: Class 1, up to 192 kbit/s

N N Y N Y

WMA 9 Windows Media Audio 9Local + streaming: Level 2, up to 161 kbit/s@48 kHz, 320 kbit/[email protected] kHz

N N Y NW950=Y

Y

Real™Audio RealAudio 8Local + streaming: "Gecko" up to 96 kbit/s, "Sipro" up to 16 kbit/s

Y Y Y N Y

RealAudio 9 N N N Y N

iMelody (ringtones)

Y Y Y Y Y

AMR(-NB) Adaptive MultiRate - Narrow BandLocal + streaming: 4.75-12.2 kbit/s

Y Y Y Y Y

AMR-WB Adaptive MultiRate - Wide BandLocal + streaming: 6.6 -23.85 kbit/s

N YK310, K320, K510, W200=N

Y N Y

SP-MIDI (ringtones)

Scalable Polyphony Y Y Y Y Y

G-MIDI (ringtones)

General MIDI Y Y Y Y Y

XMF Extensible Music Format Y Y Y Y Y


K310, K320, K510, W200, W300, W550, W600, W810, W900, Z530, Z550, Z558


M600, P1, P990, W950, W960

K850, W910, Z750


26 August 2007

Video codecs supported in Sony Ericsson mobile phones

Y = Yes (Decoding), N = NoQVGA (Quarter VGA) = 320x240 px; QCIF (Quarter CIF) = 176x144 px

DLS (ringtones)

audio/midi Y (partly)

Y (partly) Y (partly) Y Y (partly)

RMF (ringtones)

audio/x-midi N N N Y N

AU (ringtones)

audio/mid N N N Y N


K310, K320, K510, W200, W300, W550, W600, W810, W900, Z530, Z550, Z558


M600, P1, P990,W950, W960

K850, W910, Z750

H.263 Profile 0 level 10Local + streaming: QVGA@15 fps, QCIF@30 fps, 128 kbit/s

Y Y Y Y Y

Profile 0 level 45Local + streaming: QVGA@15 fps, QCIF@30 fps, 128 kbit/s

N Y Y N Y


Y YK310, K320, K510=N

Y Y Y


N Y Y N Y


K310, K320, K510, W200, W300, W550, W600, W810, W900, Z530, Z550, Z558


M600, P1, P990, W950, W960

K850, W910, Z750


27 August 2007

MPEG-4 Part 2, Visual Simple profile

Level 0Local + streaming: QVGA@15 fps, QCIF@30 fps, 128 kbit/s

Y Y Y Y Y

Level 0bLocal + streaming: QVGA@15 fps, QCIF@30 fps, 128 kbit/s

Y Y Y Y Y


N NW900=Y

N N Y


N NW900=Y

N Y Y


N NW900=Y

N Y Y

H.264 (MPEG Part 10/AVC), Baseline Pro-fileNote: QVGA is not sup-ported

Level 1Local + streaming: QCIF@15 fps, 128 kbit/s

N N Y NW950=Y

Y

Level 1bLocal + streaming: QCIF@15 fps, 128 kbit/s

N N Y NW950=Y

Y

Level 1.1 N N N N N

Level 1.2 N N N N N

Level 1.3 N N N N N

WMV Windows Media Video 9Local + streaming: QCIF@15 fps, 128 kbit/s

N N Y N Y

RealVideo 8 Local + streaming: QCIF@15 fps NK600=Y

NW900=Y

Y Y Y

RealVideo 9 Local + streaming: QCIF@15 fps N N N Y N


K310, K320, K510, W200, W300, W550, W600, W810, W900, Z530, Z550, Z558


M600, P1, P990,W950, W960

K850, W910, Z750


28 August 2007

Supported MIME types for MMS

Audio MIME types

Y = Yes, N = No, R =Receiving only

MIMEK600, K750, V600, W800,

Z520

K310, K320, K510, W200, W300, W550, W600, W810, W900, Z530, Z550, Z558

K530, K550, K610, K770, K790, K800, K810, K850, S500, T650, W580, W610, W660, W710, W830, W850, W880, W910,

Z610, Z710, Z750

AMR audio/amr Y Y Y

audio/x-amr R R R

AMR-WB audio/amr-wb NK600=Y

NW900=Y

Y

AU audio/basic N N N

WAV audio/wav Y Y Y

audio/x-wav R R R

MP3 audio/mp3 Y Y Y

audio/x-mp3 R R R

audio/mpg R R R

audio/x-mpg R R R

audio/mpeg R R R

audio/x-mpeg R R R

audio/mpg3 R R R

audio/mpeg3 R R R

MP4 audio/mp4 Y Y Y

audio/mp4a-latm N N R

MIDI audio/midi Y Y Y

audio/x-midi R R R

audio/mid R R R

audio/sp-midi R R R

RMF audio/rmf N N N

audio/-x-rmf N N N


29 August 2007

iMelody text/x-iMelody Y Y Y

audio/x-iMelody R R R

audio/iMelody R R R

3GPP audio/3gpp Y Y Y

SMAF application/vnd.smaf N N N

application/x-smaf N N N

XMF audio/mobile-xmf Y Y Y

Real8 audio audio/vnd.rn-realau-dio

NK600=Y

NW900=Y

Y

audio/x-pn-realaudio NK600=R

NW900=R

R

m4a audio/x-m4a NK750=Y

Y Y

RHZ audio/rhz N Y Y

audio/rawhz N Y Y

Windows media

audio/wma N N Y

MIMEK600, K750, V600, W800,

Z520

K310, K320, K510, W200, W300, W550, W600, W810, W900, Z530, Z550, Z558


Z610, Z710, Z750


30 August 2007

Video MIME types

Y = Yes, N = No, S=Sending only, R =Receiving only

Streaming video recommendations

The following content parameters are recommended as a baseline for testing. They should provide excel-lent quality for the screen size and processing power of all Sony Ericsson mobile phones. For testing on specific phone models, content parameters according to the codec tables above may be more appropri-ate.

Supported frame sizes are QCIF (176x144 pixels) and SQCIF (128x96 pixels).

MIMEK600, K750, V600, W800,

Z520

K310, K320, K510, W200, W300, W550, W600, W810, W900, Z530, Z550, Z558


Z610, Z710, Z750

MP4 video/mp4 Y YK310, K320=N

Y

video/mp4v-se R RK310, K320=N

R

video/mpeg4 R RK310, K320=N

R

Packet Video video/x-pv-pvx N N N

3GPP video/3gpp Y Y Y

SDP application/sdp Y Y Y

Real8 videoa

a.Real8 video streaming is not supported in the K600, playback only.

video/vnd.rn-realvideo

NK600=Y

NW900=Y

Y

video/x-pn-realvideo NK600=R

NW900=R

R

Windows media

video/wmv N N Y


31 August 2007

Streaming:

• 32 Kbps, Video MPEG-4 or H.263, QCIF or SQCIF, 15 fps, Audio AMR 12.2 Kbps

• Audio only: AAC, 42 Kbps

Download / local playback:

• 64 Kbps, Video MPEG-4 or H.263, QCIF or SQCIF, 15 fps, Audio AAC 64 Kbps mono

• Short clips (<30 seconds): 64 Kbps total (video with Variable Bit Rate, VBR, with or without audio)

Wireless network limitations

When streaming content is sent over a wireless network, the network capabilities might affect the practical parameter limits of the content.

Sony Ericsson GSM phones are designed for GPRS class 8, 4:1 (4 download and 1 upload time-slots).

Normally the Channel Coding Scheme CS-2 is used for the GPRS network. This scheme specifies a data rate of 13.4 Kbps, which with 4 time-slots, gives the maximum data speed 53.6 Kbps.

If the CS-1 coding scheme is used, the maximum data speed with 4 time-slots is 4 x 9.05 = 36.2 Kbps.

Sony Erisson EDGE enabled phones support EDGE 4+2, Multislot Class 10. Modulation Coding Schemes MCS1- MCS9 are supported, with typical throughput rate of 50 – 120 Kbps.

UMTS throughput rates are under practically no circumstances a limiting factor for streaming video or audio in mobile phones.

Streaming server considerations

Servers for streaming should be compliant with 3GPP Packet-Switched Streaming protocols. The content should consist of 3GPP-compliant .3GP files generated by some compliant authoring tool.

Issues to take into consideration when setting up and testing a server for streaming media:

• Streaming standards supported by the mobile phone clients.

• Streaming video recommendations (see above).

• Proper configuration of Firewall/NAT.

To minimize interoperability problems, it is strongly suggested to select a server that has been through PSS-AG testing.

Information about PSS-AG interoperability testing may be found on http://www.imtc.org/act_pss.htm

http://www.imtc.org/act_pss.htm


32 August 2007

Configuration for firewall/NAT

Firewalls on both the client and server sides introduce complexities into end-to-end video streaming sys-tem deployments that are not present in a direct client-server link environment. Firewall components have evolved from simple packet filters to complex stateful inspection firewalls, and will continue to evolve in the future. It is the carrier's responsibility that any firewall/NAT present in the network be properly config-ured to allow UDP media streams to pass correctly between the server and the client.

The first required action is to be sure that any firewall has opened the ports needed for communication between the mobile phone video player application and the server. On the player side, the following port range must be opened in the firewall:

• Mobile phone video player application: UDP ports 3456 to 3459

In most cases, the video player application will use one port-pair per media stream. So for a simple audio/video presentation, it would use all four ports; 3456-3459, assuming these are not in use by another appli-cation.

On the server side, the port range to open on the firewall will depend on the particular server used and how it is configured.

Port 554 is used for RTSP (Real Time Streaming Protocol) by default.

A second required action is to be sure that any firewall or NAT is RTSP-aware and thus is transparent to the streaming session. A typical problem seen in carrier networks is that the introduction of non-RTSP-aware port remapping prevents the UDP packets from reaching the client. The problem is described in detail in the following IETF Internet draft: http://tools.ietf.org/html/draft-ietf-mmusic-rtsp-nat-03.txt.

If the firewall or NAT is RTSP-aware, then it understands that the port information is sent in RTSP and may thus adjust the port remapping so that it is transparent to both the client and the server.

http://tools.ietf.org/html/draft-ietf-mmusic-rtsp-nat-03.txt

Documents

Music and video - Laneros.com