10
Specifications are subject to change without notice. For further information please contact each office. All Rights Reserved. The contents of this document are subject to change without notice. Customers are advised to consult with FUJITSU sales representatives before ordering. The information, such as descriptions of function and application circuit examples, in this document are presented solely for the purpose of reference to show examples of operations and uses of Fujitsu semiconductor device; Fujitsu does not warrant proper operation of the device with respect to use based on such information. When you develop equipment incorporating the device based on such information, you must assume any responsibility arising out of such use of the information. Fujitsu assumes no liability for any damages whatsoever arising out of the use of the information. Any information in this document, including descriptions of function and schematic diagrams, shall not be construed as license of the use or exercise of any intellectual property right, such as patent right or copyright, or any other right of Fujitsu or any third party or does Fujitsu warrant non-infringement of any third-party's intellectual property right or other right by using such information. Fujitsu assumes no liability for any infringement of the intellectual property rights or other rights of third parties which would result from the use of information contained herein. The products described in this document are designed, developed and manufactured as contemplated for general use, including without limitation, ordinary industrial use, general office use, personal use, and household use, but are not designed, developed and manufactured as contemplated (1) for use accompanying fatal risks or dangers that, unless extremely high safety is secured, could have a serious effect to the public, and could lead directly to death, personal injury, severe physical damage or other loss (i.e., nuclear reaction control in nuclear facility, aircraft flight control, air traffic control, mass transport control, medical life support system, missile launch control in weapon system), or (2) for use requiring extremely high reliability (i.e., submersible repeater and artificial satellite). Please note that Fujitsu will not be liable against you and/or any third party for any claims or damages arising in connection with above-mentioned uses of the products. Any semiconductor devices have an inherent chance of failure. You must protect against injury, damage or loss from such failures by incorporating safety design measures into your facility and equipment such as redundancy, fire protection, and prevention of over-current levels and other abnormal operating conditions. If any products described in this document represent goods or technologies subject to certain restrictions on export under the Foreign Exchange and Foreign Trade Law of Japan, the prior authorization by Japanese government will be required for export of those products from Japan. 2003 FUJITSU LIMITED Printed in Japan FUJITSU LIMITED http://edevice.fujitsu.com/ Japan Marketing Div., Electronic Devices Shinjyuku Dai-ichi Seimei Bldg. 7-1, Nishishinjuku 2-chome, Shinjuku-ku, Tokyo 163-0721 Tel : +81-3-5322-3353 Fax : +81-3-5322-3386 AD07-00038-1E June, 2003 REALOS is trademark of Fujitsu Limited, Japan. axLinux is name of the Linux OS developed and provided by AXE, Inc. DivX is a trademark of DivX Networks, Ins. Microsoft, Windows and Windows Media are either registered trademarks or trademarks of Microsoft Corporation in the United States and/or other countries. Other company names and brand names are the trademarks or registered trademarks of their respective owners. FUJITSU SEMICONDUCTOR Middleware Media Solution North and South America FUJITSU MICROELECTRONICS AMERICA, INC. 1250 E. Arques Avenue, M/S 333 Sunnyvale, CA 94088-3470, USA Tel : +1-408-737-5600 Fax : +1-408-737-5999 http://www.fma.fujitsu.com/ Europe FUJITSU MICROELECTRONICS EUROPE GmbH Am Siebenstein 6-10, D-63303 Dreieich-Buchschlag, Germany Tel : +49-6103-690-0 Fax : +49-6103-690-122 http://www.fme.fujitsu.com/ Asia Pacific FUJITSU MICROELECTRONICS ASIA PTE LTD. #05-08, 151 Lorong Chuan, New Tech Park, Singapore 556741 Tel : +65-6281-0770 Fax : +65-6281-0220 http://www.fmal.fujitsu.com/ Korea FUJITSU MICROELECTRONICS KOREA LTD. 1702 KOSMO TOWER, 1002 Daechi-Dong, Kangnam-Gu, Seoul 135-280, Korea Tel : +02-3484-7100 Fax : +02-3484-7111 http://www.fmk.fujitsu.com/

Middleware - fujitsu.com msm.pdfThe FR-V middleware is optimized to exploit the full range of hardware capabilities in the FR-V Media Solution product provided by Fujitsu. In addition

Embed Size (px)

Citation preview

Specifications are subject to change without notice. For further information please contact each office.

All Rights Reserved.The contents of this document are subject to change without notice. Customers are advised to consult with FUJITSU sales representatives before ordering.

The information, such as descriptions of function and application circuit examples, in this document are presented solely for the purpose of reference to show examples of operations and uses of Fujitsu semiconductor device; Fujitsu does not warrant proper operation of the device with respect to use based on such information. When you develop equipment incorporating the device based on such information, you must assume any responsibility arising out of such use of the information. Fujitsu assumes no liability for any damages whatsoever arising out of the use of the information.

Any information in this document, including descriptions of function and schematic diagrams, shall not be construed as license of the use or exercise of any intellectual property right, such as patent right or copyright, or any other right of Fujitsu or any third party or does Fujitsu warrant non-infringement of any third-party's intellectual property right or other right by using such information. Fujitsu assumes no liability for any infringement of the intellectual property rights or other rights of third parties which would result from the use of information contained herein.

The products described in this document are designed, developed and manufactured as contemplated for general use, including without limitation, ordinary industrial use, general office use, personal use, and household use, but are not designed, developed and manufactured as contemplated (1) for use accompanying fatal risks or dangers that, unless extremely high safety is secured, could have a serious effect to the public, and could lead directly to death, personal injury, severe physical damage or other loss (i.e., nuclear reaction control in nuclear facility, aircraft flight control, air traffic control, mass transport control, medical life support system, missile launch control in weapon system), or (2) for use requiring extremely high reliability (i.e., submersible repeater and artificial satellite).Please note that Fujitsu will not be liable against you and/or any third party for any claims or damages arising in connection with above-mentioned uses of the products.

Any semiconductor devices have an inherent chance of failure. You must protect against injury, damage or loss from such failures by incorporating safety design measures into your facility and equipment such as redundancy, fire protection, and prevention of over-current levels and other abnormal operating conditions.

If any products described in this document represent goods or technologies subject to certain restrictions on export under the Foreign Exchange and Foreign Trade Law of Japan, the prior authorization by Japanese government will be required for export of those products from Japan.

2003 FUJITSU LIMITED Printed in Japan

FUJITSU LIMITEDhttp://edevice.fujitsu.com/

Japan Marketing Div., Electronic DevicesShinjyuku Dai-ichi Seimei Bldg.7-1, Nishishinjuku 2-chome, Shinjuku-ku, Tokyo 163-0721Tel : +81-3-5322-3353 Fax : +81-3-5322-3386

AD07-00038-1E June, 2003

REALOS is trademark of Fujitsu Limited, Japan. axLinux is name of the Linux OS developed and provided by AXE, Inc. DivX is a trademark of DivX Networks, Ins. Microsoft, Windows and Windows Media are either registered trademarks or trademarks of Microsoft Corporation in the United States and/or other countries.Other company names and brand names are the trademarks or registered trademarks of their respective owners.

FUJITSU SEMICONDUCTOR

Middleware

Media Solution

North and South AmericaFUJITSU MICROELECTRONICSAMERICA, INC.1250 E. Arques Avenue, M/S 333Sunnyvale, CA 94088-3470, USATel : +1-408-737-5600Fax : +1-408-737-5999http://www.fma.fujitsu.com/

EuropeFUJITSU MICROELECTRONICS�EUROPE GmbHAm Siebenstein 6-10, �D-63303 Dreieich-Buchschlag,�GermanyTel : +49-6103-690-0 Fax : +49-6103-690-122http://www.fme.fujitsu.com/

Asia PacificFUJITSU MICROELECTRONICSASIA PTE LTD.#05-08, 151 Lorong Chuan,New Tech Park,Singapore 556741Tel : +65-6281-0770Fax : +65-6281-0220http://www.fmal.fujitsu.com/

KoreaFUJITSU MICROELECTRONICSKOREA LTD.1702 KOSMO TOWER,1002 Daechi-Dong,Kangnam-Gu, Seoul135-280, KoreaTel : +02-3484-7100Fax : +02-3484-7111http://www.fmk.fujitsu.com/

Audio/videoaccessories

In-Vehicleaudio/video accessories

Internet printers

IP videophones

Digital video cameras

Digital camerasHome servers

Media PDAs

Surveillance cameras

Silicon viewers

The FR-V middleware is optimized to exploit

the full range of hardware capabilities in the

FR-V Media Solution product provided by

Fujitsu. In addition to a basic codec for media

processing including MPEG-1, MPEG-2,

and MPEG-4, it provides a rich suite of

products, including higher-level audio/video

recorder and audio/video player libraries.

These products give customers the tools to

embed media processes into their products

with ease.

ContentsWhat is the FR-V Media Solution?………………3Features of the FR-V Middleware…………………4Audio/Video Recorders and Audio/Video Players…5MPEG Visual Codec………………………………7Audio/Voice Codec………………………………11Still Picture Libraries……………………………132D Graphics Libraries……………………………15List of the FR-V Middleware Products…………17

1 2

middleware

A/V Player/RecorderMPEG-4

Visual

MPEG-2 ML

MPEG-1

JPEG

2D GraphicsWindows MediaTM

Video

Windows MediaTM

Aud io

ATRAC 3

MP3

MPEG -2/4 AA C

Fujitsu FR-V middleware for embedded use to meet a wide variety of media processing needs through advanced programming technologies

ADPCM(G.726)

Software solutions that ensure advanced functionality, high performance, and high quality.

We offer our rich variety of libraries developed by highly efficient program for embedded use. Depending on the users' purposes, they can be applied in flexible combinations to achieve a wide range of functions.

All middleware products achieve high-performance software solution that has been fully tuned to use of an FR-V processor. This optimized middleware and powerful FR-V processors realize hiher-quality image and sound.

A wide range of middleware products reduce development costs and time.

Our versatile range of middleware products include basic codecs such us for MPEG-1, MPEG-2, and MPEG-4 as well as libraries for audio/video recorders and players. These products enable easy incorporation of middleware functionality into customer products, enabling customers to reduce development costs and time.

Our software solution allows customers to conform their products to a new standard or upgrade them according to their new system simply by replacing the software.

Adopts an industry standard operating system to take full advantage of existing assets.

The FR-V middleware runs on Fujitsu's REALOS that is a real-time operating system compliant with Japanese embedded industry-standard µITRON specification. It also runs on Linux that is an industry-standard as open source software, therefore the customers can utilize their own applications and other assets.

From customization to system integration

Our staff specialists support customers' hardware, software and service from planning to development up to mass production. With this wide range of support including customization up to system integration consulting, customers can use our middleware products without any concern.

Features of the FR-V Middleware

FR-V Media Solution consists of hardware, software, and service.We provide an integrated platform consisting of high-performance media processing CPU FR-V processors, companion chips, boards equipped with peripheral devices, an operating system, device drivers, and FR-V middleware.To provide detailed support for customer from product planning up to the stage of volume production, we offer solution in which service products are added to the platform.

What is the FR-V Media Solution?

3 4

PlanningPlanning Development Massproduction

Hardware• CPU• Companion chips• Boards

Software• Operating system• Device drivers• Middleware

Platform

Service

Media Solution

Customers

Fujitsu

Total support

Audio/Video Recorder and Audio/Video Player

5 6

Trick Play (Audio/Video Player)

A wide range of player functions make it easy to incorporate various trick play functions such as play and stop.• Normal play, stop, and pause• Fast forward and rewind of I-picture search• Playback speed control�

(double, standard, 1/2 time, 1/4 time, �and 1/8 time speeds)

*Specifying a playback speed other than standard results in playback of the video image only.

The original image size of the video data stream can be enlarged or reduced for playback.• 200% enlargement or 50% reduction of

image size can be specified

Enlargement and Reduction Function (Audio/Video Player)

This function shows how much time passed since playback of the stream started and how much time is necessary tocomplete playback of the entire stream. With this function, customers can develop a playback progress bar or somethingthat shows playback progress status.• Information regarding time passed since stream playback started / total time to complete the stream playback can be acquired.

Playback Progress Status (Audio/Video Player)

Voice Control (Audio/Video Player)

This function supports bilingual streams and enables voice control that minimizes POP noises by filtering voice output at start and at end with software.• Switching between main and sub-voices, main voice only, and sub-voice only�• Mute on/off function�• Handy POP noise reduction function

Audio/videorecorders

n-times speedencoding

Customerapplications

Customerapplications

Various codecs

FR-V processors

Various codecs

FR-V processors

Audio/videoplayers

Trick play functionEnlargement/reduction

function

Table 1. Compatible Middleware and File Formats

Common Interface

Fast Encoding (Audio/Video Recorder)

Our audio/video recorder and player offer a variety of middleware library products (video, audio, and voice) and the interface common to various file formats (such as MP4). This allows customers to make expand product functionality without major modifications of existing applications, even in the event of a revised or new standard.

Our audio/video recorder realizes an encoding system with greater than 1x speed if it's a stored resource, with the high-processing FR-V processors and the high-speed middleware encoders.

Video

Audio

Voice

File format

MPEG-4 Visual SP

MPEG-2/4 AAC-LC

ADPCM (G.726)

MP4

MPEG-1, MPEG-4 Visual SP

MPEG-1 LayerI/II, MPEG-2/4 AAC-LC, MP3

ADPCM (G.726)

MP4, MPEG-1 System

Audio/Video Recorder Audio/Video Player

Features of the Audio/Video Recorder and Player

Product Specifications

Compatible codec

Compatible file format

System stream information

Video stream information

Audio stream information

Recording and playback

function

Recording and playback

information

Video input/output

Audio input/output

Audio mode switching

ROM capacity

RAM capacity

Operating environment

Compatible operating system

Audio/Video recorder

Video: MPEG-4 Visual SP

Audio: MPEG-2/-4 AAC-LC

Voice: ADPCM (G.726)

MP4

Recording start time, recording time

Image size/aspect ratio, frame rates, bit rates, picture structure

Channel configuration, sampling rates, and bit rates

Recording

Recording capacity notification

Approx. 480KB

Approx. 1.7MB*2

FR400 series

REALOSTM*3, axLinux*4

Audio/Video player

Video: MPEG-1, MPEG-4 Visual SP

Audio: MPEG-1 Layer I/II, MP3, MPEG-2/-4 AAC-LC

Voice: ADPCM (G.726)

MPEG-1 System, MP4

File format identification, time information

Image size/aspect ratio, frame rates, bit rates

Channel information, sampling rates, and bit rates

Normal play, pause, stop, fast forward, fast rewind,

double-speed play*1, and slow play (1/2, 1/4, and 1/8 time)*1

Playback progress time

50%, 100%, and 200% enlarged/reduced displays

Mute function

Handy POP noise reduction function using data filtering

Switching between main and sub-voices, main voice only,

and sub-voice only

Approx. 280KB

Approx. 1.7MB*2

*1: For a double-speed or slow-speed playback, only the video image is playbacked.*2: Approx. 1.7MB does not include the audio/video input/output buffer. When using MP4 in the audio/video recorder, a capacity of +356 × recording time (seconds) bytes is required in addition.*3: REALOS is a Fujitsu's real-time operating system compliant with µITRON 4.0 .*4: axLinux is the name of the Linux developed and supplied by AXE, Inc.

We offer audio/video recorder and audio/video player products so that customers can install the interface common to various codecs such as MPEG-1/-4, AAC, and ADPCM when developing applications. This allows customers to realize more efficient application development and easier functional expansion.

MP4

Audio/video recorders and players

Customer's applications

Common interface

Audio File format

MP3 AAC ADPCM

VoiceVideo

MPEG1

MPEG4

Trick play Voice control

*This is a product image. As GUI (Graphical User Interface) functionality is not included in this product, customers need to develop it by themselves if necessary.

Enlargement andReduction

Playback progress status

384Kbps bit rate 2Mbps bit rate

MPEG Visual Codec

* : Stream data that has been encoded at a high bit rate of 384Kbps or more requires a decoder supporting a bit rate of 384Kbps or more.

Responding quickly to the demand for high image quality (higher resolution and higher bit rates), we provide a functional expansion of MPEG-4 Visual Simple Profile (SP) (supporting higher bit rates) and our own proprietary algorithms to achieve high image quality. We also have MPEG-1 and MPEG-2 decoder products. In addition, we plan to introduce products compliant with MPEG-4 Visual Advanced Simple Profile (ASP), DivX, Windows Media Video, or H.264 standards. Supporting various codecs like this is an advantage of our software solution with middleware based on FR-V as its core. Moreover, this software-based middleware solution can flexibly meet customers' functional requirements and customization to create winning products together with customers.

MPEG-4 Visual Encoder and Decoder

High performanceThe FR-V processor's powerful media instructions are capable of performing the high-speed operation essential for image processing. These powerful operational instructions allow high-speed performance of processes such as motion estimation, motion compensation, and DCT/IDCT (discrete cosine transform/inverse discrete cosine transform) and encoding and decoding at very small CPU loads. This enables real-time processing under the following conditions, even with MPEG-4 AAC running simultaneously.

Handling higher bit rates (encoder)In addition to 384Kbps, the upper limit bit rate of the MPEG-4 Visual Simple Profile (ISO/IEC14496-2) standard bit rate, the MPEG-4 visual encoder supports bit rates of up to 2Mbps for high quality image . We can also provide custom solutions to handle bit rates to 2Mbps or more.

Conditions: With FR400 series MB93403, Stream ITE No. 16, and MPEG-4 AAC are running concurrently

Bit rate control function (encoder)Our proprietary bit-rate control algorithm is capable of accurate, automatic detailed bit rate control - for example, allocating fewer bits to a video scene with relatively stable content and more bits to a video scene with many movements, even in cases where the number of bits assignable within a certain time is fixed, as with constant bit rates (CBR). This permits high image quality even in scenes with a high rate of change.

Error concealment function (decoder)Our decoder products are even capable of handling bit errors or packet loss in streaming data. For example, when a packet loss occurs in a transmission line and the error concealment function is enabled, the decoders retrieve image information from a preceding frame near the frame area from which packets were lost to conceal the error parts. This enables extremely, high-quality video images.

Scene analysis and scene change detection function (encoder)The FR-V processors are capable of high-speed operations of sum-of-square differences. This means MPEG-4 visual encoder can instantly calculate differences between current and previous frames to accurately detect scene changes. When the first frame of a scene change detected at this time is allocated to an I-picture (I-VOP), disturbances in a video image at the scene change are eliminated for smooth scene transitions. Moreover, because the encoder can adjust the sensitivity of detecting a scene change, the user can make detailed user setup according to input video images.

7 8

High image quality

: I-picture. It holds data of one screen.

: P-picture. It holds only data for differences between preceding and succeeding frames.

P

I

Our encoder accurately detects a scene change and processes it with I-picture.

P P P I P P

Video image withrelatively stable content

Video image withmany movements

30 frames/second

Bit

rate

Fewer bits

More bits

Network transmission line

Transmission side Receiving side

Error concealmentfunction enabledPacket Packet

Packet

Packet loss takes place

* : This is an optional function. Note that enabling this function will reduce decoding performance somewhat. Customers can enable or disable this function, depending on their system requirements.

Deblocking filter (decoder)Usually, MPEG data encoded at a low bit rate generates block noise during decoding. The deblocking filter can remove this block noise by using it as a posttreatment of decoding.

Deblocking filterOFF

Deblocking filterON

Encoding performance

Decoding performance

QVGA 1Mbps 15fps, CIF 128Kbps 15fps, QCIF 128Kbps 30fps

QVGA 2Mbps 30fps, CIF 512Kbps 30fps, QCIF 128Kbps 30fps

Note: The images on this page are intended to illustrate typical effects.

Image size bit rate, and frame rate This decoder can decode various image sizes, including SQCIF, QCIF, CIF, QVGA, and VGA. In addition, it supports a wide range of bit rates, frame rates, and other parameters, giving you the power to reproduce stream data of various image sizes, bit rates, and/or frame rates.

Frame-by-frame processingWe offer an API that decodes MPEG video frames on a frame-by-frame basis. This makes it possible for the decoder to detect picture type, allowing you to extract only a single I-picture of high-quality video image for printing or for use as a thumbnail.

ResponseOur libraries can convert the number of video buffer planes into a parameter, which can be set to suit your system. This realizes the system that minimizes response time between an instruction to begin playback and the actual video display (The response time is approx. 1/30 second if a data stream at 30 fps is buffered for a portion of one frame).

* : Setting a low number of buffer planes may result in missing frames when decoding a video image under high processor loads.

Load distribution function (encoder)System design needs to be done by taking account of load distribution according to the system in order to do encoding while multiple applications run concurrently. Our libraries can implement this functionality by inserting NOT_CODED (the instruction for using the previous block or frame in the event there are no differences in video data between current and previous blocks or frames) on a macro-block or frame-by-frame basis to reduce encoding loads.

MPEG-2 MP@ML Decoder

Image size bit rate, and frame rateThis decoder can decode various image sizes including SQCIF, QCIF, CIF, QVGA, and VGA. In addition, it supports a wide range of bit rates, frame rates, and other parameters, giving you the power to reproduce stream data of various image sizes bit rates, and/or frame rates.

Frame-by-frame processingWe offer an API that decodes MPEG video frames on a frame-by-frame basis. This makes it possible for the decoder to detect picture type, allowing you to extract only a single I-picture of high-quality video image for printing or for use as a thumbnail.

ResponseOur libraries can convert the number of video buffer planes into a parameter that can be set to suit your system. This realizes the system that minimizes response time between an instruction to begin playback and the actual video display (The response time is approx. 1/30 second if a data stream at 30 fps is buffered for a portion of one frame).

* : Setting a low number of buffer planes may result in missing frames when decoding a video image under high processor loads.

Product Specifications

Complies with the MPEG-2 standard (ISO/IEC 13818-2)

The decoder can extract only an I-picture (I-VOP) of fine image to do video printout, etc.

P P P P P P P PI

(MPEG-4 video frames):I-picture PI :P-picture

9 10

Complies with the MPEG-1 standard (ISO/IEC 11172-2)

MPEG-1 Decoder

Image size bit rate, and frame rate (encoder and decoder)With these MPEG-4 visual encoder/decoder, various image size (16 × 16 to 8191 × 8191) such as size of SQCIF, QCIF, CIF, QVGA, or VGA standard can be set. You can also set bit rates (32Kbps to 2Mbps), frame rates (1 fps to 60 fps), and other parameters .

Response Real-time capability is a key ingredient of interactive two-way communication products. Our libraries can convert the number of video buffer planes into a parameter, which can be set to suit your system. This realizes the system that minimizes response time between an instruction to begin playback and the actual video display (The response time is approx. 1/30 second if a data stream at 30 fps is buffered for a portion of one frame).

* : Setting a low number of buffer planes may result in missing frames when decoding a video image under high processor loads.

A rich feature set

*1: Up to 384Kbps due to the MPEG-4 SP standard. However, the MPEG-4 visual encoder and decoder support bit rates of up to 2Mbps for high image quality. We can also provide custom solutions to handle bit rates higher than 2 Mbps.

*2: When constrained_parameter_flag = 1, the bit rate is 1.856Mbps or less according to the standard.*3: The RAM size shown is provided when the image size is 320 × 240, vrfb = 3, and the deblocking filter is enabled.*4: The RAM size shown is provided when the image size is 320 × 240.*5: REALOS is a Fujitsu's real-time operating system compliant with µITRON 4.0 .

MPEG-4 SP decoder

Elementary stream

YUV 4:2:0 Frame Planer

16 to 8191 pixels

16 to 8191 lines

ROM 100KB/RAM 460KB*4

Deblocking filter

MPEG-1 decoder

ISO/IEC11172-2

Elementary stream

YUV 4:2:0 Frame Planer

16 to 768 pixels

16 to 576 lines

Up to 1.5Mbps*2

1 to 30 fps

ROM 32KB/RAM 470KB*4

FR400 series

MPEG-2 decoder (MP@ML)

ISO/IEC13818-2

Elementary stream

YUV 4:2:0

Field Planer/Frame Planer

16 to 720 pixels

16 to 576 lines

Up to 15Mbps

1 to 60 fps

FR550 series

MPEG-4 SP encoder

YUV 4:2:0 Frame Planer

Elementary stream

16 to 1920 pixels (16 pixels basis)

16 to 1088 lines (16 lines basis)

ROM 120KB/RAM 460KB*3

1) Single pass CBR

2) Variable packet size

3) Channel switching

32Kbps to 2Mbps*1

1 to 60 fps

FR400 series

REALOSTM*5, axLinux

MPEG-4 Visual Simple Profile (ISO/IEC14496-2)

Specifications

Decoding/coding system

Input format

Output format

Number of horizontal pixels for picture

Number of vertical lines for picture

Bit rate

Picture rate

Resources

Other

Operating environment

Compatible operating system

Frame-by-frame processing (decoder)We offer an API that decodes MPEG video frames on a frame-by-frame basis. This allows users (for example) to extract only a single high-quality I-picture (I-VOP) of a favorite scene for printing or for use as a thumbnail.

Our audio/voice codec is compatible with various standards including MPEG-2/-4 AAC LC, MPEG-1 layer I/II, MP3, and ADPCM, allowing you to efficiently develop application systems for portable audio equipment, terrestrial digital broadcasting/satellite broadcasting receivers, music distribution on the Internet, and other applications. This audio/voice codec is capable of high-speed encoding and decoding with high sound quality, even with a high efficient but compact program. The MPEG-2/-4 AAC LC encoder uses proprietary algorithms to achieve optimum compression encoding processing and sound quality. For the future, we will reinforce product differentiation based on our proprietary algorithms, with the goal of creating appealing products and introducing them in a timely manner. We also plan to offer middleware compatible with Windows MediaTMAudio, ATRAC3 and AMR.

The MPEG-1 Audio Layer I/II decoder is capable of decoding audio streams of ISO/IEC11172-3 standard-compliant MPEG-1 audio layers I/II at high speed and with high sound quality.• Because the MPEG-1 Audio Layer I/II decoder accepts a various ways of audio stream inputs, they

adopt memory input for input means.• Environment-independent memory management�

(libraries can be run in a wide range of environments, since they use user-provided memory allocation and memory deallocation functions.)

• Audio frame-basis decoding (easily dealing with audio streams transmitted in real-time)

Audio/Voice Codec

MPEG-2/-4 AAC LC Encoder/Decoder MPEG-1 Audio Layer I/II Decoder

• Header format: — ADTS (Audio Data Transport Stream) — ADIF (Audio Data Interchange Format) — Without header• Sampling frequency: 24/32/44.1/48kHz• Number of channels for coding (decoder only): — 5.1 channels maximum (5 channels + LFE (Low Frequency Enhancement) • Down mix (decoder only): — Audio information can be down-mixed from 3 - 5.1 channels to 2 channels.

The encoding/decoding performed by the MPEG-2/-4 AAC LC Encoder and Decoder meets the requirements of ISO/IEC14496-3 and the ISO/IEC13818-7 Low Complexity (LC) Profile. These middleware solutions enable high-quality, real-time music playback/recording.

• Realizing world's highest-speed encoding• High compression and high sound quality tuning depending on bit rates• These encoder/decoder incorporates our proprietary algorithms (swithing to optimum window length

switching and bit distribution) for low noise and high-quality sound.

Analog signal Audio signal (time domain)

Mapping conversionand psychologicalsensory analysis

Quantization Coding

Inverse mappingconversion

Inversequantization Decoding

Encoder

Decoder

Accumulated media/communication line

Overview of specifications

11 12

• CRC (Cyclic Redundancy Check) protection• Bilingual: main voice and sub-voice• Bit rate: fixed (CBR)• Number of quantized bits: 16bits• Memory data — Encoder: ROM: 104KB (library size) RAM: 190KB — Decoder: ROM: 130KB (library size) RAM: 130KB

Comparison of Encoding Performance(Music data of 44.1kHz, 128Kbps, and 4 minutes)

PC: Pentium II-800MHz Windows 2000 Minimum RAM: 192MB

FR-V: CPU: FR400 series MB93403

Encoding conditions: 128Kbps/44.1kHz/Stereo

Fujitsu (FR-V)

Fujitsu (PC)

Company A (PC)

Company B (PC)

Company C (PC)

1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 (times)Fast Slow

Note: The performance comparison is done by converting into MHz.

Minimum Requirements

Achieving high sound qualityin any environment

• Input format: 8-bit µ-law PCM/8-bit A-law PCM/ 14-bit uniform PCM• Output format: 16/24/32/40Kbps• Memory data: ROM: 20KB (library size) RAM: 500B

• Output: 16-bit signed integer type/32-bit signed integer type• Memory data: ROM: 18KB (library size) RAM: 30KB

The MP3 decoder can decode MP3 (MPEG audio layer III)-compliant audio streams at high speed and high-quality sound.

The ADPCM Encoder/Decoder performs encoding and decoding in compliance with the ITU-T Recommendation G.726 and ITU-T Recommendation G.726 Annex A standards. This middleware allows you to process high-quality audio data regardless of user environment.• Concurrent processing of compression and decompression• Supports diverse input/output formats• Flexible settings for audio data arrangements and processing sequences

• Sampling frequency: 8kHz• Data input/output interface: — Provides functions that process sampling data one by one for compression or decompression. — Input/output of audio data is processed only by arguments and return values of functions.

MP3 Decoder

ADPCM Encoder/Decoder

• Sampling frequency: 24/32/44.1/48kHz• Number of channels: 2 channels (stereo)• Bit rates: 32 to 448Kbps (layer I) 32 to 384Kbps (layer II)

• Output: 16-bit, signed integer type/32-bit, signed integer type• Memory data: ROM: 85KB (library size) RAM: 100KB

• Sampling frequency: 24/32/44.1/48kHz• Number of channels: 2 channels (stereo)• Bit rates: 32 to 384Kbps

Overview of specifications

Overview of specifications

Overview of specifications

CPU: Fujitsu FR400 seriesOS: REALOSTM, axLinux

Operating Environment

MPEG Layer-3 audio coding technology licensed from Fraunhofer IIS and Thomson multimedia.

Complies with the JPEG standardThis library complies with the JPEG baseline process (DCT-based) specifications (ITU-T T.81, ISO/IEC10918-1), international standards for encoding of color still pictures, and are therefore data compatible with other JPEG-compliant image equipment.

High-speed compression/decompression processingThe processing speed achieved when the FR400 Series MB93403 (266MHz) performs encoding and decoding (24-bit RGB to YUV 4:1:1 and vice versa) of a still picture with VGA size (640 × 480 pixels) at 6% is as high as 52 ms for encoding and 50 ms for decoding.

A quantization table and Huffman table can be set as desired.Allows flexible control of image quality and compression rates according to the uses of a product to be developed.

Divided decoding is possible.Pictures can be devided and decoded on an MCU basis or specified bytes basis. This can reduce of required memory resources, enabling other processes to run while image decoding is performed. Since any decoding units can be set, this library is easily used on existing systems. Since the library is compatible with JPEG hardware IP decoding units, switching from JPEG hardware IP to this library is easy.

Still Picture Libraries

JPEG Baseline Encoder/Decoder Library

This library complies with the GIF standard (Graphics Interchange Format Version 89a Programming Reference). Thus, it is data compatible with other image equipment compliant with the GIF standard.

It is capable of decoding an image by dividing in smaller units. This enables use with applications even under low memory resource conditions.

This library complies with the TIFF 6.0 standard (TIFF Revision 6.0 Final - June 3, 1992).*1 Thus, it is data compatible with other image equipment compliant with the TIFF standard.

As with the GIF decoder library, it is capable of decoding an image by dividing in smaller units. This enables use with applications even under low memory resource conditions.

Multi-page images can be loaded into the library.

Provides functions capable of acquiring tag information. This allows use of user-defined tag information.

Saves system resources by high-efficient compact program. The required ROM size is 48KB.*2

*1: Supports only non-compression format of the TIFF 6.0 standard. *2: Not including image display memory and stack size.

Supports GIF animation format.

Supports interlaced loading.

Supports transparent images.

Saves system resources by high-efficient compact program. The required ROM size is 38KB.*2

*1: To use the GIF decoder library, you must obtain licenses for the image compression patent (LZW license), which is held by Unisys of the United States.

*2: Not including image display memory and stack size.

GIF Decoder Library*1

TIFF Decoder Library

13 14

Low compression(High image quality)

Medium compression (Medium image quality)

High compression(Low image quality)

Decoding can be performed at an arbitrary position.*1

Supports input and output function of extended APPn marker segments defined in the JFIF format, Exif standard, DCF standard, and G3 fax standard.Saves system resources by high-efficcient compact program. The required ROM size is 30KB or less for both encoder and decoder.*2

*1: Availabl only for the pictures encoded by this library. *2: Not including image display memory and stack size.

JPEG image Divided decoding Reproduced image

CPU: Fujitsu FR400 series OS: REALOSTM, axLinux

Operating Environment

Divided decoding

Quantization

Huffman coding

Interlace GIF

Multi-page image

The process of replacing signals sampled at specific frequency with data of a specified number of bits.

Encoding method that assigns shorter codes to information occurring more frequently and longer codes to information occurring at relatively low frequencies.

One of the GIF formats for displaying an image by first displaying a low-quality image, then improving this image over time.

Method for storing multiple images in a single file.

Explanation of Terms

We offer industry-standard JPEG codec and GIF/TIFF decoders. Compact packaging to be embedded as well as motion JPEG and animation GIF by the high-speed processing optimized for the FR-V processors. In addition, more effective drawing function can be realized by the combination with the 2-Dimension graphics library, and the functions corresponding to the customer product specification can be easily embedded in a short period of time.

Nearest neighbor

Bilinear

Bi-cubic

You can change the display position, sizes, and orientation of image data when displaying images or characters. The 2D Graphics Library allows you to make changes on a frame-by-frame basis to create your own animations, or display JPEG/MPEG codec output onto the screen according to screen layout. You can also select image interpolation processing to improve image quality when adjusting image dimensions or orientation.

Supports various image data formatsThe 2D Graphics Library outputs drawing graphics and image data according to a specified image data format. These products realize portions of a process dependent on hardware such as the image data format as independent modules. Simply replacing these modules lets you run applications on various hardware. The standard library modules support nine image data formats, including those displayable using FR400 companion chips. They also allow the customers to create their own modules.

Use of various font dataThese products implement independent modules that search for font data by character code and convert this data into character-drawing dot patterns. Creating these modules allows the customers to use any font data in character drawing. (Note: The products contain no font data.)

Use of logical coordinate systemsThe 2D Graphics Library allows logical, two-dimensional coordinate systems to be defined in a rectangular area at the drawing destination. This allows users to develop applications regardless of locations or sizes of a physical display region on the screen layout.

API for graphical data renderingThe 2D Graphics Library is provided with not only the function of converting drawing procedures into programs and making drawing by caling a series of elemental functions with single functionality, but also the function of converting a set of graphics data to be drawn into input parameters to make drawing. The latter functionality can be used in developing applications that perform various external data-based drawings without modifying programs.

Flexible Image Representation (Enlargement, Reduction, and Turning)

Inverse

Reduction Enlargement

Adjusting image sizes is easy - justspecify the sizes desired after the transformation.

Examples of three types of image interpolation forenlargement(the area of a clock in the image at the left is turned and enlarged)

The following minimum system resources are required to run the 2D Graphics Library.

2D Graphics Library

15 16

The 2D Graphics Library provides a rich set of graphics drawing functionality and high-quality image data manipulating functions. The 2D Graphics Library allows easy achievement of a functionality with graphical interfaces in a variety of equipment and devices the customers develop and design.

Merely call the functions to create a menu screen or graphical data-display screens.Image data can be enlarged, reduced, and/or rotated to fit the display screen.In conjunction with the JPEG/MPEG codec, this library can display video images in flexible screen layouts.

A wide range of graphic drawing capabilities offer diverse representations:

ROM size (program size)

RAM size

30KB to 154KB (depending on functions used)

20KB (not including the frame buffer size)

A Rich Set of Two-dimensional Graphic Drawing Capabilities Other Features

Resource Capacities Required

Imagequality

CPU: Fujitsu FR400 seriesOS: REALOSTM, axLinux

Operating Environment

Straight line

Circle

Points

Polygon

Arc

Rectangle

Fan

Paint

Logicalcomputation

Tile

Line style

Color specification

Filling

Thick line

Frame drawing

Mask

Continued straight lines

Ellipse

Tertiary Bezier curve

Filling color Drawing color

Background color

One degree-basisturning angle

Rotation

17 18

Audio/Video Players or RecordersCompatible

OS

REALOSTM

axLinux

REALOSTM

axLinux

Product number

Evaluation License

SP366244818EVJ

SP406244918EVJ

SP366244618EVJ

SP406244718EVJ

Basic License

SP366244818QAJ

SP406244918QAJ

SP366244618QAJ

SP406244718QAJ

Target License

SP366244818RCJ

SP406244918RCJ

SP366244618RCJ

SP406244718RCJ

Maintenance

SP366244818MAJ

SP406244918MAJ

SP366244618MAJ

SP406244718MAJ

Still Picture LibrariesCompatible

OS

REALOSTM

axLinux

REALOSTM

REALOSTM

Product number

Evaluation License

SP366241118EVJ

SP366243718EVJ

**

Basic License

SP366241118QAJ

SP366243718QAJ

**

Target License

SP366241118RCJ

SP366243718RCJ

**

Maintenance

SP366241118MAJ01

SP366243718MAJ01

**

FR-V Middleware Operating EnvironmentCPU: Fujitsu FR400 seriesOS: REALOSTM, axLinux

ServicesWe offer customization of our middleware products to meet the specifications required for customer products. We also offer consulting on tuning customer software applications or actual tuning services.

CustomizationConsultingTuning service

* : Contact our sales representative for product numbers available.

Product Name

JPEG Baseline Process Encoder/

Decoder Library �

JPEG Baseline Process Encoder/

Decoder Library

TIFF Decoder Library for FR400 V01

GIF Decoder Library for FR400 V01

Product Name

Media Recorde Master Library for

FR400 V01

Media Recorde Master Library for

FR400(axLinux) V01

Media Play Master Library for FR400 V01

Media Play Master Library for

FR400 (axLinux) V01

List of the FR-V Middleware Products

2D Graphics LibrariesCompatible

OS

REALOSTM

axLinux

Product number

Evaluation License

SP366241518EVJ

SP406245018EVC

Basic License

SP366241518QAJ

SP406245018QAC

Target License

SP366241518RAJ

SP406245018RAC

Maintenance

SP366241518MAJ

SP406245018MAC

Product Name

2D Graphics Library for FR400 V01

2D Graphics Library for FR400 (axLinux)

V01

MPEG Visual CodecsCompatible

OS

REALOSTM

axLinux

REALOSTM

axLinux

REALOSTM

Product number

Evaluation License

SP366242818EVJ

SP366242918EVJ

SP366241918EVJ

SP366242718EVJ

SP366241618EVJ

Basic License

SP366242818QAJ

SP366242918QAJ

SP366241918QAJ

SP366242718QAJ

SP366241618QAJ

Target License

SP366242818RCJ

SP366242918RCJ

SP366241918RCJ

SP366242718RCJ

SP366241618RCJ

Maintenance

SP366242818MAJ01

SP366242918MAJ01

SP366241918MAJ01

SP366242718MAJ01

SP366241618MAJ

Product Name

MPEG-4 Visual Simple Profile Encoder

Library for FR400 V01 �

MPEG-4 Visual Simple Profile Encoder

Library for FR400 (axLinux) V01

MPEG-4 Visual Simple Profile Decoder

Library for FR400 V01

MPEG-4 Visual Simple Profile Decoder

Library for FR400 (axLinux) V01

MPEG-1 Decoder Library for FR400 V01

(incl. DEMUX, Video, Audio Layer I/II)

File FormatsCompatible

OS

REALOSTM

axLinux

Product number

Evaluation License

SP366245118EVJ

SP406245218EVJ

Basic License

SP366245118QAJ

SP406245218QAJ

Target License

SP366245118RCJ

SP406245218RCJ

Maintenance

SP366245118MAJ

SP406245218MAJ

Product Name

MP4 File Format Library for FR400 V01

MP4 File Format Library for

FR400 (axLinux) V01

Audio/Voice CodecsCompatible

OS

REALOSTM

axLinux

REALOSTM

axLinux

Product number

Evaluation License

SP366243418EVJ

SP366244118EVJ

SP366243318EVJ

SP366244018EVJ

Basic License

SP366243418QAJ

SP366244118QAJ

SP366243318QAJ

SP366244018QAJ

Target License

SP366243418RCJ

SP366244118RCJ

SP366243318RCJ

SP366244018RCJ

Maintenance

SP366243418MAJ01

SP366244118MAJ01

SP366243318MAJ01

SP366244018MAJ01

Product Name

MPEG-4/2 AAC LC Encoder Library for

FR400 V01 �

MPEG-4/2 AAC LC Encoder Library for

FR400 (axLinux) V01

MPEG-4/2 AAC LC Decoder Library for

FR400 V01

MPEG-4/2 AAC LC Decoder Library for

FR400 (axLinux) V01