August, 2015

Realtek Audio Codec Introduction and Demo (Microsoft Cortana Workshop)

Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp -1-

Milestone with Microsoft Partner

Design Notice and Flow for Cortana Application

Approach of Microphone Effect

Demonstration

Q & A

Outline

Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp -2-

Milestone with Microsoft Partner

Over 90% Lync/Skype/Unified certified projects for laptop/tablet/AiO adopted in Realtek audio solutions

2010 ~ NOW

2015/May Realtek HD audio is the worldwide NO.1 Win10 certified device/driver

2015/Q2 ~ NOW Exceed 100 projects with Cortana Premium Level tuned by Realtek (Win10 launched in 2015/July/E)

Professional tuning tools & solutions

for audio-related certification

Convenient global technical support, audio laboratories built

not only in Taiwan but China

Sufficient Over 4 ETSI Room

and anechoic chamber for tuning resources

(gradually building more )

+ + =

Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp

• Careful mechanical integration of the microphone is important and is a common source of failure. Following the principle: for microphone, as far as possible from noise; for speaker, as close as possible to the user’s mouth

-3-

Key component select & design is microphone and

its placement

• microphone & speaker placement / codec and recording algorithm implementation • complete system pre-test for Cortana • setting microphone tuned volume/gain in Win10 system register

Design Flow

• Good component selection, acoustic design and mechanical integration is important to capture the best possible audio to give a good experience rather than relying on the speech enhancement pipeline

Design Notice and Flow for Cortana

Key Recommendation

Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp

• Good component selection, acoustic design and mechanical integration is important to capture the best possible audio to give a good experience rather than relying on the speech enhancement pipeline

Key Recommendation

-4-

Design Notice and Flow for Cortana

Microphone Selection

• Signal to Noise Ratio 61 dB for Standard 63 dB for Premium • Sensitivity Max Level: <= -20dBFS Min Level: <= -55dBFS (100 ~ 8,000 Hz)

Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp

• Good component selection, acoustic design and mechanical integration is important to capture the best possible audio to give a good experience rather than relying on the speech enhancement pipeline

Key Recommendation

-5-

Design Notice and Flow for Cortana

Acoustic Design

(For Microphone) • Sealing well for

Airtight • Leakage not to be introduced

Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp

• Good component selection, acoustic design and mechanical integration is important to capture the best possible audio to give a good experience rather than relying on the speech enhancement pipeline

Key Recommendation

-6-

Design Notice and Flow for Cortana

Mechanical Integration

• Speaker and MIC are not in the same chamber

• Leakage not to be introduced (speaker isolation) • Consideration for

resonance issue

GOOD BAD

Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp

• Careful mechanical integration of the microphone is important and is a common source of failure. Following the principle: for microphone, as far as possible from noise; for speaker, as close as possible to the user’s mouth

Key component select & design is microphone and

its placement

-7-

Design Notice and Flow for Cortana

DIRECT PATH is the key

> >

For Microphone

For Speaker

Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp

• microphone & speaker placement / codec and recording algorithm implementation • complete system pre-test for Cortana • setting microphone tuned volume/gain in Win10 system register

Design Flow

-8-

Design Notice and Flow for Cortana

Before mechanical & component placement fixing

Checking…

*SPK & MIC relative position

*SPK heading direction

*SPK aperture ratio

*Effective Isolation to avoid interference in the same chamber

Before audio driver fixing

Checking…

* Detail tuning MIC effect parameter

* Confirm the best MIC gain value after Realtek pre-test

Before system driver fixing

Checking…

* Implement MIC gain setting by customers themselves or Realtek driver

Cortana Application

Ready Send a complete system to Realtek

Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp

Approach of Microphone Effect

-9-

Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp

Free microphone placement for either Landscape or

Portrait mode

User friendly GUI (scenario term)

More natural sound quality

Improvement for VR test (SEVT, Lync/Skype Unified)

Valueable features attached (Keystroke Removal, FFP)

-10-

The Goals of Microphone Effect

Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp -11- -11-

Uni-Directional Mode

• Enhance the Clarity of the voice During the VoIP or even the Voice Command

- Remove Internet Stream Echo

- Reduce keystroke noise

- Directional Recording

- Environment Noise Reduction

- Natural Target Voice

Disabled

Enabled

Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp -12- -12-

• Free moving when Multi-user conduct the conference

- Remove Internet Stream Echo

- Recording from all Angles

w/ same volume level

- Reduce keystroke noise

- Environment Noise Reduction

- Far Field Pickup (FFP) Record

Omni-Directional Mode

5m

0.5m 5m

Disabled

Enabled

Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp -13- -13-

• Used for video and music recording, not for VoIP

- Stereo recording with independent

Noise Suppression for L and R Channel

- Higher sampling rate

(44.1kHz/48kHz) record

High Quality Record with NS

Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp -14-

Controls in GUI

All Off Uni-Directional Omni-Directional

Enhance Voice Recognition High Quality Record Echo Cancel Off

Echo Cancel On

Realtek Confidential, for MSFT WinHEC Only Copyright © 2015 Realtek Semiconductor Corp

Thank You!

-15-