The First CMOS SoC of 77GHz mmWave Sensor Used in Automotive and Industrial

2017/11/15-16

TI Jesse Wang

1

Agenda

• Technology Overview – TI 77GHz mmWave introduction

• Core Applications – Automotive

– Industrial

• Automotive & Industrial Applications – Example & TI solution

– Development tool

• Measurement – Joint-Test with Rohde & Schwarz

2

Basics of FMCW (Frequency Modulation Continue Wave)

By working with FFT on these IF signals to get Range, Velocity,

Angle information of detecting object

IF frequency = Tx frequency – Rx frequency

IF frequency

The fundamentals of millimeter wave sensors, http://www.ti.com/lit/wp/spyy005/spyy005.pdf

mmWave Sensors – Technology Overview

4

• High precision range measurement – tank level probing, displacement sensing, and vibration monitoring

• Smarter infrastructure – occupancy sensing, traffic monitoring, lighting control, gesture recognition

• Advanced navigation for drones and robotics – sense and avoid, landing assistance, collision avoidance, ground speed sensing

• Automotive - Adaptive cruise control, automatic emergency brake, lane change assist, and more

When to use

mmWave

sensing?

• mmWave technology is robust against environmental influences such as bad light and weather conditions and extreme temperatures

• RFCMOS technology enables analog/digital integration in a single low-power, small, single-chip solution

• Highly linear signal generation, ultrawide resolution, robust calibration/monitoring, and more for unprecedented accuracy in RF sensing

Why Now?

• mmWave is the band of spectrum between 30GHz and 300GHz

• Electromagnetic waves used for sensing, imaging and communications

• mmWave sensors measure with high accuracy range, velocity and angle of remote objects

What is

mmWave

sensing

The last 7 years

Kickoff

Kilby Radar

160 GHz

single chip

embedded

antenna

2010 2011 2012 2013 2014 2015

Test Chip 3 76-81 GHz

Module level

circuits

Final tune

Model matching

AWR1243 76-81 GHz

Single Chip

Transceiver

Production intent

Sampling Now

MP in Q1 2018

Test Chip 1

77 GHz

Module level

circuits

Test Chip 2 76-81 GHz

Single chip

Package variant 1

Package variant 2

Embedded

Antenna

Field Trials

2016

AWR1642 76-81 GHz

Single Chip

Radar

Production intent

Sampling Now

MP in Q4 2017

5

TI Single-Chip CMOS Radar

6

PCB PCB

PCB

SiGe

BiCMOS

SiGe

BiCMOS

CMOS

Discrete Multi-Chip mmWave Sensor TI Single-Chip mmWave Sensor

• Discrete solution – expensive

• Complex and critical signal routes

• Unconventional packaging

• Prone to noise

• Lack of system level observability

• Crude implementation of RF and Baseband safety

• Smaller in size

• Simpler design

• Built in monitoring and calibration (SIL)

• High Resolution, less false positives

• Programmable core

• Lower Power

Delivering mmWave sensing solutions

7

SILICON

TOOLS

& KITS

SUPPORT

TI DESIGNS TRAINING

ECOSYSTEM

PARTNERS

I NDUS TRI A L A UTO MO TIV E

A NA LYT I CS MA CHI NE V I S I O N

mmWaveStudio

mmWave

SOC

mmWaveSDK

mmWave Sensors – Presence on ti.com

8

Industrial radar

Find mmWave through Sensor Portal

mmWave Portal:

Each title will drive

to unique landing

pages for Auto

and Industrial

Find

mmWave

through

Applications

Automotive radar

Get the training / support / Labs

mmWave sensing applications

9

Beyo

nd

Au

tom

oti

ve

A

uto

mo

tive

Level Probing

Precision Measurement

Vibration Monitoring

Occupancy Sensing

Gesture Recognition

Traffic Monitoring

Perimeter Surveillance

Vital Sign Monitoring

Factory Automation

Industrial Transport & Robots

Adaptive Cruise Control Automatic Emergency Brake Lane Change Assist Blind Spot Detection

Building Automation

Drones

Applications

11

•Adaptive Cruise Control

•Automated Highway Driving

150 m +

RCS: 10 – 50sqm

•Automated Emergency Braking

•Automated Urban Driving

100 m – 150 m

RCS: 1 – 10sqm

•Pedestrian Detection

•Bicyclist Detection

•BSD, RCA, LCA

20 m – 100 m

RCS: 0.1 – 1sqm

•Proximity warning

•Parking

•Stop and Go Traffic

5 m – 20 m

RCS: 0.1sqm

•Proximity warning

•Chassis sensors

•Gesture detection

•Driver monitoring

•Occupant detection

2 cm – 5 m

RCS: micro sqm

Single

chip

solution

Works with

external

MCU/DSP

AWR1243

AWR1443 AWR1642

AWR1443 AWR1642

AWR1642

AWR1243

Enabling Innovation in ADAS – AWR1642

12

Imaging / cascading

radar

Ultra short / Short

range (USRR/SRR)

• Small, low power single chip solution – AWR1642

• Cost optimized BOM – cheaper PCB, better yield

• Single chip radar, monolithic processing through RF/analog samples to object

detection

• Power consumption as low as 2W leads to lighter housing

• Blind spot detection, pedestrian/bicyclist detection, park assist, lane change assist,

forward/rear collision avoidance

AWR16

10 m

100 m

120°

160°

Parameter Far Range Near Range

Max Range 100 m 10 m

Range Resolution 40 cm 4 cm

Max Velocity 90 kmph* 30 kmph

Velocity Resolution 1 kmph 1 kmph

RCS 1 Sq m

( Pedestrian, pole)

0.1 Sq m

(Traffic cone, wire mesh)

Horizontal FOV 120 deg 160 deg

Vertical FOV 10 deg 30 deg

Enabling Innovation in ADAS – AWR1243

13

Imaging / cascading

radar

Ultra short / Short

range (USRR/SRR)

• High performance, low power radar front end – AWR1243

• 15 MHz IF bandwidth for 200+m range and 300km/hr unambiguous max velocity

• Built-in circuitry for seamless cascading of multiple AWR1243

• Angular resolution as low as 0.6° in the azimuth and vertical direction

• Urban driving, automated highway driving, full-range radar (FRR)

1-4x

AWR12

150 m

250 m

30

°

90°

Parameter Long Range Mid Range

Max Range 250 m 170 m

Range Resolution 2m 40 cm

Max Velocity 300 kmph 300 kmph

Velocity Resolution 1 kmph 1 kmph

RCS 10-50 Sqm (Car, truck) 5-10 Sqm (Motorbike, car)

Horizontal FOV 30° 90°

Vertical FOV 10° 30°

Satellite Configuration

Sensor configuration with TI mmWave solutions

14

SRR

AWR1642

CORNER/MRR

AWR1243

Processor

AWR1243

USRR

AWR1642

Proximity

AWR1443

IMAGING

AWR1243 AWR1243 AWR1243 AWR1243

Processor

LRR

AWR1243

Processor

AWR1642

Processor

AWR1642

CANFD

AWR1642 AWR1642

Automotive mmWave Sensors

Radar Sensor

• Use Cases – Imaging Radar Sensor

• 2x AWR12 (cascade) +

External DSP

• 4x AWR12 (cascade) +

External DSP

Radar Sensor + HW Accelerator

• Use Cases – Entry-level Single-chip Radar

• Proximity warning, Blind spot

Radar Sensor + DSP

• Use Cases – USRR Single Chip Radar

• 160 Degree, 40m

– SRR Single chip Radar

• 120m Cross traffic Alert

AW R 1 2 4 3

3 4RX

Calibration,

Monitoring

Engine

3TX Synth SPI

CSI2

AW R 1 4 4 3

4RX Calibration,

Monitoring

Engine

3TX Synth

R4F

Radar

Acc

576KB SPI

CAN

AW R 1 6 4 2

4RX Calibration,

Monitoring

Engine

2TX Synth

R4F

C674x

1.5MB SPI

CAN

CAN

FD

Crypto HIL

15

AWR1x Software Deployment TI code

TI Partner code

Customer code

mmWave Studio(PC)

AWR1x Raw Data Capture

Device Firmware Package (DFP)

Device Firmware Package (DFP)

Master or Slave

AWR1243 + Processor

TDA3x Radar SDK

Application

CSI2, SPI, I2C, FPD

ISO 26262 enabled code

ECU

Device Firmware Package (DFP)

Application

Custom RTOS

TI RTOS

mmWaveSDK

MCAL

AUTOSAR

RTE

AWR1443 / AWR1642 Development

CAN,CANFD

16

AWR Design Kit

17

Silicon

EVM

• TI(Ecosystem partner) built reference HW

RF tool

• Signal Path analysis, Radiative measurements

HDK

• Reference Schematic/Layout, BOM, RF Model, Thermal Model

SDK

• Firmware, Device drivers, Operating system, Development environment

Sample: √

RTM:

Q1 2018

Sample: √

RTM:

Q1 2018

Sample: √

RTM:

Q4 2017

√ √ √

√ √ √

√ √ √

√

√ √

AWR1243 AWR1443 AWR1642

AWR Hardware Platforms

18

• Enables evaluation of single

chip radar

• Proximity sensor demo on

AWR1443 EVM

• SRR demo on AWR1642

EVM

A W R 1 2 4 3 + T D A 3 x A W R 1 2 4 3 + T S W 1 4 0 0 A W R 1 4 4 3 / A W R 1 6 4 2 E V M A W R 1 4 4 3 / A W R 1 6 4 2

S e n s o r m o d u l e

• Enables RF performance

evaluation

• Raw ADC capture into PC

and then post process

• mmWave Studio to visualize

object range/velocity/angle

• Enables radar algorithm and

MRR/LRR application

development on TDA3x

• Enables vehicle

validation/demonstration

• Enables radar algorithm and

proximity/SRR application

development on AWR1443/

AWR1642

• Enables vehicle

validation/demonstration

51 x 32mm 34 x 38mm 85 x 65mm

Delivering the most precise sensors in CMOS Enabling Level 2 and above

Small

footprint

Single-chip, integrated

analog and digital,

Automotive-friendly package Versatile intelligence

Self monitoring & calibration,

Complex/IQ architecture

Interference detection

Low power

Scalable power

consumption to meet

demanding applications

such as 4-20mA sensors

Highly configurable

Flexible sensing for long-

range, mid and short-range

applications, including multi-

mode

Ultra high resolution

Wide RF BW, 0.01% Chirp

linearity

Scalability

Scalable digital

performance, high-resolution

analog cascading

19

Industrial Transport / Robotics – Obstacle Detection

21

Pickup

Robot

Warehouse Floor

Warehouse Use Case

Typical Range ~ 5 m

Typical Velocity < 5 m/sec

Typical Device Performance

Range accuracy 2 cm

Range resolution 10 cm (@2 GHz chirp BW)

Velocity accuracy 1 cm/sec

Velocity resolution 5 cm/sec

Angle accuracy 1

Interference Rejection : The 2025 Parking lot

• FMCW inherently robust to interference

• Chirp based timing randomization

• Binary phase modulation

Pickup

Robot

mmWave in Building Automation

Advantages

• Robust to false detection/movements with integrated processing

• Radar information can give position and velocity – easy

background subtraction, movement classification

• Robust to environment – lighting, temperature, moisture

• No camera or lens for privacy-conscience applications

• Sparse data set requires lower processing requirements

Challenges

• Angular resolution of radar is poor, complex scenes require

algorithms to decipher

• Power consumption for wireless, battery-powered sensors

• Cost pressure versus incumbent technologies such as 24GHz,

ultrasonic, and PIR

22

Motion Detectors

People Counting

Automated Doors

& Gates

IP Network

Camera

GOAL: Robust, small form-factor detection and sensing of people near buildings, cameras, and doors

TI mmWave in Traffic Monitoring TIDEP-0090

• RFCMOS - Fully-Integrated design • All mmWave sensing, radar processing and advanced algorithms can be

performed on single chip

• High Performance • mmWave radar can precisely determine object location and speed

• Can minimize or eliminate need for expensive video analytics for object

localization, speed estimation, and classification

• Detection/measurement of objects at 100m+, velocities <200km/hr, across

multiple lanes

• Insensitive to Environment • Insensitivity to challenging environments such as fog, smoke, and changing

lighting conditions.

• Flexibility of Solution • TI mmWave supports multiple data output types to allow for greater flexibility

and optimization in your system design

23

Value of TI mmWave in Drones

Drone Sense and Avoid Overview

• Obstacle Detection and Avoidance (Power lines, buildings, trees etc)

• Autopilot Features : Positioning, Hovering, Object Tracking

• Landing Assist (Altitude measurement, Ground / water landing classification)

Technologies used today

• Vision, Ultrasound, IR, LIDAR

• Limitations with current techniques : Low Range, Sensitivity to environmental

conditions, Poor low/bright light performance, Low frame rates (except LIDAR)

What makes mmWave sensing interesting

• Highly accurate, Long Range (80 m+), High frame rates

• Insensitive to environmental conditions such as dust, fog, low light or dazzling

sunlight

• Supplement existing sensors with Radar for added Safety/Redundancy

• Radar/Vision Fusion - make all sensors smarter

24

Power Line Detection

Autonomous Landing

Capability demonstration – Vital Stats Measurement

25

Lens used to increase the SNR

Subject seated between 1-3 meters away from the Radar

Subject asked to stay very still and have his/her back rested on the back of

the chair

Remaining challenges:

Separating breathing rate harmonics from

heart beat

Cancellation of body/limb movements

Vital Signs (Adults) Chest displacement Frequency

Breathing Rate 1- 12 mm 0.1 – 0.3 Hz

Heart Rate 0.2 – 0.5 mm 0.8 – 2 Hz

Typical vital sign parameters

Lens Radar

Experimental Setup

5 10 15 20 25 30 35 40 45 50 55

-3

-2

-1

0

1

Dis

pla

ce

me

nt

(mm

)

Time (sec)

Bea

ts p

er

min

ute

100 200 300 400 500 600

20

40

60

80

100

0 50 100 1500

0.2

0.4Mean

Beats/minutes

50 100 150 200 250 300 350 400 450 500

20

25

30

0 200 400 600 800 1000 12000

50

100

0 5 10 15 20 25 30 350

50

100

Time

Range

Range Bins

corresponding

to the subject

5 10 15 20 25 30 35 40 45 50 55

-3

-2

-1

0

1

Dis

pla

ce

me

nt

(mm

)

Time (sec)

Bea

ts p

er

min

ute

100 200 300 400 500 600

20

40

60

80

100

0 50 100 1500

0.2

0.4Mean

Beats/minutes

Beats

per

min

ute

D

ispla

cem

ent

(mm

) Heart

Rate

Breathing

Holding

Breath Breathing

Holding

Breath

Breathing Rate

Spectrogram

Unwrapped Phase

Example Video – Parking Lot

26

Industrial mmWave Sensors IWR1443 IWR1642

mmWave Sensor + HW Accelerator

• Use Case

– Entry-level Single-chip Sensor

• Power-optimized applications

• HW acceleration for limited processing

mmWave Sensor + DSP

• Use Cases

– Full functionality single-chip radar

• Increased on-board memory for higher range and

resolution measurement

• On-chip DSP for advanced algorithms

4RX Calibration,

Monitoring

Engine

3TX* Synth

R4F

FFT

576KB

SPI CSI2

LVDS CAN

4RX Calibration,

Monitoring

Engine

2TX Synth

R4F

C674x

1.5MB

SPI LVDS CAN

* 2x TX simultaneously

27

IWR1xxx mmWave Signal Processing

28

RF Front-End ADC ADC Data

IWR1443

IWR1642

Pre-

Processing (Interference Mitigation)

1st Dim FFT

(Range)

2nd Dim FFT

(Velocity)

3rd Dim FFT

(Angle Arrival) Detection

Point Cloud [Range, Velocity, Angle]

Clustering Tracking Object Classification Objects

IWR Standard Offering

Silicon • Single-chip mmWave sensors

Modules • mmWave Sensors with integrated PCB antenna

EVM • OOBE demo, reference schematics/layout, BOM

Hardware Collateral • Datasheets, user guides, app notes, RF/thermal models

Software Development Kit • mmWaveSDK, software collateral, visualization tools, flashing tools

29

Samples: ✓ RTM: 1Q18

Samples: ✓ RTM: 2Q18

2Q17 ✓

✓ ✓

✓ ✓

✓ ✓

IWR1x Evaluation Modules

• Platform for out of the box evaluation

and rapid prototyping

• Includes reference schematics, layout,

and BOM

• Interfaces:

– USB for debugging and emulation

– High-speed interface for raw ADC

capture

– BoosterPack headers

• DevPack board for additional

expansion

30

Modules for simplified production

3rd Party Modules

• Full system-on-module (SOM) with mmWave SoC, Antenna, PMIC, Flash and

other support ICs

• Samples and production quantities from 3P 31

Discrete Multi-board mmWave

Radar

TI Single-Chip mmWave Sensor

Module

TX/RX ADC & Digital

mmWave Software Simplified evaluation and development

32

mmWave SDK mmWave Examples mmWave Studio

Includes:

• TI RTOS

• Drivers

• SPI

• CAN/CANFD

• LVDS / CSI-2

• EDMA

• UART

• I2C

• GPIO

• Timers

• FFT HW

• Signal Processing Library

• On DSP

• On HW Accelerator

• MCU-DSP communication

• mmWaveAPI

• mmWaveLink

• SecDev (delivered separately)

• TI Designs:

• Proximity Sensor

• Short-Range Radar

• Power-Optimized Field Transmitter

• Traffic Monitoring

• Drone Sense and Avoid

• People Counting

• Examples:

• mmWaveStudio (OOB)

• MSP4XX

• AMXX

• TDA/DM5

• C2000

• Labs:

• Water Vs Ground Lab

• Vital Sign Lab

Includes:

• Visualizer – visualize output (point-cloud and proximity grid) from the sensor on the PC

• Sensing Estimator – define chirp configuration through abstracted parameters like max range, minimum range, etc

• Capture – capture raw RF data from the capture HW onto the PC

Measurement

33

Joint-Test between Rohde & Schwarz and Texas Instruments through FSW Signal Analyzer

Thank You & Questions

36