50
www.evk.biz © EVK DI Kerschhaggl GmbH 2014 Matthias Kerschhaggl BiRT Workshop, 20/03/15 1 Hyperspectral/ Chemical Imaging as Key Technology in Sensor Based Sorting Applications

SLOPE 1st workshop - presentation 5

Embed Size (px)

Citation preview

Page 1: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Matthias KerschhagglBiRT Workshop, 20/03/15

1

Hyperspectral‐/ Chemical Imaging as Key Technology in Sensor Based 

Sorting Applications 

Page 2: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Outline

2

Page 3: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014 [email protected]

Who we are

Smart solutions providersince 1987

2006: HSI camera & classificationsystem introduced to market

Real‐time classification and sorting: All‐in‐one device

Industry proven in recycling, mining, food processing and pharmaceutical applications 

3

Page 4: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Applications

4

Metals from slagHousehold waste

C&D Recovered Paper Wood Sorting

Potato Sorting &Grading

E‐Scrap

Nut Sorting

Page 5: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

References RecyclingGlass Sorting

Customer: 

EVK products:EOS – Color ImagingARGOS – Conductivity Imaging

5

Page 6: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

References RecyclingMetal Scrap

Customer: 

EVK product:ARGOS –Conductivity Imaging

6

Page 7: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

References RecyclingPlastic Sorting

Customer:EVK product: HELIOS – Chemical Imaging

7

Page 8: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Recovered Paper Sorting

[email protected]

Page 9: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

References RecyclingMinerals, Metals, Plastic

Customer:

EVK product:EOS – Color Imaging

9

Page 10: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

References MiningMineral Sorting

Customer: 

EVK product:HELIOS – Chemical Imaging

10

Page 11: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

References Food SortingDiv. Nut Sorting / Recycling

Customer: 

EVK product:HELIOS –

Chemical Imaging

11

Page 12: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

References Food Processing Potato Sorting

Customer:

EVK products:HELIOS –Chemical Imaging

EOS – Color Imaging

12

Page 13: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014 [email protected]

Hyperspectral Imaging Technology

Camera internal classification and RGB visualization of chemical differences for real‐time analysis

13

Page 14: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014 [email protected] 14

HELIOS – Spectral Ranges

Page 15: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Outline

15

• Recycling

• Food

• Pharmaceuticals

• Mining

Page 16: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Recycling

16

papercardboard

PE‐LD

Page 17: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Recycling

17

PE PVC

Page 18: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Recycling

18

Quality analysis ofpaper

Paper + Glue, 1st derivative, normalized

Page 19: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Outline

19

• Recycling

• Food

• Pharmaceuticals

• Mining

Page 20: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

FoodHSI preview of SE 

potatoe

CCI view of SE potatoe

Potatoe after frying

Sugar end

Page 21: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

FoodFood sorting – Blueberries and stems

Page 22: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Food

Food sorting – Noodles and worms

Page 23: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Food

Starch

Glucosewater

Simple VIS representation(filter convolution)

of HSI data

CCI representationof HSI data

(PCA: Principal Component Analysis)Quantitative analysis is possible

Page 24: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

HSI Objectives/Trends Monitoring of input streams for quality and process control ‐> 

HSI as Process Analysis Technology (PAT) Sorting and monitoring of product flows in one machine using

HSI/CIT Quantitative analysis of chemical constituents as add‐on

Removing foreign materialsand infer quantitative information on e.g. dry matter and glucose in potatos at the same time

24

Page 25: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

HSI – Quantitative Analysis

wellness.byu.edu

Fig 2: PLS schematics (Wold et al. 2001) 

Fernadez‐Novales et al. (2009)

X YPredictors (spectra)

Observations(reference analysis)

X Y

25

Page 26: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Dry Matter

26

REMINDER 1st inline TEST 2013

HELIOS Camera

R = 0.9 RMS = 1 %

Page 27: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Inline Dry Matter Measurements

27

• Dry matter content tracedby spectral signatures

• Inferred FIR‐filter kernelallows for concentrationprediction

Page 28: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Dry Matter Machine

28

• Integrated in sortingmachine (INSORT Observer)

• Valdidated model(R^2=0.9, RMS=5 %)

Page 29: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Award

29

International FoodTec Award

DLG (Deutsche Landwirtschafts‐Gesellschaft 

/ German Agricultural Society) 

Page 30: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Dry Matter

30

Page 31: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Dry Matter

31

waterchannels

Page 32: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Dry Matter Statistics

32

• DM „heat map“• DM value histogramm• Mean DM• Standard Deviation of

product DM

Page 33: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Accuracy vs. Precision

[email protected] 33

Plots taken from http://en.wikipedia.org

higher precision 

–lower 

accuracy 

lower precision 

–higher accuracy 

Laboratory precision completed with 100% inspection of entire 

production stream

Page 34: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Precision vs. Accuracy

• The intrinsic variance of the product is greater than the precision of the lab reference, so better have full sampling rather than super precision!

• „Better you measure all the fries all the time with reasonable precision rather than 1 out of 100.000 with ultra‐high precision!“

• It is about large scale trends in the whole product stream not about laboratory measurements of unrepresentatively small quantities!

• A RMS of e.g. 1 % for constant monitoring of the product throughout the entire input stream is already way better than what you can do with a precision of 0.1 % every 30 min on a spatially confined sample!  

34

Courtesy W. Märzinger

Page 35: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Outline

35

• Recycling

• Food

• Pharmaceuticals

• Mining

Page 36: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Pharmaceuticals

36

Page 37: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Pharmaceuticals

[email protected]

Page 38: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Pharmaceuticals

R^2=0.98RMSEC = 1.2 mg/cm2

[email protected]

Page 39: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Pharmaceuticals

R^2=0.98RMSEC = 1.2 mg/cm2

39

mg/cm2

[email protected]

Page 40: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Personalized Medicine

Imprinted set of test specimens with ascending API concentration

[email protected] 40

Visible image

HSI imagePixels representing wavelength 1.3‐2.3µm 

Intensity

unnormalizedspectra

Page 41: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Drying Processes

[email protected] 41

In‐situ measurement of moisture content of a sample during drying cycle(left: wet,  right: dry)

Page 42: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Product Identification

[email protected] 42

Hyperspectral Imaging technology analyzes the chemical consistency and checks tablet integrity

Courtesy of RCPE

Page 43: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Chemical Composition

Chemical mapping of API content

Agglomerated API spots

[email protected] 43

1%

11%

5%

15%Courtesy of RCPE

Page 44: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Outline

44

• Recycling

• Food

• Pharmaceuticals

• Mining

Page 45: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Sandstone/Slate Classification

[email protected]

Page 46: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Copper Ores Quantitative Analysis

46

λ [px]

I [AU

]

[email protected]

%

Page 47: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Conclusion

47

• HELIOS is a near infrared (NIR) hyperspectral imaging (HSI) smart camera suitable for fast inline applications

• A broad range of applications in food, recycling, miningand pharmaceuticals have been already realized and arerunning in the field.

• HSI has become an established and reliable technology in the field of sensor based sorting.

• Apart from mere sorting solutions the inference of spatiallyresolved, non‐invasive quantitative inline measurementsfor 100 % product control (PAT) have enormous potential adding to classical, precise but low sampling and invasive laboratory based techniques. 

Page 48: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

References

M. Kerschhaggl, W. Märzinger, E. Leitner et al. „Inline HSI food inspection and concentration measurements of pharmaceuticals – a report from an industrial environment.” Karlsruhe: KIT Scientific Publishing, Karlsruhe, 2013.

M. Kerschhaggl“Hyperspectral imagery for real‐time quantitative inline analysis,” Sensor‐Based Sorting 2014, GDMB Verlag GmbH, vol. 135, 2014.

M. Kerschhaggl“Hyperspectral Imaging as Process Analysis Technology for inline Applications. Laboratory Precision meets high Sampling Accuracy” Karlsruhe: KIT Scientific Publishing, Karlsruhe, 2015.

48

Page 49: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014

Acknowledgments

M. Jeindl

W. Märzinger

E. Leitner

49

Page 50: SLOPE 1st workshop - presentation 5

www.evk.biz© EVK DI Kerschhaggl GmbH 2014Thank you for your attention50