A photonic network for data acquisition systems for deep-sea neutrino telescopes

electronic department

A photonic network for data acquisition systems for deep-sea neutrino telescopes

Presentation on behalf of the KM3NeT consortium

by Jelle Hogenbirk

Home institute: Nikhef Amsterdam


This talk is dedicated to Dr. Charles Kao

VLVnT 2009 Athens 10 October 2009 Jelle Hogenbirk et.al. 2

The part of this year's award associated with Mr. Kao underscores the fact that optical fibers carry an increasing fraction of phone calls, television programs, and internet traffic into homes. Data can move down silicon fiber more quickly than through copper wire because nothing is faster than light, and light signaling offers higher bandwidth for electronic circuitry. Encoding information in the form of light pulses rather than as electric pulses allows more data to flow down a line. Kao's principal achievement was in making the fiber more efficient; by excluding impurities in the fiber material, he developed a material that absorbed less of the light carrying signals over long distances.

For more information please consult:http://www.ieeeghn.org/wiki/index.php/Oral-History:Charles_Kao

physics Nobel prize winner 2009


Outline of this talk• Requirements• System setup CW lasers (continuous wave) R-EAM’s (reflective electro absorption modulator) DWDM technology (Dense Wavelength Division Multiplexer) bidirectional optical signaling with multiple λ’s /fibre

• Realized items• Further developments


Development team:Peter Healey 1

Mar van der Hoek 3

Jelle Hogenbirk 2 Peter Jansweijer 2

Sander Mos 2

Henk Peek 2

David Smith 1

1 Center for Integrated Photonics 2 Nikhef3 VanderHoekPhotonics


A facility network


3 years ago and taking progress in technology in account the starting point for the DAQ system requirements were:

All data to shorePreferable: synchronous data readout

Integrated clock and event time systemProven technology including COTS (commercial of the shelf) components

A node network for about 6000 clients. Flexible interfacing to the network must be guaranteed over its life time of > 15 years after deployment.Taking KM3NeT scale into account, optimize designs in electrical power consumption on seabed facility dependence to RAMS (reliability, availability ,maintainability, safety) criteriaand keep the network affordable


electronic-photonic front end design idea


From PMT’s

0 21 4 5 15I0 I1 Ix

identifier

D D D D D D D D D D D

Trigger all Zener diodes at the same time andThe delay times are tuned to 100 ps

serialized output after optical trigger

electric output to optical modulator

2R or 3R ?modulator

unit

CW + readout clock pulseLater the clk pulse is the “heartbeat”

3

15

1,6 nsec <=> 3,2 nsec

I0 I1 Ix 0 1 2 3 4 5

Pulse detector&

gain flattening

~ 7ns

Example16 PMT’s and 4 identifiers => 20 data bits. Optical trigger repetition rate: 1,6 nsec <=> 3,2 nsec80 <=> 160 psec sample pulse width.If “D” delay 100 psec then the system adapts to10Gb/s optical transmission technology.

Photonic pulse streame.g. every 2 nsec

resistor

ToT signal PMT 2 ToT signal PMT 5

# PMT’s

D


Recovering PMT’s Time over Threshold on shore


Hit 1Hit 1

Hit 2

Late hit?PMT 2

PMT 5

2 nsec

Readout pulsesthe “heartbeats”

x + .. 1 2 3 4 5 6 7 8

# PMT 1 2 3 4 5

100 psec

1

2

3

4

5

2 nsec

Original PMT Pulse ToT Readout pulses x+ ..

Recovering PMT’s ToT

Sub-sea

Shore

Related pulses


Signal path and loop-timing scheme

VLVnT 2009 Athens 10 October 2009 Jelle Hogenbirk et.al. 7 7

Modulator (gate)Generating CW + heartbeat signal On one fiber to/from OM

2x(N+1)AWG

DWDM

Optical receiver

Circulator

Reflective Modulator

Optical Amplifiers

Power splitters to feed up to 100 units

Single shared feed fibrewith DWDM seed plus clock / framing on 1

Burst-mode Optical receiver

PMT electronics

tap

1

2+3

N+(N+1)

1

(N+1)

AWG FSR

Gated Semicondutor Optical Amplifier forSignal propagation timemeasurements

CDR& controller

20%

10%

10%

To Gated SOA

30%

OPTICAL MODULE

2.0 km of single fiberCW seed + heartbeat

and in opposite directionmodulated signal back to shore

Mirror (for 100km loop timing)

Sub-sea

Shore


Measurement Results


Backscatter impact on 10G 2km REAM link

1.E-12

1.E-11

1.E-10

1.E-09

1.E-08

1.E-07

1.E-06

1.E-05

1.E-04

1.E-03

-22 -21 -20 -19 -18 -17 -16 -15 -14 -13 -12 -11 -10

Rx Pwr (dBm)

BER

Anritsu

Anritsu BB

Lasertron

Lasetron BB

Santec (60MHz)

Santec (kHz)

Santec BB

Santec 1558.7nm (back-to-back)

Laser

Backscatter impact on 10G/s 2km SMF28 in the R-EAM link


5 Detection Unit options sub-sea network


May be in JB or DU

Strings of 20 OMsover 20 floors

To JB

OM1

1 fibre to each OM

20

DU1 2 543

20-fibre ribbon connection to

string

100ch AWG To JB

20ch cyclicAWGs

OM1

1 fibre to each OM 20

WDM ADMs

DU1 2 543

Single fibre interface to each string

(a) Single AWG* ribbon connectors

(b) Multiple AWGs* + ADM**single-fibre connectors

*AWG (Arrayed Wave Guide) is the applied hardware for DWDM (Dense Wavelength Division Multiplexing) technology **ADM (Add Drop Multiplexer) take out # wavelengths from a wavelength comb on a fibre and put them back on after external access


Test bench SPARK


cw ch 17

cwch 18

cwtun

DW

DM

DW

DM

combiner

R-EAMR-EAMR-EAM

DW

DM

PIN

PIN

driver clkdata

driver clkdata

driver clkdata

receiver

receiver

clkdata

clkdata

171819

AWG

171819R-EAM

SOA

to sub-sea from shore

to shorefrom sub-seasub-clk

sub-clk

Sophisticated Photonic Architecture Readout for KM3Netlaboratory optical network test setup for 10Gb/s

FPGAFPGA

20 km fiber (without optical amplifiers)And tested at 100 km (with optical amplifiers)

Optical connector for flexible use of SPARK

Sub-seaShore


Realized SPARK setup for 10Gb/s



Results pulse Transmission over 10 km

VLVnT 2009 Athens 10 October 2009 Jelle Hogenbirk et.al. 1248.80 ps

jitter mainly from P-N change over in the electronic circuitry

Refer to next p

resentatio

n of

Peter Jansw

eijer


10 Gb/s Eye Pattern


Received signal after a 10 km connection at receiver output

BER figureshows

Signal Quality

72.4 mV/div Clock Rec: 10,3125 Gb/s Time 16.2 ps/div Trig: Pattern5.1 mV LBW 4.13 MHz Delay 40.1552 ns Bit 113

BER is Bit Error RateThe more open “eye”The better SNR(Signal to Noise Ratio)


Node Interface Kit


shore

DM laser R-EAM

PINCW laser

FPGA

Mem

PIN

311 Mhzclock

GbE

311 Mhzclock

GPSReceiver and

reference clock

SPARK Light e.g. OM

“Heartbeat” with embedded SC

up to 12x 10 Gb/s

10 Gb/s

Continuous wave laser

PMT data

TTC

Gen. I/O

including a basic firmware for the 10 gb/s network

end-node

Evaluation board Altera Stratix IV GT

determining the functionalityin the end-node

FPGA

interface outside world to the optical network

Typ. power Stratix GT SERDES: 171 mW at 10.3 Gbps

Altera Stratix IV GT sampling now

Xilinx Virtex 6 HXT sampling Q1 2010

Optical Network

(transparent for the data transmission format)


Node Interface Kit


shore

DM laser R-EAM

PINCW laser

FPGA

Mem

PIN

311 Mhzclock

GbE

311 Mhzclock

GPSReceiver and

reference clock

e.g. OM

“Heartbeat” with embedded SC

up to 12x 10 Gb/s

10 Gb/s

Continuous wave laser

PMT data

TTC

Gen. I/O

end-node

Evaluation board Altera Stratix IV GT PMT readout, TTC and general I/OFunctionality hard/firmware to beimplemented by the client

FPGA

Typ. power Stratix GT SERDES: 171 mW at 10.3 Gbps

Altera Stratix IV GT sampling now

Xilinx Virtex 6 HXT sampling Q1 2010D

WD

MD

WD

M

DW

DM

(depicted 1 channel)

SPARK


Example of NIK Node implementation


FPGAAltera Stratix IV

POWERBoard

CDR

R-EAM driver

PIN

R-EAM

3D COMPASS

HMC5843

ADC LED Beacon

PMT control

PMT LVDS signals

Acoustic Sensor

Optical Network

Sensors:-Temperature?

-Voltage?-Water?

PMT’s

I2C

I2C Bus

SPI

622Mbps

10Gbps

31 LVDS signals

10 - 14V 1V8, 3V3, 5V

Control

Spare I/O

Octopus Board

Mezzanine Boards

All I/O 3v3 or 1v8 or LVDS

for the Multiple PMT Optical Module

SPARK


A photonic network for data acquisition systems for deep-sea neutrino telescopes




Expertise is the last thing you need for an animated discussion

Thank you

andremember

Documents

A photonic network for data acquisition systems for deep-sea neutrino telescopes