16
DailySplit_KSK [daily task 00:02] T:\Cr5000_outdata\slowHourly\ KSK_RFYYDOY.dat DailySplit_KSS [daily task 00:03] T:\Cr5000_outdata\slowHourly\ KSS_RFYYDOY.dat OTAGO I:\YYYY\London\$site and NetCDF to dataBridge01: A:\data\YYYY\London\$level\ $site\DAY\$DOY GAS-LAS-WXT-Ceil [hh:11] • grab hourly WXT data from both roofs to \WXT510\RAW\MM\WXTYYYYDOY_HH_raw.txt • translate hourly WXT data formatted raw data \WXT510\FORMAT_L0\WXTYYYYDOY_HH.txt \WXT510\FORMAT_L1\WXTYYYYDOY_HH.txt • write hourly WXT 5s data to databridge01 • grab Rad & RG data to \CR5000\KSK_RFYYDOY.dat \CR5000\KSS_RFYYDOY.dat LoggerNet KSK Mast 10_09_10.CR5 Q:\CR5000\Fast\ CR5000_Slow.dat ROOF8 COMCAP4 Q:\WXT510\wxt-YYYYMMDD- HH00.txt CR3000 Data Logger KSK-Mast Instruments w i r e s CNR4 K up , K dn, L up , L dn , T CNR1 WXT510 T, U, p, RH, RR ARG100 [RR] LoggerNet KSS tower 01_09_10.CR5 C:\CR5000\CR5000_slow.dat ROOF13 (C is T on Otago) C:\WXT510\ bin\WXT510.pyc stores data to data\WXT-YYYYMMDD-HH00.txt CR5000 Data Logger KSS-Mast Instruments w i r e s CNR1 K up , K dn, L up , L dn , T CNR1 WXT510 T, U, p, RH, RR SKU420/5 [UVA] SKU430 [UVB] SKL2620/5 [PAR] Troubleshoot LoggerNet KSS Tower 19_11_09.CR5 S:\CR5000\CR5000_slow.dat ROOF12 CR5000 Data Logger KSS45W Instruments w i r e s PIR [Ldown] ARG [RR ] SKU420/5 [UVA] SKU430 [UVB] SKL2620/5 [PAR] PSP [Kdown] LHRdat [half hourly task, hh:28, hh:58] Grab LHR data and save to daily file I:\YYYY\London\ALL\LHR_EGLL\ EGLLYYYYDOY.txt DATA COLLECTION

DailySplit_KSK [daily task 00:02] T:\Cr5000_outdata\slowHourly\KSK_RFYYDOY.dat

  • Upload
    jensen

  • View
    24

  • Download
    4

Embed Size (px)

DESCRIPTION

ROOF8. KSK-Mast Instruments. DATA COLLECTION. CNR4 K up , K dn , L up , L dn , T CNR1. LoggerNet KSK Mast 10_09_10.CR5 Q :\CR5000\Fast\CR5000_Slow.dat. CR3000 Data Logger. wires. ARG100 [RR]. OTAGO I:\YYYY\London\$site and NetCDF to dataBridge01: - PowerPoint PPT Presentation

Citation preview

Page 1: DailySplit_KSK [daily task 00:02] T:\Cr5000_outdata\slowHourly\KSK_RFYYDOY.dat

DailySplit_KSK [daily task 00:02]T:\Cr5000_outdata\slowHourly\KSK_RFYYDOY.dat

DailySplit_KSS [daily task 00:03]T:\Cr5000_outdata\slowHourly\KSS_RFYYDOY.dat

OTAGOI:\YYYY\London\$site and NetCDF to

dataBridge01:A:\data\YYYY\London\$level\$site\DAY\$DOY

GAS-LAS-WXT-Ceil [hh:11]• grab hourly WXT data from both roofs to\WXT510\RAW\MM\WXTYYYYDOY_HH_raw.txt• translate hourly WXT data formatted raw data\WXT510\FORMAT_L0\WXTYYYYDOY_HH.txt\WXT510\FORMAT_L1\WXTYYYYDOY_HH.txt• write hourly WXT 5s data to databridge01• grab Rad & RG data to\CR5000\KSK_RFYYDOY.dat\CR5000\KSS_RFYYDOY.dat

LoggerNetKSK Mast 10_09_10.CR5

Q:\CR5000\Fast\CR5000_Slow.dat

ROOF8

COMCAP4Q:\WXT510\wxt-YYYYMMDD-HH00.txt

CR3000Data

Logger

KSK-Mast Instruments

wires

CNR4Kup, Kdn, Lup, Ldn, TCNR1

WXT510T, U, p, RH, RR

ARG100 [RR]

LoggerNetKSS tower 01_09_10.CR5C:\CR5000\CR5000_slow.dat

ROOF13 (C is T on Otago)

C:\WXT510\bin\WXT510.pyc

stores data to data\WXT-YYYYMMDD-HH00.txt

CR5000Data

Logger

KSS-Mast Instruments

wires

CNR1Kup, Kdn, Lup, Ldn, TCNR1

WXT510T, U, p, RH, RR

SKU420/5 [UVA]

SKU430 [UVB]

SKL2620/5 [PAR]

Troubleshoot

LoggerNetKSS Tower 19_11_09.CR5S:\CR5000\CR5000_slow.dat

ROOF12

CR5000Data

Logger

KSS45W Instruments

wires

PIR [Ldown]

ARG [RR ]

SKU420/5 [UVA]

SKU430 [UVB]

SKL2620/5 [PAR]

PSP [Kdown]

LHRdat [half hourly task, hh:28, hh:58]Grab LHR data and save to daily file

I:\YYYY\London\ALL\LHR_EGLL\EGLLYYYYDOY.txt

DATA COLLECTION

Page 2: DailySplit_KSK [daily task 00:02] T:\Cr5000_outdata\slowHourly\KSK_RFYYDOY.dat

WXTDataPro_V2.R [01:20]/home/micromet/Roofprograms/WXT/WXTDataPro_V2.R• L0: convert KSK, KSS and NDT WXT data into netcdf• L1: check data on physically reasonable thresholds and correct wind direction to BNG north• with temporal resolutions 5sec, 1min, 5min, 10 min, 30min• Output saved to respective DAY directory on dataBridge01

DATA POCESSINGData02Scripts in /home/micromet/RoofprogramsdataBridge01 on /media/micromet/data

RadRainNcdf.m [02:00~]/D drive on Otago:/Roof/Rad_Rain/RadRainNcdf.m (mergeARG.sh and mergeRAD.sh on Data02/home/micromet/script/cronJobs/)• L0: converts radiation (CNR4 KSK, CNR1/Skye KSS, SPN1 & Eppleys/Skye KSS45W) and ARG100 data into netcdf• Higher Levels: Please refer to the KUMA Manual

http://geography.kcl.ac.uk/micromet/Manuals/Manual_KUMA.pdf

PlotMetObs.sh [03:55]/home/micromet/Roofprograms/WXT/PlotMertObs.sh• Use Matlab program PlotMetObs.m to generate eps plots for WXT data and radiation, combining all instruments

from all sites• Convert to png via gnuplot and save to /media/micromet/works/$YEAR/London/Level_1/MetObs• ftp png plots MetObs.png and RadObs.png to web

WXTgapFill.R [run on demand...]/home/micromet/Roofprograms/WXT/WXTgapFill.R• L2: gap fill WXT data from KSK and KSS by

a) Linear interpolation b) readings from alternative site c) predicted value

Page 3: DailySplit_KSK [daily task 00:02] T:\Cr5000_outdata\slowHourly\KSK_RFYYDOY.dat

ARG100• Tipping bucket:precipitation [mm]

WXT510• 2D-sonic: horizontal wind speed [m/s], wind direction [ °]• RAINCAP (counts hits by raindrops): precipitation [mm]• BAROCAP (capacitive silicon sensor ): barometric pressure [hPa]• THERMOCAP (capacitive ceramic sensor): air temperature [°C]• HUMICAP (capacitive thin film polymer): relative humidity [%]

CNR4• CM3up: shortwave incoming radiation [W/m2]• CM3dn: shortwave outgoing radiation [W/m2]• CG3up: longwave incoming radiation [W/m2]• CG3dn: longwave outgoing radiation [W/m2]• PT100: housing temperature [K]

backKSK

Page 4: DailySplit_KSK [daily task 00:02] T:\Cr5000_outdata\slowHourly\KSK_RFYYDOY.dat

back

Pow

er

(red)

IX1 IXR

Grou

nd (

blac

k)

CM3u

p si

gnal

+ (

red)

1H 1L

CM3u

p si

gnal

- (b

lue)

CM3d

n si

gnal

+ (w

hite

)

2H 2LCM

3dn

sign

al -

(bla

ck)

CG3u

p si

gnal

+ (

grey

)

3H 3L

CG3u

p si

gnal

- (y

ello

w)

CG3d

n si

gnal

+ (

brow

n)

4H 4L

CG3d

n si

gnal

- (g

reen

)

PT10

0 si

gnal

+ (y

ello

w)

8H 8L

PT10

0 sig

nal -

(gre

en)CNR4

SDI-S

igna

l (b

lue)

2

Serial-to-USB

3 5

SDI-S

igna

l (w

hite

)

Sign

al g

roun

d (g

reen

)

Pow

er (

brow

n)

-+

Grou

nd (n

o)

WXT510

Sign

al (

blac

k)

P1Si

gnal

gro

und

(bla

ck)

ARG100

KSK

Page 5: DailySplit_KSK [daily task 00:02] T:\Cr5000_outdata\slowHourly\KSK_RFYYDOY.dat

ARG100• Tipping bucket:precipitation [mm]

WXT510• 2D-sonic: horizontal wind speed [m/s], wind direction [ °]• RAINCAP (counts hits by raindrops): precipitation [mm]• BAROCAP (capacitive silicon sensor ): barometric pressure [hPa]• THERMOCAP (capacitive ceramic sensor): air temperature [°C]• HUMICAP (capacitive thin film polymer): relative humidity [%]

UV/PAR[μmol/m2s1 and W/m2]• SKU420: UVA• SKU430: UVB• SKL2620: PAR(Photosynthetic active radiation)

CNR1• CM3up: shortwave incoming radiation [W/m2]• CM3dn: shortwave outgoing radiation [W/m2]• CG3up: longwave incoming radiation [W/m2]• CG3dn: longwave outgoing radiation [W/m2]• PT100: housing temperature [K]

backKSS

Page 6: DailySplit_KSK [daily task 00:02] T:\Cr5000_outdata\slowHourly\KSK_RFYYDOY.dat

back

Pow

er fo

r UV/

PAR

(red

)

G5V

Grou

nd fo

r UV/

PAR

(bla

ck)

Pow

er

(red)

IX1 IXR

Grou

nd (

blue

)

UVA

sig

nal

(yel

low

)

5H 5L

UVA

sig

nal g

roun

d (g

reen

)

UVB

sig

nal

(bro

wn)

6H 6L

UVB

sign

al g

roun

d

(pur

ple)

7H

Qua

ntum

(bl

ue)

CM3u

p si

gnal

+ (

red)

1H 1L

CM3u

p si

gnal

- (b

lue)

CM3d

n si

gnal

+ (w

hite

)

2H 2LCM

3dn

sign

al -

(bla

ck)

CG3u

p si

gnal

+ (

purp

le)

3H 3L

CG3u

p si

gnal

- (y

ello

w)

CG3d

n si

gnal

+ (

brow

n)

4H 4L

CG3d

n si

gnal

- (g

reen

)

PT10

0 si

gnal

+ (y

ello

w)

8H 8L

PT10

0 sig

nal -

(gre

en)

SDI-S

igna

l (b

lue)

2

Serial-to-USB

3 5

SDI-S

igna

l (w

hite

)

Sign

al g

roun

d (g

reen

)

Pow

er (

blac

k)

G12V

Grou

nd (r

ed)

CNR1

WXT510UV/PAR

KSS

Page 7: DailySplit_KSK [daily task 00:02] T:\Cr5000_outdata\slowHourly\KSK_RFYYDOY.dat

ARG100• Tipping bucket:precipitation [mm]

UV/PAR[μmol/m2s1 and W/m2]• SKU420: UVA• SKU430: UVB• SKL2620: PAR(Photosynthetic active radiation)

CNR1• CM3up: shortwave incoming radiation [W/m2]• CM3dn: shortwave outgoing radiation [W/m2]• CG3up: longwave incoming radiation [W/m2]• CG3dn: longwave outgoing radiation [W/m2]• PT100: housing temperature [K]

backKSS45W

Page 8: DailySplit_KSK [daily task 00:02] T:\Cr5000_outdata\slowHourly\KSK_RFYYDOY.dat

KSS45W

CR3000

Datalogger

Eppley PIR CH 5 +

CH 5 -

Single ended channel 11

VX 1

10k Resistor

GND

GND

VX 2

Single ended channel 12

10 k Resistor

Eppley PSP

GND

CH 4 -

CH 4 +

Rain gauge

GND

P1

SPN1 sunshine Pyranometer

CH 8 +

CH 9 +

CH 9 -

GND

+12 V

GND

CH 10 +

+ 12 V

GND

CH 10 – 10 k Resistor + 5 V

CH 8 -

Page 9: DailySplit_KSK [daily task 00:02] T:\Cr5000_outdata\slowHourly\KSK_RFYYDOY.dat

next

Page 10: DailySplit_KSK [daily task 00:02] T:\Cr5000_outdata\slowHourly\KSK_RFYYDOY.dat

next

Page 11: DailySplit_KSK [daily task 00:02] T:\Cr5000_outdata\slowHourly\KSK_RFYYDOY.dat

next

Page 12: DailySplit_KSK [daily task 00:02] T:\Cr5000_outdata\slowHourly\KSK_RFYYDOY.dat

back

Page 13: DailySplit_KSK [daily task 00:02] T:\Cr5000_outdata\slowHourly\KSK_RFYYDOY.dat

Conversion of measured Voltage into meteorological parameters by SimpleTowerProgram

Short-wave in: VoltDiff(CM3Up,1,mV20,1,True,0,_50Hz,88.1057,0)Short-wave out: VoltDiff(CM3Dn,1,mV20,2,True,0,_50Hz,88.1057,0)Long-wave in: VoltDiff(CG3Up,1,mV20,3,True,0,_50Hz,88.1057,0)Long-wave out: VoltDiff(CG3Dn,1,mV20,4,True,0,_50Hz,88.1057,0)UVA: VoltDiff(UVAv,1,mV5000,5,True,0,_50Hz,1.0,-0.03)

UVAW=UVAv* 0.02082UVAm=UVAv* 0.059666

UVB: VoltDiff(UVBv,1,mV1000,6,True,0,_50Hz,1.0,0.14)UVBW=UVBv* 0.014755UVBm=UVBv* 0.036523

Quantum: VoltSe(Quantumv,1,mV5000,13,True,0,_50Hz,1.0,0.08)QuantumW=Quantumv* 0.11926Quantumm=Quantumv* 0.59988

CNR1 Temperature: Resistance(CNR1TK,1,mV200,8,Ix1,1,1675,True,True,200,250,0.01,0)PRT(CNR1TK,1,CNR1TK,1,273.15)CNR1TC=CNR1TK-273.15

Net Radiation: NetR=(CM3Up-CM3Dn)+(CG3Up-CG3Dn)Precipitation PulseCount(RainTips,1,2,2,0,1,0)

back

Page 14: DailySplit_KSK [daily task 00:02] T:\Cr5000_outdata\slowHourly\KSK_RFYYDOY.dat

WXT 510 Mean Data File ConventionWho: Duick Young 22/7/07File convention for data files stored in W:\KCLroof\YYYY\WXT510\MM\File name structure WXTYYYYDDD_15.txt.File Convention started 16th July 2007 (DOY 2197) Flags added 6th August 2007 (DOY 218)Generated by: MATLAB using WXTmeanplot#.m Column Variable Units1 Day of Year (DOY)2 Decimal Time3 Hour4 Minute5 Number of Samples6 Wind Speed Minimum m s-1

7 Wind Speed Mean m s-1

8 Wind Speed Maximum m s-1

9 Air Temperature °C10 Relative Humidity %11 Air Pressure hPa12 U (Wind Component) m s-1

13 V (Wind Component) m s-1

14 Wind Direction °15 Total Rain Accumulation mm16 Total Rain Duration s17 Total Hail Accumulation hits cm-2

18 Total Hail Duration s19 Standard Deviation – Wind Speed Minimum m s-1

20 Standard Deviation – Wind Speed Mean m s-1

21 Standard Deviation – Wind Speed Maximum m s-1

22 Standard Deviation – Air Temperature °C23 Standard Deviation – Relative Humidity %24 Standard Deviation – Air Pressure hPa25 Standard Deviation – U m s-1

26 Standard Deviation – V m s-1

27 Flag Flags1 Data fine5 Less than 90 data lines in 15 minute averaging period6 No data present during 15 minute averaging period

CNR1 Mean Data File ConventionWho: Duick Young 23 March 2009File convention for data files stored in ...\KCLroof\YYYY\CR5000\File name structure RFYYDDD.datFile convention started: 18th August 2008 (DOY 231)Generated by: Simple Tower Program _V1.1.CR3

Column Variable Units1 Year2 Month3 Day4 Hour5 Minute6 Kdn- Average W m-2

7 Kdn-- Standard Deviation W m-2

8 Kup - Average W m-2

9 Kup - Standard Deviation W m-2

10 Ldn-- Average W m-2

11 Ldn-- Standard Deviation W m-2

12 Lup - Average W m-2

13 Lup - Standard Deviation W m-2

14 CNR1 Temperature - Average °C15 CNR1 Temperature – StDev ° C16 CNR1 Temperature – Average K17 CNR1 Temperature – StDev K18 Net Radiation – Average W m-2

19 Net Radiation – StDev W m-2

20 UVA – Average μmol m-2 s-1

21 UVB – Average μmol m-2 s-1

22 Quantum (PAR) – Average μmol m-2 s-1

23 UVA – Average W m-2

24 UVB – Average W m-2

25 Quantum (PAR) – Average W m-2

26 UVA - Standard Deviation μmol m-2 s-1

27 UVB - Standard Deviation μmol m-2 s-1

28 Quantum (PAR) – StDev μmol m-2 s-1

29 Quantum (PAR) – StDev μmol m-2 s-1

30 Tipping Bucket Rain Gauge mm

back

Page 15: DailySplit_KSK [daily task 00:02] T:\Cr5000_outdata\slowHourly\KSK_RFYYDOY.dat

WXT 510/CNR1 Mean Data File Convention Who: Duick Young 6 Aug 2007File convention for data files stored in W:\KCLroof\YYYY\WXT510\MM\File name structure LRYYYYDDD_15.txt.File Convention started 25th July 2007 (DOY 206) Flag (Column 27) added 3rd August 2007 (DOY 214) Tipping Bucket Raingauge added 18 August 2008 (DOY 231)Generated by: MATLAB using WXTmeanplot#.m Column Variable Units1 Day of Year (DOY)2 Decimal Time 3 Hour 4 Minute 5 Number of Samples6 Wind Speed Minimum m s-1

7 Wind Speed Mean m s-1

8 Wind Speed Maximum m s-1

9 Air Temperature °C10 Relative Humidity%11 Air Pressure hPa12 U (Wind Component) m s-1

13 V (Wind Component) m s-1

14 Wind Direction°15 Total Rain Accumulation mm16 Total Rain Durations17 Total Hail Accumulation hits cm-2

18 Total Hail Durations19 StDev – Wind Speed Minimum m s-1

20 StDev– Wind Speed Mean m s-1

21 StDev– Wind Speed Maximum m s-1

22 StDev– Air Temperature °C23 StDev– Relative Humidity %24 StDev– Air Pressure hPa

Column Variable Units

25 StDev– U m s-1

26 StDev– V m s-1

27 Flag 28 K¯ - Average W m-2

29 K¯- Standard Deviation W m-2

30 K↑ - Average W m-2

31 K↑- Standard Deviation W m-2

32 L¯- Average W m-2

33 L¯- Standard Deviation W m-2

34 L↑ - Average W m-2

35 L↑ - Standard Deviation W m-2

36 CNR1 Temperature – Average °C37 CNR1 Temperature - Standard Deviation °C38 CNR1 Temperature – Average K39 CNR1 Temperature - Standard Deviation K40 Net Radiation – Average W m-2

41 Net Radiation - Standard Deviation W m-2

42 UVA – Average μmol m-2 s-1

43 UVB – Average μmol m-2 s-1

44 Quantum (PAR) – Average μmol m-2 s-1

45 UVA – Average W m-2

46 UVB – Average W m-2

47 Quantum (PAR) – Average W m-2

48 UVA - Standard Deviation μmol m-2 s-1

49 UVB - Standard Deviation μmol m-2 s-1

50 Quantum (PAR) - Standard Deviation μmol m-2 s-1

51 Surface Albedo 52 Rain (Tipping Bucket) mm

Flags1Data fine5Less than 90 data lines in 15 minute averaging period6No data present during 15 minute averaging period

back

Page 16: DailySplit_KSK [daily task 00:02] T:\Cr5000_outdata\slowHourly\KSK_RFYYDOY.dat

TROUBLESHOOT

• In case data have been collected by Roof8 or Roof3 but are missing on Otago,grab data with: D:\roof\co2\wxtGasGrabCeilAB_GetMissingData.m (latest version)

1. Adjust time settings in the code• Year• Month• Day• hour_orig (the first hour to be moved)• Nperiods (number of hourly periods in one day – run program separately for each day)

2. check file sizes are correct in I:\YYYY\London\$site\WXT510\FORMAT_L0\WXTYYYYDOY_HH.txt

3. Rerun scripts on data01: /home/micromet/Roofprograms1) WXT/WXTDataPro.R2) WXT/PlotMetObs.sh

4. For radiation (CNR’s, SPN1, Eppleys, Skye) and ARG100 dataset1) Rerun matlab program on Otago D drive:/Roof/Rad_Rain/RadRainNncdf.m2) Rerun script at data02:/home/micromet/script/cronJobs/ -> mergeARG.sh and

mergeRAD.sh

back