1
Data Processing and Archival in the Marine Optical Buoy Project (MOBY) B. Carol Johnson, Dennis K. Clark, Steven W. Brown, Michael E. Feinholz, Mark A. Yarbrough, Stephanie J. Flora, Darryl Peters, Terrence Houlihan and Yong Sung Kim Distribution and Archival of Data The satellite band averaged values for L w , E s , and L wn are downloaded automatically to NASA. They are also displayed on the internet, see http://physoce.mlml.calstate.edu/moby/ . These data are also password-protected and are available to NASA authorized users. Requests for access authorization should be made to NASA. Data Submissions In October of 2006 spectral MOBY data from deployments 2-32 were provided to NASA. This data included upwelled radiance (L u ), surface irradiance (E s ), downwelled irradiance (E d ) and upwelled irradiance (E u ). All of the satellite weighted products were also provided. The data are in the Moss Landing database format (MLdbase). Documentation describing the format and ancillary data have been included . Summary The MOBY data consist of a nine year record of in situ radiometric measurements. The values are derived using a robust system of multiple calibration and measurement procedures. Extensive instrument characterizations are the basis for correction of known systematic effects. The data are made available to users according to NASA guidelines. Mar Sep Mar Sep Mar Sep Mar Sep Mar Sep Mar Sep Mar Sep Mar Sep 0 0.5 1 1.5 2 2.5 Sequential Day MODIS-1 Lw7 Total-Band (μW/cm²/sr/nm) 1998 1999 2000 2001 2002 2003 2004 2005 Band8 Band9 Band10 Band11 Band12 Band13 400 500 600 700 800 900 10 -5 10 -4 10 -3 10 -2 10 -1 10 0 10 1 10 2 10 3 Wavelength (nm) MOBY data set Es LuTop LuMid LuBot EdTop EdMid EdBot EuMOS Mooring Buoy •Wind velocity •Surface pressure •Air temperature •Relative humidity •Sea surface temperature •Sea surface conductivity •Photosynthetically Active Radiation 350 400 450 500 550 600 650 700 750 800 850 900 0 0.5 1 1.5 2 2.5 3 3.5 x 10 4 Wavelength (nm) MOBY Lu (ADU) LuTop LuMid Spikes Removed Bad Scan 350 400 450 500 550 600 650 700 750 800 850 900 -0.5 0 0.5 1 1.5 2 2.5 3 3.5 x 10 4 Wavelength (nm) MOBY LuTop (ADU) Light Dark Light-DARK 350 400 450 500 550 600 650 700 750 800 850 900 10 -5 10 -4 10 -3 10 -2 10 -1 10 0 10 1 10 2 10 3 Wavelength (nm) MOBY LuTop (ADU/pix/sec) Blue Spectrograph Red Spectrograph Nov Dec Jan Feb Mar Apr May Jun Jul 29 29.5 30 30.5 31 31.5 32 32.5 33 33.5 34 2003 21 22 23 Sequential Day MOBY Water temperature (C) MOBY221-23 TT7 Temperature used in the thermal corrections In-water TT7 temp LuTop Rsp TT7 Temp LuMid Rsp TT7 Temp LuBot Rsp TT7 Temp TT7 Set Temp 0 5 10 15 20 25 30 35 0.98 1 1.02 1.04 1.06 1.08 Deployment Number Lu Top System Response Ratio (PreCal/PostCal) 411.8 nm 442.1 nm 546.8 nm 665.6 nm 411.8 442.1 546.8 665.6 0.01 0.015 0.02 0.025 0.03 0.035 Wavelength (nm) Pre / Post System Response Stability LuTop LuMid LuBot Dec Mar Jun Sep Dec Mar Jun Sep Dec Mar Jun Sep Dec Mar Jun Sep Dec Mar Jun Sep Dec Mar Jun Sep Dec Mar Jun Sep 0.95 0.96 0.97 0.98 0.99 1 1.01 1.02 1.03 Sequential Day Lamp (ADU/pix/sec) MODIS-1 MOBY Times Series, 22 hour 2000 2001 2002 2003 2004 2005 2006 12 1314 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 B 8, 411.8 nm B 9, 442.1 nm B10, 486.9 nm B11, 529.7 nm B13, 665.6 nm B14, 676.7 nm B15, 746.4 nm B16, 866.2 nm The primary reference instrument for ocean color satellites, including the U.S. Moderate Resolution Imaging Spectroradiometer (MODIS) and the Sea-Viewing Wide Field- of-View Sensor (SeaWiFS), is the Marine Optical Buoy (MOBY), a radiometric buoy stationed in the waters off Lanai, Hawaii. MOBY uses a hyperspectral instrument known as the Marine Optical System (MOS) to detect radiation over the spectral range from 350 nm to 955 nm. In MOBY, MOS is fiber-optically connected to radiance and irradiance ports on the three MOBY arms (denoted Top, Mid, and Bot) that are located at depths of approximately 1.5 m, 5 m, and 9 m, as well as a surface irradiance port. Data acquisition is autonomous and designed to overlap with the overpass of the sun-synchronous satellites, resulting in daily acquisitions at 20 h, 22 h, and 23 h, corresponding to SeaWiFS, MODIS-Terra and MODIS-Aqua, respectively. In this presentation, we describe the processing of the MOBY data sets, including what is collected, analysis and quality control, and dissemination and archival. Pre-processing of the entire data set includes the incorporation of time stamps for the ancillary data, if necessary, rejection of anomalous radiometric scans, and removal of “spikes” in the radiometric data. Multiple scans are averaged, the data are normalized for integration time and bin factor (a sub-sampling along the slit direction in the CCD spectrographs), and the net counts are determined using the associated dark scans. Corrections are made for instrument temperature, which affects the radiometric responsivity as 0.5 %/°C. The temperature correction algorithm is based on laboratory measurements at the MOBY facility in Honolulu using a temperature controlled bath and stable radiometric sources. Optical Buoy •E s , L u (at four depths), E d (at three depths) •CCD parameters (integration time, bin factor, temperature) •Temperatures (instrument and sea water) •Attitude (x, y tilt; pressure at top arm; compass heading) •System housekeeping (battery status, coolant flow, etc.) •Time (onboard, GPS) The optical measurements (e.g., E s and L u ) by MOBY are sequential – the inputs from the different optical fibers are coupled to the spectrographs using an optical multiplexer mirror assembly. A complete data set for L u at each depth includes multiple scans of L u , bracketed by a dark scan; this L u measurement is bracketed in turn by a set of E s scans (which are also bracketed by dark scans). The optical and ancillary data are stored on hard drive until transmittal to a server at MLML via modem and cellular antenna. MOBY Data Processing Corrections are made for spectral stray light effects in the spectrographs. The magnitude of this correction depends on wavelength and the relative spectral shape of the source being measured. The stray light correction algorithm iterates to a solution based on laser characterizations at the MOBY facility. MOBY uses two optical buoys, rotating between them every 3 mo or so. During the deployment of one system, the other is being refurbished and calibrated at the MOBY facility. These wavelength and radiometric calibrations are performed twice on each system – before and after the deployment. This information is used to convert the corrected counts to radiometric data. Next, L u attenuation coefficients, K L , are computed from the different depths, using the possible combinations: Top/Mid arms, Mid/Bot arms, and Top/Bot arms. The average of the surface irradiance measurements that bracket the corresponding L u depths are used to normalize these values in order to correct for any variations in downwelling irradiance. Quality control is incorporated, for example the K L values using different arm pairs must be consistent, GOES visible imagery is used to assess cloud contamination, and provisions are made for special cases, such as a bent upper arm. A clear-water K L , known from optical properties of sea water, is compared to the measured values; if the results are non- physical, the data are marked “bad.” In some cases, the data are flagged as “question- able.” Situations where this may occur are when there is no evidence of clouds but the standard deviations in the E s measurements are larger than what is typically the case. The water-leaving radiances, L w , are computed by upward extrapolation using the K L and L u data and propagation through the surface for nadir viewing. A solar-normalized water leaving radiance, L wn , is calculated by correcting for variations in the Earth-Sun distance and atmospheric transmittance (this is a simplified approach, aerosols are not included). Then, using relative spectral responsivity data provided by the satellite teams, band- averaged radiances are determined for L u (all depths), L w , and the L wn values. Additional quality control data are available. This includes scans of an internal lamp and two internal LEDs, verification of the stability of the wavelength calibration from observation of Fraunhofer lines, and assessment of the system level responsivity utilizing diver- deployed stable calibration lamps on monthly intervals. Upwelled Radiance, L u Increase in UV Better agreement in overlap region Better agreement in overlap region Increase in UV MOS in temperature controlled bath In-water and system response temperatures (ref. is 32°C) MOBY processing steps MOBY System Response Laser data used for stray light correction Single Pixel Responsivity correction matrix Stray light correction ratios for MODIS Bands Pre and post system responses are evaluated for each MOBY deployment once the post calibrations are done and the entire deployments data set have been downloaded and processed. The mean of the pre and post system responses are used when appropriate. The result of all this processing are E s , Lu (at four depths), E d (at three depths), and for some deployments E u at 11 meters, which have been quality checked, thermally corrected, stray light corrected and converted to scientific units. Total files processed: 7660 Total number of good days: 3456 Total number of questionable days: 720 Introduction MOBY Time Series, 22 Hour for MODIS-Terra

Data Processing and Archival in the Marine Optical Buoy Project (MOBY… · presentation, we describe the processing of the MOBY data sets, including what is collected, analysis and

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Data Processing and Archival in the Marine Optical Buoy Project (MOBY… · presentation, we describe the processing of the MOBY data sets, including what is collected, analysis and

Data Processing and Archival in the Marine Optical Buoy Project (MOBY)B. Carol Johnson, Dennis K. Clark, Steven W. Brown, Michael E. Feinholz, Mark A. Yarbrough, Stephanie J. Flora, Darryl Peters, Terrence Houlihan and Yong Sung Kim

Distribution and Archival of Data

The satellite band averaged values for Lw, Es, and Lwn are downloaded automatically to NASA. They are also displayed on the internet, see http://physoce.mlml.calstate.edu/moby/. These data are also password-protected and are available to NASA authorized users. Requests for access authorization should be made to NASA.

Data Submissions

In October of 2006 spectral MOBY data from deployments 2-32 were provided to NASA. This data included upwelled radiance (Lu), surface irradiance (Es), downwelled irradiance (Ed) and upwelled irradiance (Eu). All of the satellite weighted products were also provided. The data are in the Moss Landing database format (MLdbase). Documentation describing the format and ancillary data have been included .

Summary

The MOBY data consist of a nine year record of in situ radiometric measurements. The values are derived using a robust system of multiple calibration and measurement procedures. Extensive instrument characterizations are the basis for correction of known systematic effects. The data are made available to users according to NASA guidelines.

Mar Sep Mar Sep Mar Sep Mar Sep Mar Sep Mar Sep Mar Sep Mar Sep0

0.5

1

1.5

2

2.5

Sequential Day

MO

DIS

-1 L

w7

Tot

al-B

and

(µW

/cm

²/sr

/nm

)

MOBY Times Series, 22 hour

1998 1999 2000 2001 2002 2003 2004 2005 Band8Band9Band10Band11Band12Band13

400 500 600 700 800 90010-5

10-4

10-3

10-2

10-1

100

101

102

103

Wavelength (nm)

MO

BY

dat

a se

t

EsLuTopLuMidLuBotEdTopEdMidEdBotEuMOS

Mooring Buoy

•Wind velocity

•Surface pressure

•Air temperature

•Relative humidity

•Sea surface temperature

•Sea surface conductivity

•Photosynthetically Active Radiation

350 400 450 500 550 600 650 700 750 800 850 9000

0.5

1

1.5

2

2.5

3

3.5x 104

Wavelength (nm)

MO

BY

Lu

(AD

U)

LuTopLuMid

Spikes Removed

Bad Scan

350 400 450 500 550 600 650 700 750 800 850 900-0.5

0

0.5

1

1.5

2

2.5

3

3.5x 104

Wavelength (nm)

MO

BY

LuT

op (

AD

U)

LightDarkLight-DARK

350 400 450 500 550 600 650 700 750 800 850 90010-5

10-4

10-3

10-2

10-1

100

101

102

103

Wavelength (nm)

MO

BY

LuT

op (

AD

U/p

ix/s

ec)

Blue SpectrographRed Spectrograph

Nov Dec Jan Feb Mar Apr May Jun Jul29

29.5

30

30.5

31

31.5

32

32.5

33

33.5

34

200321 22 23 24

Sequential Day

MO

BY

Wat

er te

mpe

ratu

re (

C)

MOBY221-23 TT7 Temperature used in the thermal corrections

In-water TT7 tempLuTop Rsp TT7 TempLuMid Rsp TT7 TempLuBot Rsp TT7 TempTT7 Set Temp

0 5 10 15 20 25 30 350.98

1

1.02

1.04

1.06

1.08

Deployment Number

Lu T

op S

yste

m R

espo

nse

Rat

io (

Pre

Cal

/Pos

tCal

)

411.8 nm442.1 nm546.8 nm665.6 nm

411.8 442.1 546.8 665.60.01

0.015

0.02

0.025

0.03

0.035

Wavelength (nm)

Pre

/ P

ost S

yste

m R

espo

nse

Sta

bilit

y

LuTopLuMidLuBot

DecMarJunSepDecMarJunSepDecMarJunSepDecMarJunSepDecMarJunSepDecMarJunSepDecMarJunSep0.95

0.96

0.97

0.98

0.99

1

1.01

1.02

1.03

Sequential Day

Lam

p (A

DU

/pix

/sec

)

MODIS-1 MOBY Times Series, 22 hour

2000 2001 2002 2003 2004 2005 200612 1314 15 16 17 18 19 20 21 2223 24 25 26 27 28 29 30 31 32 33 34 B 8, 411.8 nm

B 9, 442.1 nmB10, 486.9 nmB11, 529.7 nmB13, 665.6 nmB14, 676.7 nmB15, 746.4 nmB16, 866.2 nm

The primary reference instrument for ocean color satellites, including the U.S. Moderate Resolution Imaging Spectroradiometer (MODIS) and the Sea-Viewing Wide Field-of-View Sensor (SeaWiFS), is the Marine Optical Buoy (MOBY), a radiometric buoy stationed in the waters off Lanai, Hawaii. MOBY uses a hyperspectral instrument known as the Marine Optical System (MOS) to detect radiation over the spectral range from 350 nm to 955 nm. In MOBY, MOS is fiber-optically connected to radiance and irradiance ports on the three MOBY arms (denoted Top, Mid, and Bot) that are located at depths of approximately 1.5 m, 5 m, and 9 m, as well as a surface irradiance port.

Data acquisition is autonomous and designed to overlap with the overpass of the sun-synchronous satellites, resulting in daily acquisitions at 20 h, 22 h, and 23 h, corresponding to SeaWiFS, MODIS-Terra and MODIS-Aqua, respectively. In this presentation, we describe the processing of the MOBY data sets, including what is collected, analysis and quality control,and dissemination and archival.

Pre-processing of the entire data set includes the incorporation of time stamps for the ancillary data, if necessary, rejection of anomalous radiometric scans, and removal of “spikes” in the radiometric data. Multiple scans are averaged, the data are normalized for integration time and bin factor (a sub-sampling along the slit direction in the CCD spectrographs), and the net counts are determined using the associated dark scans. Corrections are made for instrument temperature, which affects the radiometric responsivity as 0.5 %/°C. The temperature correction algorithm is based on laboratory measurements at the MOBY facility in Honolulu using a temperature controlled bath and stable radiometric sources.

Optical Buoy

•Es, Lu (at four depths), Ed (at three depths)

•CCD parameters (integration time, bin factor, temperature)

•Temperatures (instrument and sea water)

•Attitude (x, y tilt; pressure at top arm; compass heading)

•System housekeeping (battery status, coolant flow, etc.)

•Time (onboard, GPS)

The optical measurements (e.g., Es and Lu) by MOBY are sequential – the inputs from the different optical fibers are coupled to the spectrographs using an optical multiplexer mirror assembly. A complete data set for Luat each depth includes multiple scans of Lu, bracketed by a dark scan; this Lu measurement is bracketed in turn by a set of Es scans (which are also bracketed by dark scans). The optical and ancillary data are stored on hard drive until transmittal to a server at MLML via modem and cellular antenna.

MOBY Data Processing

Corrections are made for spectral stray light effects in the spectrographs. The magnitude of this correction depends on wavelength and the relative spectral shape of the source being measured. The stray light correction algorithm iterates to a solution based on laser characterizations at the MOBY facility.

MOBY uses two optical buoys, rotating between them every 3 mo or so. During the deployment of one system, the other is being refurbished and calibrated at the MOBY facility. These wavelength and radiometric calibrations are performed twice on each system – before and after the deployment. This information is used to convert the corrected counts to radiometric data.

Next, Lu attenuation coefficients, KL, are computed from the different depths, using the possible combinations: Top/Mid arms, Mid/Bot arms, and Top/Bot arms. The average of the surface irradiance measurements that bracket the corresponding Lu depths are used to normalize these values in order to correct for any variations in downwelling irradiance. Quality control is incorporated, for example the KL values using different arm pairs must be consistent, GOES visible imagery is used to assess cloud contamination, and provisions are made for special cases, such as a bent upper arm. A clear-water KL, known from optical properties of sea water, is compared to the measured values; if the results are non-physical, the data are marked “bad.” In some cases, the data are flagged as “question-able.” Situations where this may occur are when there is no evidence of clouds but the standard deviations in the Es measurements are larger than what is typically the case.

The water-leaving radiances, Lw, are computed by upward extrapolation using the KL and Lu data and propagation through the surface for nadir viewing. A solar-normalized water leaving radiance, Lwn, is calculated by correcting for variations in the Earth-Sun distance and atmospheric transmittance (this is a simplified approach, aerosols are not included). Then, using relative spectral responsivity data provided by the satellite teams, band-averaged radiances are determined for Lu (all depths), Lw, and the Lwn values.

Additional quality control data are available. This includes scans of an internal lamp and two internal LEDs, verification of the stability of the wavelength calibration from observation of Fraunhofer lines, and assessment of the system level responsivity utilizing diver-deployed stable calibration lamps on monthly intervals.

Upwelled Radiance, Lu

Increase in UV

Better agreement in overlap regionBetter agreement in overlap region

Increase in UV

MOS in temperature controlled bathIn-water and system response temperatures (ref. is 32°C)

MOBY processing steps

MOBY System Response

Laser data used for stray light correction

Single Pixel Responsivity correction matrix

Stray light correction ratios for MODIS Bands

Pre and post system responses are evaluated for each MOBY deployment once the post calibrations are done and the entire deployments data set have been downloaded and processed. The mean of the pre and post system responses are used when appropriate.

The result of all this processing are Es, Lu (at four depths), Ed (at three depths), and for some deployments Eu at 11 meters, which have been quality checked, thermally corrected, stray light corrected and converted to scientific units.

Total files processed: 7660

Total number of good days: 3456

Total number of questionable days: 720

Introduction

MOBY Time Series, 22 Hour for MODIS-Terra