|
|
![]() |
weather.gov | |
![]() |
![]() |
||
| Home | NWS News | NWS Organization |
|
Home >
NDACC Goals and Organization
>
NDACC Protocols
>
Appendix II - UV/Vis Instruments
Appendix II - UV/Vis InstrumentsP. V. Johnston, J-P. Pommereau and H. K. Roscoe Revision - November 1998 (finalised August 1999)
Introduction This document describes the validation process for new zenith viewing UV/Vis instruments, and the criteria for maintaining data quality from existing instruments. It is written to cover measurements of the species NO2 and ozone, which are the ones most accurately measured using the zenith sky viewing technique at this time. However, much of this document will also apply to measurements of the species OClO and BrO. NO2 and ozone were the primary species measured at the most recent NDACC UV/Vis Instrument Intercomparison which was held at the Observatoire de Haute-Provence (OHP), France, in June 1996, and this revison of the appendix includes new procedures advanced after discussions with the UV/Vis community at OHP. The SCUVS-3 BrO working group also held a BrO measurement intercomparison at OHP in 1996 following the formal NDACC intercomparison, and the resulting report is expected to be a reference for future NDACC BrO measurement intercomparisons. The reports on the UV/Vis Data Analysis Intercomparison in 1991, the Lauder Instrument Intercomparison in 1992 and the OHP Instrument Intercomparison, should be read with this document (see references). Because UV/Vis spectroscopic measurements are used to answer a variety of scientific questions, this appendix will attempt to define the certification of groups and their instruments for two applications: (Further ones should be defined in the future.) (1) NDACC trend determination and global studies; (2) NDACC stratospheric chemistry process studies and satellite validation. Trend measurements and global studies require a long term dedicated approach to the maintenance of the quality of the measurements and the archiving of data. To determine long term trends requires stable and well calibrated instruments operated by groups that have a thorough understanding of the measurement technique and who have demonstrated competence in the management of long term programmes. Global studies include, for example, identifying possible interhemispheric asymmetries of species such as NO2, which requires the maintenance of good inter-instrument calibration. Type (1) measurements of the highest possible accuracy at solar zenith angles up to 95° in the visible are the most suitable for NO2 vertical profiling (Preston et al., in preparation). Because type (1) studies would probably involve instruments permanently located at primary or secondary sites, instrument portability and deployment flexibility are not important criteria. In contrast, process studies and satellite validation campaigns would be better facilitated by a denser network of measurements at locations (such as polar regions) being studied to answer specific questions. Except for intercomparisons, accuracy and long term stability would be less important in this case, whereas deployment flexibility plus operational reliability in hostile environments would be more important. Typical of the issues that can and have been investigated in such campaigns are: Antarctic total ozone measurements, NO2 seasonal cycles, SAGE / TOMS / GOME / ENVISAT etc., satellite validations and PSC statistics. Some satellite validations may require type (1) measurements after the initial debug stage however. Ideally a network of a few type (1) measurements and many type (2) measurements in polar regions would best serve vortex and collar region chemistry studies. This multiple specification approach will be extended to cover further scientific needs as they are identified. Such an approach is more realistic with UV/Vis instruments because their cost is lower than IR or microwave instruments. The accuracy of vertical column derived from zenith measurements is determined by several factors: measurement accuracy (random and systematic), airmass factor (AMF) calculations and the errors introduced by multiple scattering in clouds containing pollution (mainly in the continental northern hemisphere). The limiting accuracy of the most accurate instruments operating at clean sites is determined by the accuracy of the AMF calculations and the accuracy of the calculation of the NO2/O3 amount in the reference spectrum. Work to address AMF and cloud effect modeling limitations is a planned future UV/Vis activity. To summarise, the principal acceptance criteria for each type are: type (1) certification; highest possible accuracy and long term commitment: type (2) certification; the ability to deploy instruments that can operate reliably in a remote environment and that have an accuracy adequate to answer the scientific questions posed.
Evaluation of Instrument Design and Data Analysis Before a formal intercomparison with a certified instrument is planned, the group whose instrument is being assessed may be asked to supply the following to the NDACC steering committees UV/Vis Instrument Group or designated representative.
Discussions and data exchange between the PI and the Instrument Group may be required, as the Instrument Group must be satisfied with this part of the evaluation before proceeding to an intercomparison.
Instrument Intercomparison The instrument intercomparison must follow the blindness rules detailed below and adhere to the general philosophy of the NDACC Instrument Intercomparison Protocol. The instrument specific requirements of this protocol follow. In the general case, one or more new instruments are to be evaluated by comparison with an already certified instrument or instruments (called the reference instrument(s) in the following) under the supervision of an impartial referee. The certified instrument(s) to be used will be designated by the Instrument Group.
Acceptance Criteria for New, Primary and Complementary Instruments The Instrument Group or its designated representative(s) will examine the results of the Intercomparison and make a recommendation to the NDACC Steering Committee. While a number of factors may enter the considerations, the principal criteria for the two types of certification currently used are as follows.
Type (1), Global studies and Trend Measurements Because no absolute calibration is possible, accuracy is determined by quantifying the accuracy of each instrument being considered for certification, relative to the designated reference instrument(s) and, as appropriate, other instruments that are assessed as producing high quality results. Spectral measurements made during the intercomparison period will be analysed by all participants using agreed criteria (wavelength interval, cross sections, etc.) to obtain their intercomparison results. A reliable method to determine which instruments meet this certification type is a regression analysis (Roscoe et al., 1998). This intercompares, using linear regression, all combinations of the twilight sets of measurements. Each set must include the results for a range of measurement SZAs, typically 70 to 93 degrees. Matrices of residual error, slope and intercept are generated in order to identify the instruments that agree most closely. The results from these instruments can then be used as the reference results for comparing the results of the other participating instruments against. In 1996 at the OHP intercomparison, the NO2 results from three instruments, (one was the designated reference instrument) agreed to within 1.00 (+0.00 -0.02) in slope and 0.00 (+0.02 -0.07) cm-2 in intercept in one analysis (same wavelength interval and NO2 cross sections), with similar or better ozone results. This close agreement is the basis for choosing the following figures as reasonably achievable at this time: NO2 Regression Accuracy Slope = 1.00 ± 0.05 Intercept = ± 0.15 x 1016 cm-2 Residual <= 0.10 x 1016 cm-2 Ozone Regression Accuracy Slope = 1.00 ± 0.03 Intercept = ± 0.15 x 1019 cm-2 Residual <= 0.10 x 1019 cm-2 Groups with intercomparison results that meet these accuracy criteria together with the general acceptance criteria (below), and who are able to meet the quality control and long term commitment requirements, should be certified for type (1), global studies and trend measurements. These specifications are not to taken as a rigid criterion for certification, but rather as a goal which can now be meet. Some groups may have instruments that produce results that are close to these figures over a more limited SZA range and these should be considered on their merits. Limited certification can be used to recognise the potential of such instruments and the groups given assistance by the fully certified groups to improve their measurement accuracy. The conversion of measured slant columns to vertical columns, using existing air mass factor (AMF) calculations, results in AMF errors that are greater than the measurement errors being sought in the above specifications, suggesting that these specifications are too tight. However, data of higher quality must be sought because, in the long term it can reasonably be expected that AMF calculations (including those at high solar zenith angles) will improve. Ancillary measurements, such as accurate meteorological parameters, aerosol profiles and cloud data, which are now available at many NDACC sites, will play an important role in these improvements. Other reasons for seeking the highest possible accuracy are the detection of trends in slant column amounts and the need for high accuracy measurements when making NO2 height retrievals, particularly at high SZAs, (Preston et al., in preparation).
General Acceptance Criteria for type (1) Certification
Type (2), Process Studies and Satellite Validation Other methods to analyse intercomparison results can also be used to determine certification. One method that is being developed is to use measurements taken over the more limited range of SZAs, 85 to 91 degrees. These are converted to one vertical column result for each twilight measurement set by averaging the 85 to 91 degrees measurements after scaling each one by the air mass factor for the SZA of the measurement. Most instruments produce their most accurate measurements in this SZA range. Such an intercomparison method is a variation on the fractional difference technique used in the 1996 OHP intercomparison (Roscoe et al., 1998). It is expected that this technique is more suitable for certifying type (2) instruments. Using airmass factor weighted values also allows results obtained using different wavelength intervals to be compared (subject to the errors arising from the airmass calculations). Ratios of the derived (airmass factor weighted) vertical columns are used to measure the agreement between the reference and compared instruments. For a 10 day intercomparison, 20 twilight periods, and therefore 20 such ratios, provide sufficient data from which a mean ratio and a fractional standard deviation of this mean ratio can be estimated. These statistics are used to assess the agreement of both NO2 and ozone measurements. Because both AM and PM results are available from the NO2 measurements intercomparison, an offset value can be estimated by using a linear regression on the campaigns (>= 10 days) results. Because AM mid-latitude NO2 values are typically 0.6 times the PM values, the error on such an estimate is expected to be acceptable in determining the offset tabled below for NO2. A suggested accuracy for certification is: NO2 Agreement Ratio = 1.00 ± 0.10 Standard Deviation <= 0.05 Offset = ± 0.25 x 1016 cm-2 Ozone Agreement Ratio = 1.00 ± 0.05 Standard Deviation <= 0.03 Groups with an instrument that meets these accuracy criteria in a formal intercomparison and who are able to participate in process study campaigns with reliable instruments, should be certified for type (2), process studies and satellite validation measurements. Most of the General Acceptance Criteria for type (1) certification also apply to type (2) certification with some relaxation of limits. The working group will define these as required.
Instrument Tests Resolution (slit function) The slit function full width half max. (FWHM) should be appropriate for the specie being measured. This is typically <1.5 nm for NO2. Stray Light Levels Using a Schott glass filter that cuts off light below a wavelength that is just above the highest wavelength used for measurements, gives some estimate of stray light levels. The limitation of using this technique is that the filter cuts a fraction (between a factor of 2 and 3 from model calculations for a GG475 filter) of the light that would otherwise contribute to the stray light signal. When the measured stray light is small (<0.2% of the light measured without the filter) this error is not important. However, with some array detector spectrographs the stray light levels are > 0.5% so this error is a problem. Another way to estimate stray light levels is to rotate the grating to below the atmospheric cutoff wavelength (∼300 nm) and measure the signal. This is often not an option however. Stray light produces errors that are approximately proportional to the fraction of stray light in a measured spectrum. For a 1% stray light level, a 1% error in NO2 and O3 measurements occurs. The ratio technique does not cancel this error. Another spectral artifact that can affect UV/Vis measurements is due to re-entrant light which can produce unwelcome structures in measured spectra. Generally this only occurs when Zerner-Turner spectrometers with grating rulings < 600 groves/mm are used in the UV region. The occurrence of re-entrant light can be predicted in the spectrometer design. Polarisation Two assessments of the polarisation tests are required to determine if an instrument is capable of making high quality zenith sky measurements. The first is the variation with wavelength of Tp/Ts, where Tp is the relative transmission with the polariser parallel to the entrance slit and Ts the relative transmission with the polariser normal to the slit. Ring effect, which is primarily due to rotational Raman scattering, will vary with wavelength when clear sky twilight measurements are made with a instrument that does not have Tp = constant x Ts. Misfit of the Ring cross section can result, with consequent errors in the measured absorbers due to correlation of the fitted cross sections with the residual of the Ring fit. A variation of 20% across the 435 - 450 nm wavelength region has been found experimentally to be acceptable (< ± 0.1 x 1016 molec. cm-2 offset) in tests at NIWA, Lauder. All the campaign instruments met this criterion. The second assessment required is to estimate the effect that differences between Tp and Ts have on NO2 measurement errors (%) due to the rotation Raman light in the spectra, i.e., Ring effect. A good reference on this question is Fish and Jones, 1995, who estimate that approximately 7% of the light in a twilight spectrum is due to rotational Raman scattering. Because the spectral shape of NO2 is largely lost in the Raman scattered light, due to the smoothing effect of the stokes and antistokes lines, the error in NO2 measurements due to this light can be estimated by treating it as a simple offset added to the Rayleigh + Mie scattered light. A 7% Ring amount will therefore produce an NO2 error of approximately 7%. In actual measurements, the Ring amount depends on the polarisation characteristics of the instrument and the presence of cloud, which can partially depolarise the normally polarised clear sky Rayleigh scattered light. In measurements at NIWA Lauder, the amount ranges between 2 and 7% for both polarised and unpolarised instruments over the twilight period. This can be approximately corrected for in the data analysis. The question of how a Tp/Ts ratio that is different to 1.0 affects the Ring amount can be estimated for the worse case, that is, when the instrument is oriented so that the highest transmission axis is aligned parallel to the sun zenith plane and when the twilight sky is very clean and clear. This is the orientation that produces a minimum signal. For a Tp/Ts = 2 or 0.5, the Ring amount would increase to approximately 9%, while for a Tp/Ts = 4 or 0.25, it would increase to nearly 12%. For Ts or Tp = 0, it increases to over 20%, a figure that is clearly too high for good NO2 measurements. A criterion of 0.5 < Tp/Ts < 2.0 has been chosen as a reasonable value for NDACC instruments. A further source of error that arises when Tp is very different to Ts, is the change in airmass that results. One test by NIWA using a polarised system showed a 5% difference in ozone airmass between measurements taken using opposite polarisations.
Data Quality Maintenance and the Responsibilities of Certified Groups
References NDACC UV/Visible Data Analysis Intercomparison: Workshop Report compiled by Susan Solomon from material presented at the Data Analysis Workshop held at the NOAA Aeronomy Laboratory, Boulder, Colorado, 23-25 July, 1991 International Intercomparison of Stratospheric NO2 UV/Vis Measuring Instruments: Referees Report prepared for the Instrument Intercomparison Workshop held at Boulder, Colorado, 13-15 October, 1992, by David Hofmann (formal referee). UV/Vis Intercomparison II; Retrievals of NO2, O3, OClO from Synthetic Spectra: Report prepared and presented by Aaron Goldman (Data Analysis Intercomparison Referee) at the Instrument Intercomparison Workshop held at Boulder, Colorado, 13-15 October, 1992. Hofmann, D., P. Bonasoni, M. De Maziere, F. Evangelisti, G. Giovanelli, A. Goldman, F. Goutail, J. Harder, R. Jakoubek, P. Johnston, J. Kerr, W. Matthews, T. McElroy, R. McKenzie, G. Mount, U. Platt, JP. Pommereau, A. Sarkissian, P. Simon, S. Solomon, J. Stutz, A. Thomas, M. Van Roozendael, and E. Wu, Intercomparison of UV/visible spectrometers for measurements of stratospheric NO2 for the network for the detection of stratospheric change, J. Geophys. Res., 100, 16,765, 1995. Roscoe, H.K.; Johnston, P.V.; Van Roozendael, M.; Richter, A.; Roscoe, J.; Preston, K.E.; Lambert, J.-C.; Hermans, C.; DeCuyper, W.; Dzienus, S.; Winterrath, T.; Burrows, J.; Sarkissian, A.; Goutail, F.; Pommereau, J.-P.; D'Almeida, E.; Hottier, J.; Coureul, C.; Didier, R.; Pundt, I.; Barlett, L.M.; McElroy, C.T.; Kerr, J.E.; Elokhov, A.; Giovanelli, G.; Ravegnani, F.; Premuda, M.; Kostadinov, I.; Erle, F.; Wagner, T.; Pfeilsticker, K.; Kenntner, M.; Marquard, L.C.; Gil, M.; Puentedura, O.; Arlander, W.; Kastad Hoiskar, B.A.; Tellefsen, C.W.; Heese, B.; Jones, R.L.; Aliwell, S.R.; Freshwater, R.A. (Accepted, October 1998). Slant column measurements of O3 and NO2 during the NDACC intercomparison of zenith-sky UV-visible spectrometers in June 1996. Journal of Atmospheric Chemistry, 32: 281 - 314, 1999. Certification Assessment for NDACC UV/Vis Instrument Intercomparison, Observatoire Haute Provence, France 12 - 21 June, 1996: report compiled by Paul Johnston from material in Roscoe et al., and additional regression analyses not otherwise published. Presented to NDACC Steering Committee, December 1998.
|
|||||||||||||||||||||||||||||||||||||||||||