Improved statistical method for quality control of hydrographic observations

View/ Open
Date
2020-05-04Author
Gourrion, Jérôme
Concept link
Szekely, Tanguy
Concept link
Killick, Rachel E.
Concept link
Owens, W. Brechner
Concept link
Reverdin, Gilles
Concept link
Charpon, Bertrand
Concept link
Metadata
Show full item recordCitable URI
https://hdl.handle.net/1912/25918As published
https://doi.org/10.1175/JTECH-D-18-0244.1DOI
10.1175/JTECH-D-18-0244.1Abstract
Realistic ocean state prediction and its validation rely on the availability of high quality in situ observations. To detect data errors, adequate quality check procedures must be designed. This paper presents procedures that take advantage of the ever-growing observation databases that provide climatological knowledge of the ocean variability in the neighborhood of an observation location. Local validity intervals are used to estimate binarily whether the observed values are considered as good or erroneous. Whereas a classical approach estimates validity bounds from first- and second-order moments of the climatological parameter distribution, that is, mean and variance, this work proposes to infer them directly from minimum and maximum observed values. Such an approach avoids any assumption of the parameter distribution such as unimodality, symmetry around the mean, peakedness, or homogeneous distribution tail height relative to distribution peak. To reach adequate statistical robustness, an extensive manual quality control of the reference dataset is critical. Once the data have been quality checked, the local minima and maxima reference fields are derived and the method is compared with the classical mean/variance-based approach. Performance is assessed in terms of statistics of good and bad detections. It is shown that the present size of the reference datasets allows the parameter estimates to reach a satisfactory robustness level to always make the method more efficient than the classical one. As expected, insufficient robustness persists in areas with an especially low number of samples and high variability.
Description
Author Posting. © American Meteorological Society, 2020. This article is posted here by permission of American Meteorological Society for personal use, not for redistribution. The definitive version was published in Journal of the Atmospheric and Oceanic Technology 37(5), (2020): 789-806, doi:10.1175/JTECH-D-18-0244.1.
Collections
Suggested Citation
Gourrion, J., Szekely, T., Killick, R., Owens, B., Reverdin, G., & Chapron, B. (2020). Improved statistical method for quality control of hydrographic observations. Journal of Atmospheric and Oceanic Technology, 37(5), 789-806.Related items
Showing items related by title, author, creator and subject.
-
Air-sea CO2 fluxes and the controls on ocean surface pCO2 seasonal variability in the coastal and open-ocean southwestern Atlantic Ocean : a modeling study
Arruda, R.; Calil, Paulo H. R.; Bianchi, A. A.; Doney, Scott C.; Gruber, Nicolas; Lima, Ivan D.; Turi, G. (Copernicus Publications on behalf of the European Geosciences Union, 2015-10-12)We use an eddy-resolving, regional ocean biogeochemical model to investigate the main variables and processes responsible for the climatological spatio-temporal variability of pCO2 and the air-sea CO2 fluxes in the ... -
Variability in the mechanisms controlling Southern Ocean phytoplankton bloom phenology in an ocean model and satellite observations
Rohr, Tyler; Long, Matthew C.; Kavanaugh, Maria T.; Lindsay, Keith; Doney, Scott C. (John Wiley & Sons, 2017-05-30)A coupled global numerical simulation (conducted with the Community Earth System Model) is used in conjunction with satellite remote sensing observations to examine the role of top-down (grazing pressure) and bottom-up ... -
Southern Ocean control of silicon stable isotope distribution in the deep Atlantic Ocean
de Souza, Gregory F.; Reynolds, Ben C.; Rickli, Joerg; Frank, Martin; Saito, Mak A.; Gerringa, Loes J. A.; Bourdon, Bernard (American Geophysical Union, 2012-06-19)The fractionation of silicon (Si) stable isotopes by biological activity in the surface ocean makes the stable isotope composition of silicon (δ30Si) dissolved in seawater a sensitive tracer of the oceanic biogeochemical ...