Skill assessment for coupled biological/physical models of marine systems
Stow, Craig A.
McGillicuddy, Dennis J.
Doney, Scott C.
Allen, J. Icarus
Friedrichs, Marjorie A. M.
Rose, Kenneth A.
MetadataShow full item record
Coupled biological/physical models of marine systems serve many purposes including the synthesis of information, hypothesis generation, and as a tool for numerical experimentation. However, marine system models are increasingly used for prediction to support high-stakes decision-making. In such applications it is imperative that a rigorous model skill assessment is conducted so that the model’s capabilities are tested and understood. Herein, we review several metrics and approaches useful to evaluate model skill. The definition of skill and the determination of the skill level necessary for a given application is context specific and no single metric is likely to reveal all aspects of model skill. Thus, we recommend the use of several metrics, in concert, to provide a more thorough appraisal. The routine application and presentation of rigorous skill assessment metrics will also serve the broader interests of the modeling community, ultimately resulting in improved forecasting abilities as well as helping us recognize our limitations.
Author Posting. © Elsevier B.V., 2009. This is the author's version of the work. It is posted here by permission of Elsevier B.V. for personal use, not for redistribution. The definitive version was published in Journal of Marine Systems 76 (2009): 4-15, doi:10.1016/j.jmarsys.2008.03.011.
Showing items related by title, author, creator and subject.
Warner, John C.; Geyer, W. Rockwell; Lerczak, James A. (American Geophysical Union, 2005-05-04)Numerical simulations of the Hudson River estuary using a terrain-following, three-dimensional model (Regional Ocean Modeling System, ROMS) are compared with an extensive set of timeseries and spatially resolved measurements ...
Skill metrics for confronting global upper ocean ecosystem-biogeochemistry models against field and remote sensing data Doney, Scott C.; Lima, Ivan D.; Moore, J. Keith; Lindsay, Keith; Behrenfeld, Michael J.; Westberry, Toby K.; Mahowald, Natalie M.; Glover, David M.; Takahashi, Taro (2008-03-04)We present a generalized framework for assessing the skill of global upper ocean ecosystem-biogeochemical models against in-situ field data and satellite observations. We illustrate the approach utilizing a multi-decade ...
Effect of roughness formulation on the performance of a coupled wave, hydrodynamic, and sediment transport model Ganju, Neil K.; Sherwood, Christopher R. (Elsevier B.V., 2010-03-27)A variety of algorithms are available for parameterizing the hydrodynamic bottom roughness associated with grain size, saltation, bedforms, and wave–current interaction in coastal ocean models. These parameterizations give ...