A comprehensive benchmarking system for evaluating global vegetation models.

Kelley, D.I., Prentice, I. C., Harrison, S.P. ORCID: https://orcid.org/0000-0001-5687-1903, Wang, H., Simard, M., Fisher, J.B. and Willis, K.O. (2012) A comprehensive benchmarking system for evaluating global vegetation models. Biogensciences Discussions, 9. pp. 15723-15785. ISSN 1810-6285 doi: 10.5194/bgd-9-15723-2012

Abstract/Summary

We present a benchmark system for global vegetation models. This system provides a quantitative evaluation of multiple simulated vegetation properties, including primary production; seasonal net ecosystem production; vegetation cover, composition and 5 height; fire regime; and runoff. The benchmarks are derived from remotely sensed gridded datasets and site-based observations. The datasets allow comparisons of annual average conditions and seasonal and inter-annual variability, and they allow the impact of spatial and temporal biases in means and variability to be assessed separately. Specifically designed metrics quantify model performance for each process, 10 and are compared to scores based on the temporal or spatial mean value of the observations and a “random” model produced by bootstrap resampling of the observations. The benchmark system is applied to three models: a simple light-use efficiency and water-balance model (the Simple Diagnostic Biosphere Model: SDBM), and the Lund-Potsdam-Jena (LPJ) and Land Processes and eXchanges (LPX) dynamic global 15 vegetation models (DGVMs). SDBM reproduces observed CO2 seasonal cycles, but its simulation of independent measurements of net primary production (NPP) is too high. The two DGVMs show little difference for most benchmarks (including the interannual variability in the growth rate and seasonal cycle of atmospheric CO2), but LPX represents burnt fraction demonstrably more accurately. Benchmarking also identified 20 several weaknesses common to both DGVMs. The benchmarking system provides a quantitative approach for evaluating how adequately processes are represented in a model, identifying errors and biases, tracking improvements in performance through model development, and discriminating among models. Adoption of such a system would do much to improve confidence in terrestrial model predictions of climate change 25 impacts and feedbacks.

Item Type	Article
URI	https://reading-clone.eprints-hosting.org/id/eprint/32219
Identification Number/DOI	10.5194/bgd-9-15723-2012
Refereed	Yes
Divisions	Interdisciplinary Research Centres (IDRCs) > Walker Institute Science > School of Archaeology, Geography and Environmental Science > Earth Systems Science Science > School of Archaeology, Geography and Environmental Science > Department of Geography and Environmental Science
Publisher	Copernicus on behalf of the European Geosciences Union
Download/View statistics	View download statistics for this item

Available Versions of this Item

• A comprehensive benchmarking system for evaluating global vegetation models. (deposited 19 Apr 2013 08:35) [Currently Displayed]
  • A comprehensive benchmarking system for evaluating global vegetation models. (deposited 07 Feb 2014 13:04)