Stratified rank histograms for ensemble forecast verification under serial dependence

Bröcker, J. and Bouallègue, Z. B. (2020) Stratified rank histograms for ensemble forecast verification under serial dependence. Quarterly Journal of the Royal Meteorological Society, 146 (729). pp. 1976-1990. ISSN 0035-9009 doi: 10.1002/qj.3778

Abstract/Summary

Rank histograms are a popular way to assess the reliability of ensemble forecasting systems. If the ensemble forecasting system is reliable, the rank histogram should be flat, ``up to statistical fluctuations''. There are two long noted challenges to this approach. Firstly, uniformity of the overall distribution is implied by but does not imply reliability; ideally the distribution of the ranks should be uniform even conditionally on different forecast scenarios. Secondly, the ranks are serially dependent in general, precluding the use of standard goodness--of--fit tests to assess the uniformity of rank distributions without any further precautions. The present paper deals with both these issues by drawing together the concept of stratified rank histograms, which have been developed to deal with the first issue, with ideas that exploit the reliability condition to manage the serial correlations, thus dealing with the second issue. As a result, tests for uniformity of stratified rank histograms are presented that are valid under serial correlations.

Item Type	Article
URI	https://reading-clone.eprints-hosting.org/id/eprint/90143
Identification Number/DOI	10.1002/qj.3778
Refereed	Yes
Divisions	Science > School of Mathematical, Physical and Computational Sciences > Department of Mathematics and Statistics Science > School of Mathematical, Physical and Computational Sciences > Department of Meteorology
Publisher	Royal Meteorological Society
Download/View statistics	View download statistics for this item