Details zur Publikation |
| Kategorie | Textpublikation |
| Referenztyp | Zeitschriften |
| DOI | 10.5194/hess-28-3665-2024 |
Lizenz  |
|
| Titel (primär) | Technical Note: The divide and measure nonconformity – how metrics can mislead when we evaluate on different data partitions |
| Autor | Klotz, D.; Gauch, M.; Kratzert, F.; Nearing, G.; Zscheischler, J.
|
| Quelle | Hydrology and Earth System Sciences |
| Erscheinungsjahr | 2024 |
| Department | CER |
| Band/Volume | 28 |
| Heft | 15 |
| Seite von | 3665 |
| Seite bis | 3673 |
| Sprache | englisch |
| Topic | T5 Future Landscapes |
| Supplements | https://hess.copernicus.org/articles/28/3665/2024/hess-28-3665-2024-supplement.pdf |
| Abstract | The evaluation of model performance is an essential part of hydrological modeling. However, leveraging the full information that performance criteria provide, requires a deep understanding of their properties. This Technical Note focuses on a rather counterintuitive aspect of the perhaps most widely used hydrological metric, the Nash-Sutcliffe Efficiency (NSE). Specifically, we demonstrate that the overall NSE of a dataset is not bounded by the NSEs of all its partitions. We term this phenomenon the "Divide and Measure Nonconformity". It follows naturally from the definition of the NSE, yet because modelers often subdivide datasets in a non-random way, the resulting behavior can have unintended consequences in practice. In this note we therefore discuss the implications of the "Divide and Measure Nonconformity", examine its empirical and theoretical properties, and provide recommendations for modelers to avoid drawing misleading conclusions. |
| dauerhafte UFZ-Verlinkung | https://www.ufz.de/index.php?en=20939&ufzPublicationIdentifier=28849 |
| Klotz, D., Gauch, M., Kratzert, F., Nearing, G., Zscheischler, J. (2024): Technical Note: The divide and measure nonconformity – how metrics can mislead when we evaluate on different data partitions Hydrol. Earth Syst. Sci. 28 (15), 3665 - 3673 10.5194/hess-28-3665-2024 |
|