New insights on model evaluation inspired by the stochastic simulation paradigm

Efstratiadis, A

dc.contributor.author	Efstratiadis, A	en
dc.date.accessioned	2014-03-01T02:54:06Z
dc.date.available	2014-03-01T02:54:06Z
dc.date.issued	2011	en
dc.identifier.uri	https://dspace.lib.ntua.gr/xmlui/handle/123456789/36608
dc.title	New insights on model evaluation inspired by the stochastic simulation paradigm	en
heal.type	conferenceItem	en
heal.publicationDate	2011	en
heal.abstract	The working paradigm for evaluating the performance of practically any kind of mathematical model is based on metrics that assess an “average” departure between modelled outputs and observations (i.e. residuals). Yet, the outputs of hydrological, hydrogeological and climatic models are not deterministic responses against known or predictable inputs; they are stochastic variables, the interpretation of which should, consequently, be implemented in statistical terms. In addition, these processes exhibit multiple peculiarities (seasonality, long-term persistence, intermittency, skewness, spatial variability), which are rather impossible to be accounted for within a single measure (typically efficiency or other least square error expression). In this context, a comprehensive statistical framework is discussed for the evaluation of such models, seeking for the reproduction of a number of statistical characteristics of the observed data, instead of focusing to optimize an “overall” distance measure. This is inspired by the requirements of advanced stochastic simulation schemes, which are by definition built to preserve the essential statistics of the parent (i.e. historical) time series (marginal and joint statistics). This is a key concept, ensuring the generation of synthetic data that are statistically equivalent to the historical ones. The proposed framework emphasises the following issues: (a) the statistical comparison of computed and observed data at multiple time scales, to account for the variability of the modelled processes in both the short and the long term; (b) the preservation of the observed cross-correlations in multi-response calibration, to represent the interrelationship of the physical processes under study, and (c) the investigation of the model response under different stress conditions, preferably using synthetic data of appropriate length; this allows recognising structural deficiencies and irregular behaviours, which are hard to identify within the, typically short, period of observations. The above issues are analysed using examples from a number of modelling works, where initial calibration approaches, following typical hydrological practices, may result in misleading conclusions.	en