Comparison of sensitivity analysis techniques: A case study with the rice model WARM

The considerable complexity often included in biophysical models leads to the need of specifying a large number of parameters and inputs, which are available with various levels of uncertainty. Also, models may behave counter-intuitively, particularly when there are nonlinearities in multiple input-output relationships. Quantitative knowledge of the sensitivity of models to changes in their parameters is hence a prerequisite for operational use of models. This can be achieved using sensitivity analysis (SA) via methods which differ for specific characteristics, including computational resources required to perform the analysis. Running SA on biophysical models across several contexts requires flexible and computationally efficient SA approaches, which must be able to account also for possible interactions among parameters. A number of SA experiments were performed on a crop model for the simulation of rice growth (Water Accounting Rice Model, WARM) in Northern Italy. SAs were carried out using the Morris method, three regression-based methods (Latin hypercube sampling, random and Quasi-Random, LpTau), and two methods based on variance decomposition: Extended Fourier Amplitude Sensitivity Test (E-FAST) and Sobol’, with the latter adopted as benchmark. Aboveground biomass at physiological maturity was selected as reference output to facilitate the comparison of alternative SA methods. Rankings of crop parameters (from the most to the least relevant) were generated according to sensitivity experiments using different SA methods and alternate parameterizations for each method, and calculating the top-down coefficient of concordance (TDCC) as measure of agreement between rankings. With few exceptions, significant TDCC values were obtained both for different parameterizations within each method and for the comparison of each method to the Sobol’ one. The substantial stability observed in the rankings seem to indicate that, for a crop model of average complexity such as WARM, resource intensive SA methods could not be needed to identify most relevant parameters. In fact, the simplest among the SA methods used (i.e., Morris method) produced results comparable to those obtained by methods more computationally expensive.