Assessing and testing prediction uncertainty for single tree-based models: A case study applied to northern hardwood stands in southern Québec, Canada

Estimating prediction uncertainty for a single tree-based model is hindered by the complex structure of these models. In this paper, we addressed this issue with a case study applied to northern hardwood stands in Québec, Canada. SaMARE is a stochastic single tree-based model that was designed for these types of stands. Using a Monte Carlo approach, the model can provide a mean predicted value and its confidence limits for some plot-level attributes.The mean predicted values were compared to observed values in terms of bias and accuracy. In addition to these common statistics, we compared nominal coverage of Monte Carlo-simulated confidence intervals with real (observed) coverage to verify the adequacy of the simulated uncertainty. A comparison was made using several plot-level attributes, which exhibited an increasing discriminative complexity. This complexity ranges from coarse attributes, such as all-species basal area, up to more complex ones, such as basal area for stems of a particular species and with sawlog potential.The results showed that in terms of absolute value, biases were small, but could be relatively high with respect to the average observed value when the discriminative complexity of the attribute increased. The comparison between nominal and real coverage of confidence intervals gave satisfactory results for all-species plot-level attributes. However, for some species-specific attributes, the Monte Carlo-simulated confidence intervals overestimated the real coverage.