Space-time analysis of the Air Quality Model Evaluation International Initiative (AQMEII) Phase 1 air quality simulations

This study presents an evaluation of summertime ozone concentrations over North America (NA) and Europe (EU) using the database generated from Phase 1 of the Air Quality Model Evaluation International Initiative (AQMEII). The analysis focuses on identifying temporal and spatial features that can be used to stratify operational model evaluation metrics and to test the extent to which the various modeling systems can replicate the features seen in the observations. Using a synoptic map typing approach, it is demonstrated that model performance varies with meteorological conditions associated with specific synoptic-scale flow patterns over both eastern NA and EU. For example, the root mean square error of simulated daily maximum 8-hr ozone was twice as high when cloud fractions were high compared with when cloud fractions were low over eastern NA. Furthermore, results show that over both NA and EU the regional models participating in AQMEII were able to better reproduce the observed variance in ambient ozone levels than the global model used to specify chemical boundary conditions, although the variance simulated by almost all regional models is still less that the observed variance on all spatiotemporal scales. In addition, all modeling systems showed poor correlations with observed fluctuations on the intraday time scale over both NA and EU. Furthermore, a methodology is introduced to distinguish between locally influenced and regionally representative sites for the purpose of model evaluation. Results reveal that all models have worse model performance at locally influenced sites. Overall, the analyses presented in this paper show how observed temporal and spatial information can be used to stratify operational model performance statistics and to test the modeling systems’ ability to replicate observed temporal and spatial features, especially at scales the modeling systems are designed to capture.

Implications: The analyses presented in this paper demonstrate how observed temporal and spatial information can be used to stratify operational model performance and to test the modeling systems’ ability to replicate observed temporal and spatial features. Decisions for the improvement of regional air quality models should be based on the information derived from only regionally representative sites.