Toward harmonizing prospective effectiveness assessment for road safety: Comparing tools in standard test case simulations

Abstract

Objective: With the overall goal to harmonize prospective effectiveness assessment of active safety systems, the specific objective of this study is to identify and evaluate sources of variation in virtual precrash simulations and to suggest topics for harmonization resulting in increased comparability and thus trustworthiness of virtual simulation-based prospective effectiveness assessment.

Methods: A round-robin assessment of the effectiveness of advanced driver assistance systems was performed using an array of state-of-the-art virtual simulation tools on a set of standard test cases. The results were analyzed to examine reasons for deviations in order to identify and assess aspects that need to be harmonized and standardized. Deviations between results calculated by independent engineering teams using their own tools should be minimized if the research question is precisely formulated regarding input data, models, and postprocessing steps.

Results: Two groups of sources of variations were identified; one group (mostly related to the implementation of the system under test) can be eliminated by using a more accurately formulated research question, whereas the other group highlights further harmonization needs because it addresses specific differences in simulation tool setups. Time-to-collision calculations, vehicle dynamics, especially braking behavior, and hit-point position specification were found to be the main sources of variation.

Conclusions: The study identified variations that can arise from the use of different simulation setups in assessment of the effectiveness of active safety systems. The research presented is a first of its kind and provides significant input to the overall goal of harmonization by identifying specific items for standardization. Future activities aim at further specification of methods for prospective assessments of the effectiveness of active safety, which will enhance comparability and trustworthiness in this kind of studies and thus contribute to increased traffic safety.