ESV 2023 will be held in Yokohama, Japan from April 3-6, 2023. P.E.A.R.S. members have submitted following paper to ESV;
'Harmonized approaches for baseline creation in propspective safety performance assessment of driving automation systems', written by: Peter Wimmer, Olaf Op den Camp, Hendrik Weber, Henri Chajmowicz, Michael Wagner, Jorge Lorente Mallada, Felix Fahrenkrog and Florian Denk.
Abstract (shortened):
In the last years, virtual simulations have become an indispensable tool for safety performance assessment of driving automation systems (DAS) and pre-crash technologies which are part of advanced driver assistance systems (ADAS). Different approaches and tools are used in this domain, making comparison of results of different studies difficult.
Therefore, the P.E.A.R.S. initiative was founded to harmonize methods for prospective safety performance assessment and by this make results of such studies more trustworthy and comparable. One essential pillar of such a harmonization is the establishment of the baseline, the dataset to which the performance of the technology under study is compared to when performing prospective assessments. Various ways have been presented in literature for setting up a baseline. For harmonization, these ways need to be analyzed and categorized so that recommendations can be given on when and how to use a certain baselineapproach. The research objective of this paper is to develop general approaches to establish a baseline based on existing ways and second to identify areas of application for each baseline approach.
Based on existing ways, we defined general approaches for setting up a simulation baseline. These baseline approaches can structure all existing ways based on their characteristics and requirements and impacts on safety performance assessment results. Relevant information for each baseline approach is discussed, such as the used
data type(s), data processing steps, applied variations to the original data, application of simulation models, and statistical methods, etc.
We identified three types of baseline approaches:
A) Using concrete ealworld scenarios without modifications.
B) Using modifications of concrete real-world scenarios. Here, real-world scenarios are the basis, but some of the existing measured properties are altered or even new properties are added.
C) Creating synthetic cases where more general data such as distributions of relevant parameters (e.g., from collision, road user behavior, traffic data) and mechanisms possibly leading to collisions are used. The paper will provide examples for each baseline approach.
By the baseline approaches presented, P.E.A.R.S. contributes to the harmonization and acceptance of virtual safety performance assessment of driving automation systems and precrash technologies. This will greatly enhance trustworthiness, comparability and, transparency of results of prospective safety performance assessments.
