Subproject
Evaluation & Demonstration
Within the project, both the performance of the AI algorithms and the effect on the user experience play a role. The final evaluation and demonstration will determine to what extent the defined goals of the developed applications have been achieved.
Problem
The final evaluation measures the extent to which the requirements and goals for the developed applications have been achieved. In this project, the dimensions of performance of the AI algorithms and their effect on user experience play a particularly important role.
In contrast to the iterative, development-accompanying evaluation, the final evaluation also focuses on the evaluation within the overall system with regard to the required “real-time” capability, which is evaluated in the context of user studies.
The mid-term and end-of-project demonstrations bring the project results to life.
Solution approach
The learning, adaptive and personalized AI functions developed in work packages 300-500 will exploit synergies and be finally evaluated in three main demonstrations. Here, the developed proposals for handling incorrect and unknown AI outputs will also be evaluated.
Users will be involved in the final evaluation to test the features developed in the project in real time and in terms of UX and AI performance.
For the implementation as well as the mid-term and final presentation, a demonstration concept should be designed so that each partner presents its work in an appropriate way.
Goal
This work package includes all activities related to the final evaluation and demonstration of the results. Primarily, the developed AI functions are to be evaluated and demonstrated in a way that is acceptable and can be experienced by users.
Divided into two subgroup evaluations, both the KARLI applicator user experience and AI performance will be evaluated, while another subgroup will work on preparing for the final presentation demonstration.
Driving scenarios on rural roads or interurban connecting routes will be prioritized for the evaluation and demonstration of the individual applications.
