Evaluation & Demonstration

Within the project, both the performance of the AI algorithms and the effect on the user experience play a role. The final evaluation and demonstration will determine to what extent the defined goals of the developed applications have been achieved.


The final evaluation measures the extent to which the requirements and goals for the developed applications have been achieved. In this project, the dimensions of performance of the AI algorithms and their effect on user experience play a particularly important role.

In contrast to the iterative, development-accompanying evaluation, the final evaluation also focuses on the evaluation within the overall system with regard to the required “real-time” capability, which is evaluated in the context of user studies.

The mid-term and end-of-project demonstrations bring the project results to life.

Solution approach

The learning, adaptive and personalized AI functions developed in work packages 300-500 will exploit synergies and be finally evaluated in three main demonstrations. Here, the developed proposals for handling incorrect and unknown AI outputs will also be evaluated.

Users will be involved in the final evaluation to test the features developed in the project in real time and in terms of UX and AI performance.  

For the implementation as well as the mid-term and final presentation, a demonstration concept should be designed so that each partner presents its work in an appropriate way.  


This work package includes all activities related to the final evaluation and demonstration of the results. Primarily, the developed AI functions are to be evaluated and demonstrated in a way that is acceptable and can be experienced by users.

Divided into two subgroup evaluations, both the KARLI applicator user experience and AI performance will be evaluated, while another subgroup will work on preparing for the final presentation demonstration.

Driving scenarios on rural roads or interurban connecting routes will be prioritized for the evaluation and demonstration of the individual applications.

Subscribe to our newsletter

We will send updates about the project by e-mail up to 4x a year. Register now and stay up to date.


News & publications of the consortium partners

Report abstract: Display of Artificial Intelligence in the Vehicle HMI

The KARLI AI-MMI (Artificial Intelligence of Human-Machine Interaction) work package focuses on the question of how the use of AI will affect the appearance of an MMI. This is also the subject of the report “Display of Artificial Intelligence in the Vehicle HMI” by Dr.-Ing Peter Rössger. Read the summary here.

UX concepts for the vehicle of the future. KARLI & HdM.

The focus of the Stuttgart Media University (HdM) in the KARLI project is on the evaluation and development of user-centered AI solutions for automated driving vehicles. The goal is to combine a high level of safety with a successful user experience (UX).

Developing AI-driven in-vehicle interaction. KARLI & Audi.

Within KARLI, Audi is working on AI-based interactions in the vehicle with regard to person- and context-sensitivity. The goal is for the human-machine interface to behave adaptively based on the user and system state of the individual operating history.