The IN2CCAM project has taken a major step forward in defining how it will measure its success. Deliverable D2.2, titled “Study questions and KPIs of CCAM ecosystem”, outlines a framework for evaluating the project’s impact on areas like traffic safety, efficiency, and environmental impact.
The framework is based on the Micro-FESTA methodology, which is designed for small pilot projects testing CCAM technologies. Led by ICCS, all project Living Labs have identified six key study questions and Key Performance Indicators (KPIs) for measuring impact:
- Usage (e.g., trip characteristics such as speed and travel time)
- Quality of service
- Traffic safety and efficiency
- Acceptance
- Environmental impact
- Economic impact
Building a foundation for future projects
Having a defined set of KPIs will be especially valuable for the project’s evaluation stage, allowing our partners to assess the real-world effects of the implemented solutions. Furthermore, the IN2CCAM KPIs can serve as a reference point for future CCAM EU-funded projects. This standardization will enable consistent measurement and comparison across different projects.
The project acknowledges the need to refine the data collection methods to ensure consistent and comparable information across all trial sites. Additional technical, operational, and economic indicators will also be incorporated during the impact assessment phase.
Challenges and solutions
Defining KPIs early in the project presented a challenge, as some developments were still in the early stages. However, the project team successfully leveraged learnings and KPIs from past CCAM projects to establish a solid foundation. The KPIs will be revisited and refined as the project progresses.
The IN2CCAM project’s establishment of a monitoring and evaluation framework is a significant step forward. “Connected, Co-operative, and Automated Mobility (CCAM) EU pilot projects, among others, require the definition of Study Questions and Key Performance Indicators (KPIs) to serve as a roadmap for effectively monitoring and evaluating their progress in terms of different categories. Establishing a robust monitoring and evaluation framework allows project stakeholders to assess the alignment with project objectives and evaluate their impact on various areas such as mobility, society, economy, environment, and others”, states Christos Ballis (ICCS).