The present document is the Deliverable D9.6 “Intermediate report after one year of measurement”. The document describes the work carried out within the task 9.5 entitled “Overall evaluation and impact analysis for impact enhancement”. The focus of this task is to provide intermediate results of the demonstration activities in the three Lighthouse (LH) cities and to present the data currently transferred to the IRIS Key Performance Indicators (KPI) tool.

The deliverable D9.6 is based on the work done in the Work Package (WP) 9, in particular the work in task 9.4 and task 9.5 (presented previously in D9.4 and D9.5). In this deliverable, the monitoring framework and established baselines developed in D9.5 are used to collect the data needed for the calculation of the KPIs. The KPIs are in turn used to evaluate the outcome and impact of the implemented measures. The collected data is transferred to the KPI tool, which was created and presented in D9.4. The tool processes and calculates the KPIs and visualizes the results. Data can be transferred to the KPI tool automatically, through a CIP, or manually through a template. A process which is described in this deliverable.

This deliverable was intended to be an intermediate report to provide an initial insight to the results for all measures in the IRIS project. However, due to the lack of data from measures, which in part is due to the Covid-19 pandemic, this report focuses more on providing information about the process of collecting data and transferring it into the KPI tool. This process is collaborative and has been carried out within the IRIS LH cites with support from the technical partners and the WP9 team. Complexity of APIs and the lack of standards have made data extraction and transfer into the KPI tool more difficult. Furthermore, not all measures in IRIS are connected to CIP which means that manual data collection was required and a systematic procedure for this collection needed to be developed and introduced to the partners.

There are several different reasons for lack of data and the resulting exclusion of some measures from this deliverable. A few measures are not yet in operation, while for other data collection have not started or the data transfer to the KPI tool has not been established yet. However, the work done in task 9.5 has provided new knowledge on issues and errors that can occur in the process of transferring data and establishing KPIs. Through dialogues with the project partners, the need to clarify some KPI cards with i.e. units, formulas or use cases has been highlighted. The close cooperation with the project partners has led to continued work on the definitions of the KPIs and what KPIs to include, taking steps in the direction of clearer interpretation and more consistent use. Further adaptation of several KPI-cards was done by the WP9 team. In the process of adjusting KPIs, the effect these adjustments would have on all measures that use them were considered. The process of developing KPIs involves a balance between finding indicators that can be used more generally and indicators that are more specific and thus better capture the purpose of a specific measure.

The improvements of KPIs and lessons learned in task 9.5 will be of great use in the continued work of WP9. Focus will be on transfer of data from all measures into the KPI tool. A continuous dialogue with responsible project partners to ensure this data transfer and discussions on deviation and errors in the initial results will be established.