Implications for Delivery
Safety Performance Indicators are an important for proactive performance monitoring, rather than relying on collision data after the fact. For successful implementation:
SPIs should be used nationally and locally to supplement collision data
SPIs used should have clear links to road safety outcomes, be easy to quantify with available data and cover all the Safe System components
A clear methodology should be established for monitoring SPIs
Road safety stakeholders should collaborate to share best-practice and work with data holders to effectively monitor SPIs
Background
Final outcomes (such as collisions) do not give a sufficient picture of road safety performance. Collision data is incomplete, often of small sample size and doesn’t explain the processes leading to collisions. Data about outcomes is also only available after something has happened and, in the case of collision data, often a considerable amount of time later. Safety Performance Indicators (SPIs) support collision data to give a more holistic understanding of road risk. They also represent a more proactive approach to road safety in line with the Safe System.
SPIs should be used by managers and directors to monitor risk and inform areas for focus. As part of Transport Scotland’s Road Safety Framework, SPIs (referred to as KPIs) are being monitored at a national level. These relate to all the Safe System components. The KPIs were outlined in the 2021/22 delivery plan and are shown below.
Indicators should also be used locally depending on their relevance to local challenges and the availability of data. National SPIs provide guidance for local implementation of SPIs.
What the Research Shows
SPIs are indicators of risk that have strong causal links with road safety outcomes. In other words, improving the score of the indicator should improve road safety outcomes. They are well established as international best practice and form an important part of performance management.
For SPIs to be effective, they should:
Have a direct relationship with casualties or collisions
Be quantifiable with available data sources
Be measured periodically to track performance over time
Be easy to understand and interpret
SPIs should be used relating to all the Safe System components as part of a systemic approach. Guidance on the key SPIs to monitor has been provided by WHO, PACTS and others. Commonly used SPIs globally relate to speed compliance, road infrastructure condition and dangerous road user behaviour. The Baseline (2020-22) and Trendline (2022-25) projects have helped to embed SPIs across Europe. This work has developed standard guidelines for SPIs, including data collection and analysis. The work also highlighted the importance of comparability between geographical areas. A common definition and methodology for SPIs means reliable comparisons can be made.
SPIs focus efforts on important factors relating to road safety. The indicators support with understanding risk factors influencing collisions and tracking the success of interventions. Whilst it may take years to understand whether an intervention has influenced collisions, monitoring an immediate change in SPIs can be feasible. For example, tracking an indicator relating to speed compliance would be an effective way of estimating the success of a speed related intervention.
New data sources are increasing the potential for monitoring SPIs, such as through developments in artificial intelligence and connected vehicle data. To maximise the impact of SPIs, diverse data sources may be required. Collaboration between road safety stakeholders and data holders such as technology providers is crucial in implementing SPIs.
Road safety professionals should consider their role in setting and monitoring SPIs. Some SPIs are only feasible to collect at a large scale and require national leadership. Other SPIs are manageable on a local level but benefit from national direction. Where local authorities have success with SPIs, best-practice should be shared with the community.
Whilst SPIs are important, they should be used with care. Remember the following when using them:
SPIs are not the ultimate goal – casualty reduction is. Where SPIs are not clearly linked to casualty reduction, they should not be used.
SPIs are limited in scope and should be supplemented with other data sources to sufficiently understand system performance (see section on Safety data value and use).
Tracking SPIs can be tricky or costly as data is not always easy to obtain.
Where targets relating to SPIs are set, this can have unintended consequences which should be considered. Targets can lead to a heavy emphasis on the target itself and hence create unwanted behaviours.
Sources
Etika, A. (2018). Developing Safe System Road Safety Indicators for the UK [Report]. Parliamentary Advisory Council for Transport Safety (PACTS) in association with Ageas. https://www.pacts.org.uk/wp-content/uploads/PactsReport_-Developing-Safe-System-Road-Safety-Indicators-for-the-UK_Oct18-FINAL.pdf
Owen, R., Fosdick, T., Scott, S., & Staton, M. (2022). Developing and measuring safety performance indicators at sub-national level: Roundtables summary report. Road Safety GB & Agilysis. https://www.roadsafetyknowledgecentre.org.uk/wp-content/uploads/2022/05/Developing-and-Measuring-Safety-Performance-Indicators-at-Sub-National-Level-Roundtables-Summary-Report-Final.pdf
Trendline. (n.d.). Trendline: Road safety KPIs across Europe. https://trendlineproject.eu/publications
Vias Institute. (n.d.). Baseline project: Road Safety KPIs in EU Member States. Baseline. https://baseline.vias.be/en/