1 Introduction

Road accidents represent a significant social problem since 25,500 people were killed on the roads of the European Union in 2016 with more than 135,000 injured [10]. The total damage of road accidents is very difficult to estimate as it does not only include the cost of treatment and material damage, but also indirect damages in the form of: reduction of job opportunities, loss of working ability, inability to perform daily activities, direct reproductive costs of medical or professional rehabilitation, indirect reproductive police costs, court proceedings, insurance companies, etc. Depending on the Member State, it is estimated that these losses amount from 1% to even 3% of gross domestic product [38].

For this reason, road safety is one of the key focuses of the European Commission, which adopts a new European Road Safety Action Program every ten years. The main task of the Program is to reduce the number of fatalities on EU roads. Since the overall road safety depends on the interaction of three main elements: human, road and vehicle, one can conclude that traffic accidents represent a failure of the whole traffic system (interaction between the three elements). For a long time, human error was most often considered as the main and more or less fatal cause of road safety problems since humans are, by nature, subject to errors. Although humans make a lot of errors, these errors are not always the true cause of accidents. Namely, a different phenomenon related to the road itself or the vehicle may trigger the human error and thus be the true cause of an accident. This is why the modern road safety strategies clearly differentiate the factors that truly cause accidents, whether they are human, environmental, vehicular, etc. Such a differentiation may lead to more diverse and efficient solutions directed toward preventing human errors by acting on their identified causes, and by promoting a better ergonomics of the driving system in accordance with human capacities and weaknesses [8].

In addition to the mentioned differentiation, training and education are one of the pillars of road safety strategies and solutions for increasing road safety. In almost every country in the world road safety education is, to a certain extent, part of formal education system. It is also a constituent part of initiatives, programs and activities outside the formal education. However, although there are plenty of road safety education programs, the number of those that are followed by detailed evaluation is rather limited [7]. Different and/or poor evaluation methods may be the reason why several studies failed to prove the positive outcomes of these programs [9, 19, 31, 33, 34, 36].

On the other hand, with better evaluation methods and research on drivers’ education on road safety, recent studies [21, 30] showed statistically significant reduction in road accidents. The studies indicated that teens who underwent the education program were less likely to be involved in accidents during their first two years of driving, compared to the teens who did not go through the education. Based on the analysis of effectiveness of road safety education in Nebraska, the authors Shell et al. [30] concluded that the non-educated group was 1.22 times more likely to get in an accident than those who underwent the education program. In their analysis, authors took into account key demographic factors such as age, sex, race/ethnicity, urbanicity and household income.

A more large-scale study examined the safety performance of teen drivers who underwent the education program and those who did not [21]. The study was conducted in two stages. Firstly, a sample of teen drivers was surveyed prior to completing the educational program and their accidents and convictions were compared once they got their provisional license. In the second stage, historical records were used to examine the accidents and convictions of a much larger population of Oregon teens who had and had not completed the approved educational program [21]. The authors concluded that the safety effects of approved educational program are either neutral (based on the first part of the study) or cautiously optimistic (based on the results of the second part).

Since from the above mentioned one can conclude that there are gaps in the evaluation methods and different strategies used in the available literature, further research is needed in order to get better insight on the influence of educational programs on road safety. In order to develop efficient training and education activities, it is primarily necessary to identify common human errors and violations. A frequently used method for this is Driver Behaviour Questionnaire (DBQ), originally developed in Britain by [26].

The DBQ is based on the theoretical taxonomy of aberrant behaviours and represents a psychometric instrument and accident predictor. The main distinction between errors and violations is based on the assumption that they have different psychological origins and demand different modes of remediation. Errors are defined as “the failure of planned actions to achieve their intended consequences”, while violations are “deliberate deviations from those practices believed necessary to maintain the safe operation of a potentially hazardous system” [26].

The main purpose of this research is to evaluate the DBQ factors used to develop the best model of multi-group moderator effect among drivers who attended the Slovenian educational program “I still drive, but I cannot walk” compared to those who did not attend the program. The program is organized by the Institute for Innovative Safe Driving Education “Vozim” which was founded on the initiative of young paraplegics/victims of road accidents. Since 2008, the Institute has been implementing a preventive program “I still drive, but I cannot walk”, focused on future young drivers between the age of 15 and 22. An innovative interactive road safety program is based on personal stories of victims, injured in road traffic accidents, who through their own experience provide direct information related to the importance of safe driving and compliance with road traffic regulations. Through personal stories told by people injured in road traffic, young people get the insight into their life before the accident, the car accident and life after it. In this way, they become aware of the importance of safe and responsible driving and possible consequences if disregarding them. Young people therefore learn firsthand about the causes of traffic accidents, tips for safe driving and as well as the lives of the disabled and their “new life” after rehabilitation, thereby encouraging the destigmatization of physically handicapped individuals. Through the stimulated discussions and questions, participants actively shape the content of the lectures. In this way, participants and disabled persons have more personal contact and share more intimate details, which ultimately results in their connection on deeper level. With this, participants, get clear message that traffic accidents are real and do not happen just “to other people” but may also happen to them. Based on what they heard during program, young participants may “think twice” about what may happen before they engage in risky driving.

The main goal of this research is to evaluate how this unique approach affects driver’s errors and violations and how they are connected to the frequency of traffic accidents caused by young drivers who participated in the program and those who didn’t.

2 Conceptual framework, survey and hypotheses

Figure 1 shows the conceptual framework with the hypothesized model. The framework consists of twenty-seven (27) items of the DBQ questionnaire, which are symbolized by variables DBQi, i = 1,2,4…28 (3 is excluded based on recommendation of authors [16, 17, 24,25,26]). Two DBQ factors (Errors and Violations) and accidents are represented as the number of accident caused by participant.

Fig. 1
figure 1

The conceptual framework

The main aim of this framework is to evaluate the effect of Errors and Violations on the number of accidents caused by a participant. As mentioned in the introduction, the aim of this study is to evaluate the DBQ factors used to develop the best model of multi-group moderator effect among drivers who participated in the Slovenian road safety program “I still drive, but I cannot walk”, compared to those who did not attend the program. In addition, the analysis of the impact of these behaviours on the number of accidents caused by the two studied groups is conducted. Based on this research gap the following two hypotheses were explored:

H1. The road safety education program “I still drive, but I cannot walk” has a moderation effect on the relationship between Errors and Accidents; this relationship is “weaker” for those who participated in the program than for those who did not.

H2. The road safety education program “I still drive, but I cannot walk” has a moderation effect on the relationship between Violations and Accidents; this relationship is “weaker” for those who participated in the program than for those who did not.

The main aim of this research is therefore to determine the difference between how Violations and Errors affect the Accidents depending on whether the driver participated in the Slovenian road safety program “I still drive, but I cannot walk”, or not. The “weaker” relationship in this case means, that those who did participate road safety program may cause less accident derived from Errors/Violations than those who did not attend the program.

2.1 Instruments

The questionnaire was divided in two sections. The first part consisted of 27 driver behaviour questions that were selected from the previous versions of the DBQ [16, 17, 24,25,26]. The questionnaire was designed to evaluate the effect of certain control variables on the behavioural factors. In this case it was used to evaluate the differences between “safe” driving behaviour depending on the participation in the education program. Respondents were asked to indicate how often they commit each of the violations or errors showed in Table 1, when driving a car on a 5-point Likert scale from “Never” to “Nearly all the time”.

Table 1 DBQ questionnaire

The second part contained demographic questions regarding age and gender as well as information related to the driving experience, their driving habits (how often do they drive a car: daily, weekly, monthly, yearly), estimated annual distance driven and accidents in the past years.

2.2 Participants

The data was collected over four week period in 2017 by means of online surveys. The sampling strategy was intended to gather data from two different driver groups. The first group consisted of people who had participated in the road safety educational program “I still drive, but I cannot walk”. The second group was composed of young drivers (nearly the same age) who did not attend the education program.

In total 183 participants fully completed the questionnaire. Of that number, 54.6% were the drivers who participated in the program and 45.4% the ones who did not. The majority of the participants were female (72.1%) between 20 and 29 years old (21.1% below 20), and they all have valid driver’s licence (35% for less than 2 years and 34% from 2 to 5 years).

2.3 Data analysis

As mentioned before, the aim of the study is to evaluate the DBQ factors used to develop the best model of multi-group moderator effect among two groups of drivers and thus evaluate the efficiency of the educational program “I still drive, but I cannot walk”. Therefore, we used the exploratory factor analysis in order to indetify the nature of the latent factors (constructs) and to estimate their indicator items loadings [13].

Using covariance-based structural equation modelling the DBQ variables and road accidents were carried in the modelling of moderated mediation in order to investigate the relationship between an independent variable and a dependent variable and the kind of the mediating variables. In order to model the moderating effect for latent construct, an alternative method was used for assessing the effect of moderator variable in the model in covariance-based structural equation modelling - Multi-group CFA. The critical ratio difference test which represents the parameter estimate divided by its standard error; as such, it operates as a z-statistic in testing that the estimate is statistically different from zero was used. For the hypothesis to be rejected the test values needs to be > ±1.96 with the probability level of 0.05.

3 Results

The descriptive statistics of the measured data was investigated with the emphasis on the analysis of normality because of disturbed accuracy of model validation if the data are non-normal [35]. Normality tests are usually conducted with the skewness index (│SI│ < 3) and kurtosis index (│KI│ < 7) of the data.

3.1 Exploratory factor analysis

The responses to the 27 DBQ items were subjected to an exploratory factor analysis (EFA), using the Principal Axis Factoring (PAF) algorithm, with additional Promax rotation (and Kaiser normalization). PAF was our preferred method for estimation, given that it does not rely on the assumption of multivariate normality, which can definitely be treated as an advantage [11].

Different research about the DBQ questionnaire have implicated that the subsequent factor model can be articulated by four, three or two essential factors [2,3,4,5,6, 16, 22,23,24, 28, 29, 32].

The possibility that the factor analysis may be used without any concerns was tested by two tests: Kaiser-Meyer-Olkin KMO test and the Bartlett’s test of sphericity (BTS) [13,14,15]. The BTS value was significant (χ2 = 1225.173 with df = 231 and p < 0.001), while the KMO value was 0.846 > 0.5. According to the recommendation of some authors [12, 18, 27], the achieved BTS and KMO values imply that the EFA can be reliably conducted in further research.

For the factors extraction process, the principal axis factoring (PAF) algorithm with the Promax rotation was used. The Scree plot and Eigen value were inspected to determine the optimal number of factors. Both of them suggested the presence of only two factors. The two factors explained the 43.75% of the variance. According to [13], only those items which are significantly loaded on corresponding factors (loadings > 0.45; communalities over 0.5) were retained in the model.

We labelled the first factor Errors because it contains items related to errors or lapses. The second factor was labelled Violations because of high loading items reflecting aggressive violation or Ordinary violations [4, 16, 20].

Factor loadings of two-factor structure can be seen in Table 2.

Table 2 Two-factor solution with descriptive data and loadings

3.2 Confirmatory factor analysis

Confirmatory factor analysis (CFA) was performed in order to test the fit of the initial derived factor model to the exploratory factor analysis (EFA). The maximum likelihood (ML) method was used to estimate all model parameters at first. While estimating the parameters, the difference between the data-based covariance matrix and the model-implied covariance matrix was minimized [14]. The goodness of fit indicates proper fit of the model because all of fit measures are higher than threshold ranges: Normed fit index (NFI = 0.913), Tucker-Lewis index (TLI = 0.986), Comparative Fit Index (CFI = 0.995), Root Mean Square Error of Approximation (RMSEA = 0.032), Standardized Root Mean Residual (SRMR = 0.0402) (Byrne 2009). Convergent and discriminant validity were also tested. Both the adequate composite reliability and average variance extracted were inside the interval and it can be concluded that there are no validity concerns.

3.3 Structural equation modelling results

This study applies two variables, namely Errors and Violations, derived from the DBQ and a variable named Accident, representing the number of accidents caused by a participant. Maximum likelihood estimator in structural equation modelling was used to determine the probability values (p-value) in order to identify the research hypothesis as the prior in the empirical study.

We first tested the global model, measuring the effect of Errors and Violations on Accidents (number of traffic accident caused by driver). This model fits well to the data (χ2 = 115.306; df = 181; GFI = 0.948 NFI = 0.912; CFI = 0.987; RMSEA = 0.021; SRMR = 0.042). It was predicted that Driver who makes more Errors causes more traffic accidents, but this path has a significant and negative effect on Accidents (− 0.34, p < 0.05). As predicted, Table 3 shows that Violations have significant and positive effect on Accidents (0.294, p < 001). The full model is shown in Table 3.

Table 3 Full model

3.4 Moderating structural equation modelling results

After the measurement model has been validated, the next step was to assemble these constructs in the moderated structural equation modelling. The main problem of this research was focused on the difference between two groups of drivers. The first group consisted of drivers who participated in the road safety educational program “I still drive, but I cannot walk” and the second group of the ones that did not.

The moderator-mediator in the form of Structural Equation Modelling (SEM) was used to examine the interrelationship among the two mentioned groups.

In this case, the effect of Errors and Violations on Accidents upon a multi-group analysis is performed. The results indicate that the relationships in our model are different between the two groups in one case. The link between Violations and Accidents is significantly different between those who participated in the program “I still drive, but I cannot walk” and those who did not (Z = − 1.313**) as shown in Table 4. This link is stronger among the participants who did not participate in the program (β = 0.646, p < 0.001) compared to the others who did (β = 0.252, p < 0.05). This indicates that the drivers who participated in the program obey the traffic regulations and are more responsible when driving, meaning that they may violate the regulations less and thus cause less accidents. Other relationships do not present significant differences between the groups. Based on this, it can be concluded that the hypothesis H2 is verified, while the hypothesis H1 cannot be verified.

Table 4 Critical ratios of comparison between groups

For analyzing possible differences between male and female participants the Multiple-Group Analysis was conducted. The results show that for both paths (Errors-Accidents and Violation-Accident) groups are not different at the model level as well as at the path level. This result implies that, even though with lower male sample, gender of participants did not affect the “strength” of the relationship between Errors-Violations and Accidents, i.e. there are no statistically significant differences between male and female participants.

4 Discussion

Educational programs represent one of the core road safety measures in most of the countries around the world. However, the efficiency of these programs and their positive effect on overall road safety is still unknown to a certain extent. One of the main reasons for this is the diversity of used strategies and evaluation methods. Nevertheless, recent studies [21, 30] show that with improved educational approaches and evaluation methods, relatively small but still statistically significant reduction in road accidents, involving drivers who attended the programs, is possible.

Based on the mentioned gaps and positive findings in the available literature, the main purpose of this research was to evaluate the efficiency of the Slovenian educational program “I still drive, but I cannot walk”. The program is based on the personal contact between participants (young drivers) and disabled persons. In this way, young drivers, who do not have enough experience, firsthand hear and see what may happen with the risky driving. The aim of this paper was to evaluate how this unique approach affects driver’s errors and violations and their connection to the frequency of traffic accidents caused by young drivers who participated in the program and those who didn’t.

In order to identify common human errors and violations, the Driver Behaviour Questionnaire (DBQ) was used to examine the moderation effect of a variable, namely the participation in the program (categorical variable), in the relationship path between exogenous and endogenous constructs. This approach also allowed us to assess how well our conceptual model as a whole fits the data.

The test of a full model (regardless of whether they did/did not participate in the program) measuring effect of Errors and Violations on Accidents showed that the relationship between driver’s Errors and number of Accidents is significantly negative. This means that the drivers who make more errors do not cause more accidents. On the other hand, the drivers who make more Violations are more susceptible to cause traffic Accidents.

The moderator-mediator in the form of Structural Equation Modelling (SEM) was used in order to examine the interrelationship between the two analysed groups (drivers who participated in the program and those who did not). The results of the effect of Errors and Violations on Accidents based on the multi-group analysis show that the link between Violations and Accidents is “weaker” among the participants who participated in the program, compared to those who did not. This indicates that the drivers in the first group became more aware and responsible after the program. In other words, the participants who attended the Slovenian road safety program “I still drive, but I cannot walk” may violate traffic regulations less and thus cause less accidents compared to those who did not participated in the program. In addition, difference of gender was not found meaning that the relationship between Errors-Violations and Accidents is the same for male and females.

The limitation of this study is mainly related to the fact that data collection was conducted in a relatively short period after the educational program took place. In the future, after each education period the driving behavior of the participants who attended the education should be investigated in order to get bigger dataset and stronger proof of here presented results. Also, the driving behavior of the participants investigated in this study should be periodically checked in longer time period, i. e. with the increase of their experience. In that way the long-term effect of the program may be determined since it is known that driving experience is negatively correlated to the risk of accidents and injuries [1, 37].

The relationship between driver’s Errors, Violations and the number of Accidents should be analysed in a longer period of time in order to get a deeper insight on the effect of educational programs on the drivers’ behaviour.

5 Conclusion

A Driver Behaviour Questionnaire (DBQ) was used to determine most common errors and violations and to develop model of multi-group moderator effect among drivers who attended the Slovenian educational program “I still drive, but I cannot walk” compared to those who did not attend the program. Results of a multi-group analysis showed indicated that the relationships between Violations and Accidents are different between the two groups (drivers who participated in the program and those who did not), indicating that the drivers who participated in the program may cause less Violations resulting in accidents. Results also indicate that the relationships between Errors and Accidents do not present significant differences between the groups. From all the above, it may be concluded that the program had a positive effect on the behaviour of young people who participated in it, meaning that they may ultimately be more responsible drivers and thus cause less accidents. These results show that more personal contact based on the empathy, emotions and mutual understanding may be more efficient in increasing awareness of the young drivers. Ultimately, this study represents a positive methodology for evaluation of a road safety educational program and as such provides significant scientific contribution.