Introduction

Bullying in schools remains a major problem with serious short- and long-term consequences for victims, bullies, bystanders, teachers, and parents (Arseneault 2018; Copeland et al. 2013; Wolke and Lereya 2015) with staggering costs for societies (Kline and Lewis 2018). Many anti-bullying programs have been developed and tested for effectiveness in the past decades (see for recent overviews: Gaffney et al. 2018; see also Farrington et al. 2017; Yeager et al. 2015). In addition to the important question whether anti-bullying programs are effective, it is also necessary to examine whether benefits of interventions exceed the costs. Cost-benefit analyses can be seen from an individual perspective (positive changes, increased performance), the organizational perspective (whether direct costs, such as materials and time investments, are exceeded by organizational benefits), or the societal perspective (whether the costs are smaller than benefits for society as a whole) (Aguinis and Kraiger 2009). Economic evaluations of anti-bullying programs are relatively new, and started with a discrete choice experiment in Sweden on the willingness to pay to reduce school bullying (Persson and Svensson 2013). This study contributes to this literature by examining the cost-benefit ratio of the KiVa anti-bullying program in the Netherlands from a societal perspective. It is relevant to investigate whether societal efforts made to reduce bullying (i.e., governmental investments in education) generate societal benefits.

Bullying and Its Consequences

Bullying can be defined as systematic, hurtful, and goal-directed negative behavior characterized by a power difference between bullies and victims (Olweus 1993; Volk et al. 2014). As such, bullying has negative consequences for different actors in both the short and long term. Obviously, bullying has negative consequences for victims. Bullying negatively impacts their psychosocial well-being, mental, and physical health, as well as their functioning at school or work (see for reviews: Arseneault 2018; Gini and Pozzoli 2013; McDougall and Vaillancourt 2015). For example, these reviews documented that victims are more likely to experience depressive symptoms, social anxiety, lower self-esteem, self-mutilation, suicidal thoughts, and health complaints such as stress, chronic headaches, inflammation, and reduced cortisol regulation. At school, victims of bullying feel insecure, have lower school performance, and are at increased risk of playing truant (Arseneault 2018). Victims of bullying in childhood are more at risk for unemployment, lower income, and poverty later in life (Brimblecombe et al. 2018).

Bullies also run a greater risk of a problematic development. Bullies are more likely to be involved in delinquency and violence, and are at greater risk of psychiatric problems and alcohol abuse in the long term (Copeland et al. 2013; Kretschmer et al. 2018; Ttofi et al. 2012). Bystanders of bullying risk to experience in the short-term mental health problems, negative feelings, and stress (Nishina and Juvonen 2005; Rivers et al. 2009). Most children want to intervene; however, they often do not know how, and may withhold support because they fear retaliation (Frey et al. 2015; Huitsing et al. 2014).

In addition to students, there are also costs of bullying incurred for adults. Parents of victimized children often have feelings of anger, frustration, and powerlessness, and are concerned about bullying to protect their child (Harcourt et al. 2014; Sawyer et al. 2011), which may result in loss of productivity (Jantzer et al. 2019). Parents of victimized children are willing to change their children’s school in case of bullying problems, and they are willing to pay 11 times more to reduce bullying than parents of non-victimized children (Agee and Crocker 2016). Tackling bullying reduces teaching time and can be a source of stress for teachers (Smilansky 1984); conversations about bullying issues with parents are often perceived as difficult and can lead to frustrations and misconceptions.

These detrimental consequences for victims, bullies, bystanders, parents, and teachers demonstrate the importance of effective anti-bullying interventions. If interventions can alleviate the problematic consequences for all involved, we expect to obtain positive societal benefits.

KiVa Anti-bullying Program

The KiVa anti-bullying program is a school-wide intervention that aims to enable students and teachers to tackle bullying (Salmivalli et al. 2010). KiVa is based on the theoretical insights that bullying is often the result of a group process (Salmivalli 2010). This is, at first, supported by the participant role approach (Salmivalli et al. 1996), suggesting that many children are involved in bullying in some way, even if they do not bully themselves. Second, bullies often have a strong position in the peer group and bullying is often rewarded by social status (Reijntjes et al. 2013; Veenstra et al. 2010; Volk et al. 2012). Third, teachers are role models for preventing bullying and can stand up to it (Saarento et al. 2015; Veenstra et al. 2014).

Overall, KiVa has two aims, to prevent bullying and victimization, and to intervene in cases that have already emerged (Salmivalli et al. 2010). The prevention involves universal actions targeted at all students, with teacher training, theme lessons, virtual learning environment for students, KiVa-symbols such as recess vests and posters, and information for parents (through flyers, an online booklet, and newsletters). Intervening by means of indicated actions is aimed at ongoing bullying and targeted at students who have been identified as targets or perpetrators of bullying (see for more information: Huitsing et al. 2019).

The effectiveness of KiVa was studied in a randomized controlled trial in 2012–2014 in target grades 3–4 of Dutch primary schools (Dutch grades 5–6). The research into the effectiveness of KiVa in the Netherlands showed that victimization of bullying had declined significantly more at KiVa schools than at control schools, both after 1 and 2 years of implementation (Huitsing et al. 2019; see also: Kaufman et al. 2018). More specifically, the number of children who were bullied monthly, weekly, or daily at KiVa schools decreased with 64% after 2 years of implementing the intervention (compared with a 53% decrease in control schools).

The Present Study

We investigated the cost-benefit ratio of the KiVa anti-bullying program in the Netherlands from a societal perspective, and we aimed to answer the question to what extent the decrease in victimization is associated with societal benefits. In other words, do the benefits of reducing victimization by bullying exceed the costs that were made to implement the KiVa program?

We specifically focused on the implementation of KiVa in the Netherlands. The KiVa anti-bullying program is used worldwide in several countries (Herkama et al. 2017, see www.kivaprogram.net for dissemination). There may be subtle differences in the way KiVa is implemented in each country (for example, the extent to which teachers are trained in providing KiVa lessons), and there are definitely differences in the costs incurred for the program (for example, differences in teacher salaries). For a cost-benefit analysis, it is therefore relevant to focus on the implementation in one country separately, although the results may be transferable to nations with similar contexts (such as Europe and North America). For the cost-benefit ratio from a societal perspective, it was investigated whether the expected benefits of KiVa in terms of lifetime income for prevented victims are greater than the costs incurred for implementing and offering the program in the Netherlands.

We limited the benefits of KiVa to effects on income for victims, because this is an outcome that has been clearly quantified in previous research (Brown and Taylor 2008). A human capital perspective perceives income as an indication of productivity for society, which is one of the most important contributors to national economic growth. As far as income is concerned, the idea is that implementing KiVa in schools leads to prevention and a reduction in victimization, and those students who are no longer victimized will have on average a higher income during their working life than victims of bullying. This may be a consequence of opening opportunities to take up positive pathways, such as reduced mental and physical health problems, which allows prevented victims to join societal activities. Thus, from a societal perspective, it is a positive sign if victims’ lifetime income is increased. Also other benefits of reducing victimization can be expected, such as a decrease in healthcare costs and increase in well-being (see, e.g., McDaid et al. 2017). Increased productivity or reduced sickness leaves may lead indirectly to increased tax contributions, which can be seen as another contribution to society. These benefits are difficult to quantify, evidence is still uncertain, or they may be seen as precursors through positive pathways of income effects.

Method

Cost-benefit Analysis

The costs and benefits of KiVa were estimated using a model-based cost-benefit analysis (CBA). A CBA compares the additional costs required for offering KiVa with the effects generated by KiVa, where effects are expressed in monetary units (2016 Euros) to represent benefits (Boardman et al. 2017). Benefits were then divided by costs to generate the estimated return-on-investment (ROI) associated with implementing KiVa. This ROI is similar to a cost-benefit ratio (CBR), a term commonly used in economic evaluations. We also estimated the net present value, by multiplying the difference between the expected discounted benefits and expected costs with the number of students at a school of average size.

Empirical Input on Self-reported Victimization

The empirical input of the reduction of victimization as a result of KiVa was taken from the randomized controlled trial (RCT) in the Netherlands in 2012–2014. In that study, two different estimates for victimization were used (Huitsing et al. 2019). First, the global item on victimization from the Olweus’ Bully-Victim Questionnaire (Olweus 1996): “how often have you been victimized at school during the past couple of months?”. Children answered on a five-point scale: 0 = “not at all”, 1 = “once or twice” (occasionally), 2 = “two or three times a month” (monthly), 3 = “about once a week” (weekly), 4 = “several times a week” (daily). For the purpose of this study, we took the percentages of dichotomized responses of children who (were) bullied not at all or occasionally (0) and children who (were) bullied at monthly, weekly, or daily (1) (Solberg and Olweus 2003). The second estimate was drawn from 10 specific comparable items from the same questionnaire concerning physical, verbal, relational, material, and cyber victimization/bullying. We took the maximum score on any of these specific items, and dichotomized it similarly to the global item. Because students had more opportunities to indicate systematic victimization with the 10 specific items, this approach resulted in a higher estimate of the prevalence obtained as compared with the global item.

Costs of Implementing KiVa

The implementation costs of KiVa (that are made once) consist of the costs for attending the so-called START-training (which takes 2 days), purchasing teaching materials, and investments of teachers’ time for attending the START-training and related meetings. The costs for these components of the intervention were estimated by implementation experts. Teachers’ time was valued at a rate of €41.25 per hour (see Table 1). In addition, there are (annual) costs for the use of an online monitor, follow-up meetings for schools (in-service training), and solving existing cases of bullying (i.e., indicated actions). Other annual costs are the number of hours that teachers spend on delivering KiVa theme-lessons. As the majority of the costs occurred in the first year, costs of offering KiVa were conservatively not discounted.

Table 1 Calculating the once-only and annual costs for implementing KiVa in the Netherlands
Full size table

Benefits of KiVa

A reduction in victimization relates to an increase in income: a previous study determined that 11-year-old victims earned 2.8% less at the age of 23 than children who were not victimized at the age of 11, independent of their educational level (Brown and Taylor 2008). In addition, 11-year-old victims were less likely to complete schooling. This study was based on a British cohort study (the National Child Development Survey) in which participants participated six times between their 7th and 42nd age in surveys about bullying, educational performance, work, and income. It was estimated that the combined effect of less education and income was associated with a total lifetime income reduction of ± €18,984 (2016 discounted prices) per person for 11-year-old victims (Hummel et al. 2009). These costs are expected to represent a lower limit of the benefit of preventing and reducing victimization. Benefits of KiVa were based on the discount rate of 3.5% as applied in Hummel et al. (2009). Sensitivity analysis considered discount rates of both 3% and 4%.

Model Assumptions

We made four assumptions on the long-term benefits of implementing the KiVa program. The first assumption was that the effectiveness of KiVa in the Netherlands at Dutch primary schools studied during the RCT (Huitsing et al. 2019) is representative for other Dutch schools that are using KiVa. Thus, it is assumed that comparable results will be found when KiVa is offered in future years at other Dutch primary schools that are motivated to implement an anti-bullying program.

The second assumption was that the effectiveness of KiVa in the Netherlands over a 2-year period will sustain with 70% in the long term (in line with Hummel et al. 2009; Knapp et al. 2011). This means that for 70% of the children for whom the bullying ended (or for whom it was prevented), victimization will not happen again. In the Netherlands, schools do not implement KiVa for enough years to verify this assumption, but research showed that Finnish KiVa schools that implemented the program for 7 years were able to decrease both the percentages of victims and bullies every year (Herkama et al. 2017). This can be seen as an indication that the likelihood of becoming a victim at KiVa schools is becoming smaller when the program is used for a longer period of time. Because of the possibility that some victims become victimized again, we set the long-term effectiveness at 70% which is in line with previous economic evaluations (Hummel et al. 2009; Knapp et al. 2011). The correction will add some cautiousness to the estimates, and we will test the impact of a more stringent sustainability percentage in sensitivity analyses.

The third assumption was that there is a causal relationship between victimization and a lower level of education as well as less income. Research supports this assumption (see for a review: Arseneault 2018), because compared with non-victims, victims of bullying in childhood have less often completed schooling and at a later age a lower income and a higher probability of unemployment (Brimblecombe et al. 2018; Brown and Taylor 2008; Takizawa et al. 2014). Although there are strong indications that these differences in income, education, and work are direct consequences of victimization of bullying, it remains possible that victims differed from non-victims in a way that also affected income and education later in life. Even in studies that controlled for family background, mental and physical health, and intelligence, there may remain other unmeasured factors that explain both victimization of bullying in childhood and the economic outcomes later in life.

The fourth assumption was that differences in expected income between victims and non-victims of bullying in childhood from the birth cohort of the National Child Development Survey (Brown and Taylor 2008) can also be applied to differences between victims and non-victims of bullying in the KiVa-cohorts in the Netherlands. The cohort study of the NCDS is one of the few that have studied participants in both childhood and adulthood. Although there are many contextual differences between cohorts, we assumed that the mechanisms linking victimization and its detrimental consequences later in life are comparable between cohorts.

Applying these assumptions introduces uncertainty, as applying other assumptions will lead to different results. To investigate to what extent the assumptions affect the results, we performed sensitivity analyses with repeated calculations. We investigated whether more conservative choices concerning assumption 2 (the extent to which a decrease in the number of victims sustains in the longer term) and assumption 3 and 4 (the estimated income per victimized student later in life, estimating whether the income effect can directly be attributed to victimization by bullying) have an effect on the estimated societal benefits.

Results

Costs of KiVa in the Netherlands

The total cost per student for implementing KiVa in the four upper grades of primary school (US grades 3 to 6) is estimated at €202, see Table 1. These costs consist of the investment that schools make for the START-training as well as the time that teachers spend for implementing KiVa for 8 years (the entire course of primary school). The once-only costs per student include the START-training, the direct cost of the KiVa materials, and the time investment for participating in the START-training (€36 per student, which is approximately 20% of the total costs). The remaining 80% consists of the time that teachers spend on implementing KiVa for 8 years (8 × €20.88 = €167). The time teachers spend on KiVa includes the time involved in delivering lessons, coordinating the monitor, attending meetings, and performing indicated actions.

Expected Benefits of KiVa

The expected benefits per student were estimated at €818 (global victimization item) and €1362 (10 specific items) as a result of the additional income, see Table 2. These benefits were calculated by multiplying the expected reduction in the number of victimized students (including the 70% correction) with the expected additional income for these students. The expected benefits per student can accordingly be obtained by dividing these benefits by the average number of students per school.

Table 2 Prevalence of victimization and its association to the expected benefits of lifetime earnings for reducing victimization by bullying
Full size table

Return-on-Investment

The expected benefits in terms of additional income per student are higher than the expected costs per student. The return-on-investment (ROI) for income, or the expected benefits per invested euro, is €4.04 (€818/€203) for the global victimization item and €6.72 (€1362/€203) for the 10 specific victimization items (see bottom lines of Table 2). This means that only for the expected income of people later in life, every euro invested in KiVa is expected to return €4.04 (or even €6.72) in the long term. The expected net present value of implementing KiVa equals €137,865 ((€818–€203) × 224 students) for a cohort of 224 students on an average school for the global victimization item and €259,806 ((€1363–€203) × 224 students) for a similar cohort when using the 10 specific victimization items.

The difference in ROI and net present value between the global victimization items and the 10 specific items on several forms of victimization stems from the difference in prevalence (which was higher for the 10 specific items), leading to a larger average number of bullied students per school. The relative risk at KiVa schools for being bullied, as compared with control schools, was also somewhat lower with the 10 specific victimization items (71% vs. 75% with the global victimization item), leading to a larger expected reduction in the number of bullied students in both the short and long term.

Sensitivity Analyses

In the sensitivity analyses, the costs and benefits of implementing KiVa were again compared with each other, but with different values for some model parameters (see Fig. 1). These adjusted values concerned the expected benefits due to reduced victimization, the extent to which a reduction in the number of bullied students continues in the long term, and the discount rates applied to the lifetime benefits of KiVa. We provided the sensitivity analyses only for the global victimization item, which has the lowest expected ROI for income.

Fig. 1
figure 1

Sensitivity analyses on the expected ROI. The straight line for the expected income effect is under the restriction of 70% long-term stability of victimization reduction. The dashed line for the long-term stability of victimization reduction is under the restriction of the expected income effect of 100%

Full size image

The first sensitivity analysis did not include the full expected benefits of €18,984 per reduced victim, but inspected what would happen to the ROI if the expected benefits are reduced. The straight line in Fig. 1 shows that when, for example, half of the expected income effect can directly be attributed to victimization by bullying, the ROI for income will be reduced to €2.02. This might be relevant, because the other half of the income reduction can be attributed to unknown factors that explain both the victimization and negative outcomes later in life. Even in this case, the ROI for income is still higher than €1.00, so also under this more stringent assumption, it is expected that investments in KiVa are seen as valuable from a societal perspective. When only 24.8% of the reduction in income can be attributed to being bullied (€4705), the ROI becomes equal to 1, rendering benefits of KiVa equal to its costs.

The second sensitivity analysis investigated the impact of a more conservative assumption about the extent to which the decrease in the number of bullied students sustained. The dashed line in Fig. 1 shows that when the effect does not sustain for 70% of the helped victims (as in the main analysis), but only for half of this (35%), the ROI for income drops to €2.02. Under this assumption too, it is therefore expected that investing in KiVa provides society with good value for money. When only 17.4% of the victims who were helped by the program remain non-victimized, the ROI becomes equal to 1.

The combination of a 50% reduction of both the benefits per reduced victim (from €18,984 to €9492) and the extent to which the decline in bullying persists (from 70 to 35%) leads to an ROI for income of €1.01. In this situation, investing in KiVa is expected to lead to similar benefits (in the form of quantifiable income) as costs for society. When this combined analysis was performed with the 10 specific victimization items, reducing both the benefits per reduced victim and the stability of the decline in bullying with 50% resulted in an ROI of €1.68, suggesting that it is still valuable to invest in KiVa.

The benefits of the intervention were based on a discount rate of 3.5% to lifetime benefits, and applying a somewhat lower discount rate of 3% would increase the ROI by an estimated 8.24%. Applying a somewhat higher discount rate of 4% would decrease the ROI by an estimated 7.32%.

Discussion

Calculations on the costs and benefits (in terms of ​income) as a result of implementing the KiVa anti-bullying program showed that it can be valuable for the Dutch society to invest in KiVa, even if only the benefits for the later income of victims are considered. In a model-based analysis with realistic assumptions, the ROIs for victims’ expected income of €4.04–€6.72 indicate that the expected income benefits of reducing and preventing bullying are expected to be higher than the costs that schools make to provide KiVa to their students.

Sensitivity analyses paid particular attention to reasons why the return-on-investment would yield less positive results. If the expected income effects later in life were reduced by 50%, there would still be an expected positive ROI (€2.02). Similarly, the long-term stability of the reduction of victimization was already set to 70% (implying that 30% of the helped victims become victimized again), reducing this percentage to 35% also yielded a positive ROI (€2.02). Even with more restrictive assumptions, an investment in KiVa would generate benefits twice as large as the required investment.

Conservative Model Parameters

The models that we applied can be considered as conservative, because there are many reasons why the societal benefits may be higher. Conservative estimates, resulting in less optimistic ROI estimates, have been made on both the cost and benefit side.

When estimating the costs in the model, it was first assumed that schools maximally implement KiVa. This was modeled in terms of the number of hours that teachers spend on KiVa lessons and the number of hours they spend on training days and interpreting the KiVa monitor. It would be more realistic to assume that most schools spend few hours on KiVa than would be expected from maximum implementation. Research shows that there are indeed differences in the degree to which KiVa is implemented in schools (Ahtola et al. 2013; Sainio et al. 2019), which means that the assumption that all schools implement KiVa to a maximum can be considered as conservative. Nevertheless, we modeled for all schools maximum efforts in terms of time investments (and thus in the financial investments). In addition, the calculation of the relative risk of bullying in KiVa schools (in comparison with control schools) was based on an empirical implementation of the KiVa program in the upper grades of primary school with suboptimal implementation strategies by teachers. If all intervention schools had optimally implemented the program, the decline in bullying would probably have been stronger (Haataja et al. 2014; Swift et al. 2017). Moreover, if the program was implemented in all grades, the intervention effects might be even stronger because the main message of the intervention is repeated every school year to students, but the costs will also be higher. How this will affect the overall ROI remains to be investigated.

Schools are likely to replace an alternative anti-bullying approach for which they may incur costs when implementing KiVa. At the time of the RCT on KiVa in the Netherlands, however, there were no other validated anti-bullying programs, and there was a wide variety of anti-bullying initiatives with varying prices that schools used. Setting the cost of the alternative approach in the models at zero can be considered as a conservative estimate because the incorporation of these costs would lower the additional costs that schools made for implementing KiVa.

Also on the benefit side, conservative estimates have been made. Only one type of benefit was included in the model; the expected increase in income when bullying declines. These costs associated with bullying have been quantified in previous research (Brown and Taylor 2008). However, there are many other expected benefits if bullying is stopped in childhood, such as reduced mental health problems (depressive symptoms, anxiety, low self-esteem), reduced physical problems (less stress, headaches, inflammation), and an improvement in the social relations and quality of life (Arseneault 2018). These benefits are not only expected in the long term but also in the short term. For example, there are indications that victimization is associated with more annual direct (medical and non-medical) costs (more than €5000 difference for victims vs. non-victims), and productivity losses for parents of victims (Jantzer et al. 2019). However, it is difficult to quantify these costs over the larger spectrum of antecedents and consequences of bullying, because these aspects can be related to each other. For example, lower education and reduced income in adulthood may be the result of mental and physical problems. A recent report attempted to quantify healthcare costs in more detail, and demonstrated that the ROI for the investment in the reduction of bullying can amount to more than €158 (£140, McDaid et al. 2017), when quantified costs such as child and adolescent mental health services, the general practitioner, self-harm, schools absenteeism, and lost home ownership are incorporated in the model.

Furthermore, a limitation was that only the long-term income benefits for victims were included to the model. A decrease in bullying at schools can also have positive consequences for bullies (less crime, substance use, and psychiatric problems later in life), bystanders (less short-term negative feelings and stress), parents and teachers (less stress, frustrations, and increased productivity). Less bullying problems may also be directly beneficial for schools and student performance in the short term because the pedagogical climate might improve which may foster students’ school adjustment, in the form of their well-being, motivation, and achievement (Salmivalli et al. 2011). By including other effects than income for victims as well as applying the benefits to other actors (bullies, bystanders, parents and teachers) in the short term, the ROI can be expected to increase.

Implications and Future Research

The cost-benefit analysis of the KiVa program in this study showed an asymmetrical distribution of the costs and benefits. Most of the costs are made by the schools, whereas most of the benefits are on the individual or societal level (including individual mental and physical health benefits that may be expected but were not included to the model). In addition, the costs for implementing an anti-bullying program such as KiVa are made directly, whereas the expected benefits used in this study (increase in income) are determined in the long term. There are direct benefits of the use of an anti-bullying program for schools, such as a safer atmosphere in the classroom, which makes teaching less of a burden to teachers, and improvements in students’ school performance, academic motivation, and school well-being (Salmivalli et al. 2011). Other direct benefits may be improvements in the satisfaction of parents. However, it can be doubted whether schools perceive these benefits as larger than the resources they have to offer (financial and time investments) for implementing a school-wide program as KiVa. Schools have many priorities and can spend their resources only once. For this reason, it could be justified that governments with a long-term perspective, on behalf of society as a whole, contribute to investments in the implementation of validated, effective anti-bullying programs such as KiVa. The return-on-investment is expected to be positive; with investments expected to return more than four times in the long term. It is well-known that investments in (early) childhood affect the productivity in later life positively (Heckman 2006).

Because the KiVa anti-bullying program is currently implemented in several countries (see www.kivaprogram.net), it is important for future research to investigate whether a positive cost-benefit ratio for KiVa can also be obtained in other countries with different empirical results and different costs for implementing the program, such as teacher salaries (see for a first attempt for Finland: Persson et al. 2018; see for the Olweus bullying prevention program: Beckman and Svensson 2015). Given that KiVa has been evaluated in Finland in an RCT (Kärnä et al. 2011b) and nationwide (Kärnä et al. 2011a) as well as in Italy (Nocentini and Menesini 2016), it would be possible to collect all the necessary information that served as input for the models used in the current study (see for the UK: Clarkson et al. 2019). Moreover, future research may do well to quantify other expected benefits of a reduction in victimization, in addition to the income effects. Examples are mental and physical health problems for victims, and detrimental outcomes for bullies, bystanders, and adults. Some of these attempts have been made recently (Brimblecombe et al. 2018; McDaid et al. 2017; Persson et al. 2018). Another suggestion for future research is to investigate the willingness to pay to reduce bullying from the payers perspective (which can be schools or governments), to investigate how a quality adjusted life year (QALY) is valued (see Persson et al. 2018). A solid quantification of expected costs and benefits in both the short and long term may convince policy makers and school staff to invest in validated, effective anti-bullying programs. These programs have shown to improve the well-being and quality of life of many children, adolescents, and adults substantively.