Auditory verbal hallucinations (AVH) can be transiently present in both clinical and healthy adolescent populations. It is not yet fully understood why AVH discontinue in some adolescents and persist in others. The aim of this explorative study is to investigate predictors of spontaneous discontinuation of distressing AVH in a school-based sample of adolescents. 1841 adolescents (mean age 12.4 years, 58% female) completed self-report questionnaires at baseline. The current study included 123 adolescents (7%; 63% female) who reported at least mild distressing AVH at baseline and completed follow-up measurements. LASSO analyses were used to uncover predictors of spontaneous discontinuation of distressing AVH. During follow-up, 43 adolescents (35%) reported having experienced distressing AVH during the last 12 months, while 80 adolescents did not. Spontaneous discontinuation of distressing AVH was predicted by never having used cannabis, parents not being divorced in the past year, never having been scared by seeing a deceased body, less prosocial behaviour, school grade repetition, having the feeling that others have it in for you, having anxiety when meeting new people, having lived through events exactly as if they happened before and having the feeling as if parts of the body have changed. No associations between spontaneous discontinuation of distressing AVH and age or ethnicity were found. Distressing AVH in non-clinical adolescents are mostly transient. Discontinuation was predicted up to a certain extent. However, several predictors were difficult to interpret and do not provide leads for preventive measures, except for discouraging cannabis use.
Auditory verbal hallucinations (AVH) are experienced by 5–35% of children and adolescents . It is defined as the perception of hearing voices without actual auditory stimulation . In most children and adolescents, AVH disappear spontaneously and do not cause functional impairment, but in less than 10% the AVH persist into adulthood [3,4,5]. Persistence of AVH is associated with an increased risk of developing severe psychopathology such as psychotic disorders [4, 6].
AVH are part of the group of psychotic experiences (PEs), which is a set of subclinical unusual perceptual experiences distributed throughout the general population . Although PEs are subclinical experiences, they are associated with an increased proneness to psychotic disorders [7, 8]. A model that can be used to understand the role of PEs in relation to psychosis and other mental diseases is the psychosis proneness–persistence–impairment model [8, 9]. According to this model, the transition from experiencing AVH to, ultimately, developing a psychiatric disorder, is caused by exposure to a combination of environmental, genetic, demographic and psychological factors, that interact synergistically or additively with the AVH [7, 8, 10]. The phenomenology of AVH remains the same throughout the severity continuum, with non-clinical individuals at one end of the spectrum and individuals with a psychiatric disorder on the other end [8, 9].
A non-exhaustive summary of risk factors for AVH persistence in non-clinical adolescents includes: a concurrent depressed mood, delusional ideations, general psychopathology and adolescent instead of childhood onset of AVH [6, 11]. Ethnic minority status, cannabis use, childhood trauma, peer victimization, social and attentional problems, affective dysregulation, developmental problems and distress due to psychotic experiences are also associated with persistence of psychotic experiences in non-clinical adolescents, although not specific for AVH [12, 13].
Adding the dimension of distress to AVH persistence might help characterizing a group of voice hearing adolescents that is at risk of developing mental health problems. Most non-clinical individuals with AVH do not experience any distress from the AVH and do not need medical care for it .
However, some voice hearers do experience AVH-associated distress, which in turn is associated with help-seeking behaviour . Importantly, Daalman and colleagues found that AVH-related distress in healthy adults was the most important predictor for transition to mental health problems at 5-year follow-up [14, 15]. Most other baseline characteristics, including age, family history of psychotic disorder, childhood trauma, and emotional valence, frequency and duration of AVH did not predict a need for mental health care at follow-up .
More research specifically on adolescents with AVH is needed, because the first prodromal symptoms of mental illness and associated social dysfunction often emerge during adolescence . A reason for this might be that during adolescence a series of rapid changes in hormones and brain development, such as the reduction of connections in the brain by pruning, takes place [6, 16]. These changes and the associated stress can trigger psychopathology in some adolescents . Next to the neurodevelopmental changes, emotional and social changes also take place during adolescence which might increase vulnerability to mental illness . At the same time, attenuated psychotic symptoms (APS), such as AVH, might occur during early adolescence as a non-pathological expression of not yet fully matured cognitive abilities . If risk factors or neurodevelopmental disturbances in information processing arise during the maturation process, the APS might persist and ultimately develop into psychiatric disorders .
From a clinical perspective, an important question is thus why AVH disappear spontaneously in some adolescents, while in others the AVH persist, and are associated with distress and development of psychopathology. As persistence and distress of AVH are the most relevant determinants of help-seeking behaviour and future transition to mental illness, research should focus on adolescents with persistent AVH with associated voice hearing distress. When we know more about what promotes spontaneous discontinuation of distressing AVH, we might be able to stimulate protective factors timely and prevent persistence and possible subsequent development of psychiatric disorders. Therefore, the aim of the current longitudinal school-based study was to investigate what percentage of non-clinical adolescents experience AVH with distress, in how many adolescents AVH with distress persist, and which factors, in terms of demographic variables, psychological traits and environmental factors, are predictive of spontaneous discontinuation of distressing AVH. Based on previously found risk factors for AVH and general PE persistence in non-clinical adolescents, we hypothesized that the absence of delusional ideation, younger age, not being from an ethnic minority group, no use of cannabis and no experience of traumatic events would be associated with spontaneous discontinuation of distressing AVH.
Materials and methods
Participants and study design
Data for this study was acquired from MasterMind, a large longitudinal cohort study on adolescent mental health in the general population . In this study, data of 1841 adolescents from 12 secondary schools, with a minimal education level of secondary vocational education (VMBO), in the provinces Noord-Holland, Zuid-Holland, and Noord-Brabant in The Netherlands were collected from June 2013 until January 2015. Participants completed questionnaires in the first year of secondary school (baseline) and 1 year later, in the second year of secondary school (12-month follow-up). In Fig. 1, an overview of the measurements at each time point is shown. Approval for the MasterMind study was received from the Medical Ethics Committee of the VUmc [reference number 2013.247]. Parents received information about the study and an informed no-consent form, which they were requested to complete and return if they did not want their child to participate in the study or if their child did not want to. In that case the adolescent was excluded from the MasterMind study. Full descriptions of the MasterMind study procedure can be found elsewhere [19, 20].
For the current study, data was used from a subset of 160 participants who at baseline reported that they had experienced distressing AVH at some point in their life. The presence of distressing AVH was determined by a positive answer to the item “I have heard things other people cannot hear, like voices of people whispering or talking” on the Prodromal Questionnaire (PQ-16), in combination with experiencing at least mild distress associated with the AVH. The participants who did not complete both the baseline and the 12-month follow-up questionnaires were excluded from analyses.
Definition of outcome
Outcome at 12-month follow-up was defined as spontaneous discontinuation of distressing AVH. The discontinuation group includes participants ‘who did not experience AVH anymore since baseline’ and ‘who did experience AVH since baseline, but without distress associated with the AVH’. The persistence group consists of participants ‘who experienced AVH with associated voice hearing distress since baseline’.
At baseline, participants were asked to fill out questionnaires on socio-demographic characteristics. Ethnicity of the participants was determined by the ethnic background of themselves and their parents. The ethnicity was coded as migrant-Dutch if the participant, the father or the mother was born abroad. Education level was coded average when participants followed secondary vocational education (VMBO) and high when participants followed a higher secondary educational track (HAVO or VWO). Screening for psychotic experiences was done with the 16-item version of the Prodromal Questionnaire (PQ-16) . The PQ-16 screens for subclinical psychotic symptoms and consists of 14 positive symptom items and 2 negative symptom items assessed on a two-point scale (0, not true; 1, true). The distress associated with the experiences is assessed on a four-point scale (0, no distress; 1, mild distress; 2, moderate distress; 3, severe distress). In this study, an experience was classified as a psychotic experience only if it was associated with at least mild distress. The question “I have heard things other people cannot hear, like voices of people whispering or talking” on the PQ-16 was used to screen for AVH. The Dutch PQ-16 as tested by De Jong et al. in a Dutch help-seeking population with a mean age of 14.6 years had a Cronbach alpha of 0.79 . This questionnaire had good concurrent validity with both the interview-based Comprehensive Assessment of At-Risk Mental States (CAARMS) diagnoses and the original 92-item version of the Prodromal Questionnaire (PQ-92) as tested by Ising et al. in a Dutch general help-seeking population with a mean age of 26.2 years . Socioeconomic status of the participant’s family was assessed with the Family Affluence Scale (FAS) . The FAS had a low internal consistency in this study with an ordinal alpha of 0.42. Andersen et al. showed that in six European countries the FAS completed by 11-year-old adolescents had good validity with the parental answers to the FAS questions . Yes/no questions were used to determine whether participants experienced the divorce or death of a parent. Self-esteem was measured with the Rosenberg Self-Esteem scale (RSE), a 10-item questionnaire with both positive and negative statements about self-esteem . Responses are given on a four-point scale (0, totally agree; 1, agree; 2, disagree; 3, totally disagree), with the total score ranging from 0 to 30. The RSE questionnaire had a high internal consistency in this study with an ordinal alpha of 0.87. The RSE as tested in 13–18-year-old adolescents (mean age 15.3 years) from 13 countries by Berry et al. had a Cronbach alpha of 0.83 in nationals and 0.75 in immigrants, which is comparable to the alpha calculated in our study . Screening for psychosocial problems was performed with the Strengths and Difficulties Questionnaire (SDQ) [27, 28]. The SDQ contains 25 items assessing strengths and difficulties in the following domains: hyperactivity, emotional symptoms, conduct problems, peer problems, and prosocial behaviour. Each subscale consists of five items on a three-point scale (0, not true; 1, somewhat true; 2, certainly true). The total score of each subscale therefore ranges from 0 to 10. The internal consistency in this study of the SDQ subscale hyperactivity was high with an ordinal alpha of 0.83. The internal consistency of the SDQ subscales emotional symptoms, conduct problems, prosocial behaviour and peer problems was acceptable with ordinal alpha’s of 0.66, 0.62, 0.67 and 0.50 respectively. The concurrent validity of the SDQ, as tested in a large sample of non-clinical Dutch children and adolescents (n = 562; mean age 12.3 years) by Muris et al. , was good. Peer status was measured via peer nominations according to the method of Coie et al. . The following five social status groups were defined: popular, rejected, neglected, controversial and average. The categories popular, controversial and average were classified as high peer status, the other two categories as low peer status. The full description of this method can be found in El Bouhaddani et al.  and Coie et al. . The adolescents completed the Social And Health Assessment (SAHA) somatic symptoms scale, consisting of 12 items representing commonly reported somatic symptoms by children and adolescents . It assesses the presence of these symptoms during the past month on a three-point scale (0, not true; 1, somewhat true; 2, certainly true). The internal consistency of the SAHA somatic symptoms scale in this study was acceptable with an ordinal alpha of 0.76. This alpha is comparable to the Cronbach alpha of 0.81 that has been previously calculated in the general population of adolescents .
Measurements at follow-up
At 12-month follow-up, the PQ-16 including distress severity was again used to assess whether participants had experienced distressing AVH during the follow-up period. Furthermore, yes/no questions were used to determine whether participants had felt discriminated on skin colour, ethnicity or religion, or had experienced the divorce or death of a parent during the follow-up period. Lifetime presence of trauma was assessed with six items derived from the post-traumatic stress disorder (PTSD) section of the Diagnostic Interview Schedule for Children (DISC) . The interview questions were transformed to self-report yes/no questions and previously used in a study by Adriaanse et al. . Participants were asked to answer questions from the SAHA questionnaire about substance abuse. Having ever used alcohol or cannabis was assessed on a four-point scale (0, never; 1, once; 2, a few times; 3, more than a few times; which was recoded to 0, no; 1, yes), and having been drunk or having been in a fight while drinking alcohol in the past year was determined with a different four-point scale (0, never; 1, 1–2 times; 2, 3–5 times; 3, 6 or more times; which was recoded to 0, no; 1, yes) . An adjusted version of the mastery questionnaire was used to measure the amount of locus of control . This questionnaire contains six items on a five-point scale (0, totally disagree; 1, somewhat disagree; 2, intermediate; 3, somewhat agree; 4, totally agree). The internal consistency of the mastery questionnaire in this study was acceptable with an ordinal alpha of 0.73. We do not have further information on the validity of this adjusted version of the mastery questionnaire in adolescents. Finally, participants were asked if they were religious (0, no; 1, somewhat; 2, very; 3, unsure). No and unsure were coded as non-religious, somewhat and very as religious. The variables that were obtained at the follow-up assessment were included in the analyses because these provided additional information about the period before follow-up.
Potential predictors were selected based on a data-driven approach. Therefore, all available variables were used, except those that showed high inter-correlations (≥ 0.8), were missing for over 25% of cases or were formulated unclearly. Descriptive statistics of the sample were calculated using pooled means, standard deviations, frequency counts and percentages across the imputed datasets. Pearson’s Chi-square tests (χ2) and non-parametric Mann–Whitney U tests (U) were used to identify differences between participants included and excluded in this study. Internal consistency of the used questionnaires in this study was estimated with ordinal alpha’s, which were calculated based on the polychoric item correlation matrix . Internal consistency was considered acceptable when alpha > 0.7 . Missing values were imputed ten times with multiple imputation, using the R-package ‘multivariate imputation by chained equations’ (MICE) . Predictors of spontaneous discontinuation of AVH were investigated using least absolute shrinkage and selection operator (LASSO) analyses in each of the imputed datasets . LASSO allows for identification of the most important predictors of a given outcome from a large set of candidate predictors by using regularization, which shrinks unimportant predictors to zero, while maintaining the most important predictors in the model. This procedure has the advantage that it allows for identification of a model that balances model parsimony with prediction accuracy. The number of selected predictors depends on the magnitude of the penalty/shrinkage, for which an optimal value needs to be selected. To do this, the optimal value of the tuning parameter λ was selected via fivefold cross-validation. This entailed selecting the λ value that was associated with the best prediction [highest area under the receiver operating curve (ROC)] across the five folds. The associated model was selected and, to guard against overfitting, the coefficients of the most parsimonious model within 1 standard error (SE) from the selected model were used for model interpretation. LASSO analyses were run using the ‘glmnet’ R-package . The results of the LASSO analyses were tallied across the 10 runs. The predictors that appeared in at least 8 of the 10 imputed datasets were selected. Finally, to get an idea of the joint prediction of the selected predictors in a more conventional statistical approach, they were combined in a multivariable model. Statistical analyses were carried out with R (version 3.5.2; R-core team, 2018) and the Statistical Package for the Social Sciences version 23 for Windows (SPSS 23.0; IBM Inc. New York, USA).
Description of the study population
A total of 251 of the 1841 (14.0%; 59.2% female) adolescents reported AVH at baseline. 160 adolescents (8.7% of the total sample; 60.4% female) mentioned having experienced distress from the AVH. Of those 160 adolescents, 124 (77.5%) had completed their follow-up questionnaire. One case was removed, because analyses showed clear response tendency which made the data of this participant unreliable. The remaining 123 participants were included in the analyses. The mean age of the included participants was 12.6 years (range 12–14 years), 62.6% of them were female, 29.6% were migrant-Dutch and 52.0% attended a higher educational level. All sample characteristics are given in Table 1.
The percentage of non-response from all invited adolescents at the baseline screening was 14.4% (310/2151 adolescents). 8.8% of these adolescents had no consent, 4.9% was not present during the baseline screening because of illness or unknown reason, and 0.7% of the adolescents had changed schools. The percentage of non-response at the follow-up screening was 15.3% (329/1841 adolescents). 1.0% of these adolescents had no consent, 8.2% was not present during the follow-up screening because of illness or unknown reason, 0.9% had changed schools, and in 7.8% the school had stopped its participation in the study.
23% (n = 36) of the adolescents who experienced distress from AVH at baseline did not participate in the follow-up measurement. The dropouts differed from the subjects included in this study on several characteristics: dropouts more often had divorced parents (55.6% of dropouts vs. 24.6% of participants, χ2 = 12.3, p = 0.000), were more frequently born abroad (16.7% vs. 3.3%, χ2 = 8.5, p = 0.004) and had more conduct problems (3.39 vs. 2.51, U = 1645, p = 0.017).
During follow-up, 43 adolescents (35.0%) reported that they had experienced at least mildly distressing AVH during the last 12 months. In that period, nine adolescents (7.3%) had experienced AVH without distress and 71 adolescents (57.7%) had not experienced AVH. Thus, in 80 adolescents (65.0%) the distressing AVH had spontaneously discontinued. The flowchart outlining the follow-up groups is depicted in Fig. 2.
Predictors of spontaneous discontinuation at follow-up
The results of the LASSO analyses are presented in Table 2. The overall predictive value of the models ranged between AUC = 0.58 and AUC = 0.62 across the imputed datasets (i.e. 0.5 indicates chance prediction, 1.0 indicates perfect prediction), indicating that some predictive value, although limited, was present. The results also indicated some potentially important predictors of spontaneous discontinuation of distressing AVH at 12-month follow-up. Nine predictors were consistently selected across the imputed datasets (in ≥ 8 imputed datasets). These were: never having used cannabis, parents not being divorced in the past year, never having been scared by seeing a deceased body, less prosocial behaviour, having repeated a school grade, having the feeling that others have it in for you, having anxiety when meeting new people, having lived through events exactly as if they happened before and having the feeling as if parts of the body have changed.
In Table 3, the results of a conventional multivariable regression model with only the selected predictors is shown. The results of these analyses indicated that only four of the nine selected predictors showed a significant multivariate association, although all nine were found to contribute substantially to the prediction of AVH persistence in the LASSO analyses.
Post hoc analysis of the prosocial behaviour data showed that adolescents with the lowest scores (scores 3–4/10) and the highest scores (scores 9–10/10) on the SDQ prosocial behaviour scale were part of the distressing AVH persistence group, while the adolescents with intermediate scores (scores 5–8/10) were part of the discontinuation group.
In the school-based sample of 1841 adolescents, 14% had experienced AVH with or without distress. 64% of the adolescents with AVH reported at baseline that they had experienced AVH that distressed them. The majority (65%) of the adolescents who participated in the follow-up did not experience distressing AVH during the follow-up period. Discontinuation of distressing AVH could not be predicted by socio-demographic characteristics, but was predicted by never having used cannabis, parents not being divorced in the past year, never having been scared by seeing a deceased body, less prosocial behaviour, having repeated a school grade, having the feeling that others have it in for you, having anxiety when meeting new people, having lived through events exactly as if they happened before and having the feeling as if parts of the body have changed.
The prevalence rate of AVH in our sample is similar to rates presented in the meta-analysis by Kelleher et al. . It should be noted that distress was often not taken into account in the studies included in that meta-analysis. The discontinuation rate of distressing AVH is lower than the 2-year AVH discontinuation rate of 73% reported in a similar population-based study among 13–14-year-old adolescents by De Loore et al. . Possibly, if we would have assessed the participants again 2 years after baseline, more participants might have discontinued from distressing AVH and the discontinuation rate might have been closer to or even higher than the rate reported by De Loore et al. .
Inherent to the data-driven approach is that, next to finding theoretically expected factors associated with discontinuation of distressing AVH, factors were found that are theoretically difficult to interpret and/or cannot be influenced in the daily life of adolescents with distressing AVH. Although the predictors were selected based on their joined ability to predict the outcome, the individual predictors are further elaborated on in the next paragraphs, to outline potential theoretical explanations for their contribution to the model.
In this study, younger age and not being from an ethnic minority group did not predict discontinuation of distressing AVH. However, never having used cannabis, parents not being divorced in the past year and never having been scared by seeing a deceased body were found to predict spontaneous discontinuation from distressing AVH. This is in line with the findings of several studies [6, 12, 13]. In The Netherlands, 1.5–6.8% of 13–14-year-old adolescents have ever used cannabis . In the current study, 2.6% of the adolescents with discontinuation of distressing AVH reported ever having used cannabis, while this was much higher (14.0%) in the persistence group. We hypothesized that the divorce of parents and being scared by seeing a deceased body represent highly emotional and, for some adolescents, traumatic events. Not having experienced such traumatic events can therefore be regarded as a protective factor for persistence of distressing AVH. Substance abuse and trauma are not only associated with AVH persistence, but they are also well-known environmental risk factors for the development of psychosis and other mental illness [42, 43].
Less prosocial behaviour as a predictor of spontaneous discontinuation from distressing AVH might seem counterintuitive, because prosocial behaviour in adolescence has been associated with a variety of positive outcomes such as high self-esteem, academic success and high-quality relationships . When looking more closely to the data to explore this finding, we found that adolescents with the lowest and highest scores on the SDQ prosocial behaviour scale were part of the distressing AVH persistence group. This is in line with literature stating that childhood psychopathology is associated with both high and low levels of prosocial behaviour [45,46,47]. It can be argued that both low and high prosocial behaviour indicate problems with social interactions, which in turn increase the risk of psychiatric problems. In those social interactions, adolescents with low prosocial behaviour tend to lack empathy towards others. Excessive prosocial behaviour, however, might reflect sub-assertiveness; a strong tendency to please others. We do not know the direction of the association between abnormal prosocial behaviour and persistence of distressing AVH. Therefore, more research on the relationship between prosocial behaviour and discontinuation of distressing AVH in other non-clinical adolescent cohorts is needed.
A novel finding is that the distressing AVH were more likely to discontinue in participants who repeated a school grade. The 95% confidence interval was wide (1.47–17.64). Therefore, this finding must be read with some caution. We did not find an association between the specific year that was repeated and discontinuation from distressing AVH. We do not have a ready explanation for the finding that in our sample school grade repetition was associated with distressing AVH discontinuation. Grade repetition is often considered a consequence of cognitive or social–emotional problems. There is, however, limited knowledge on the effect of grade repetition on the social–emotional development of students . One study reported that 13–14-year-old students who had ever repeated a year had more academic, emotional, and behavioural problems than the non-retained students . There are, to our knowledge, no studies that describe a positive social–emotional effect of grade repetition in a population similar to the current study’s population.
Another novel finding is that having the feeling that others have it in for you was associated with discontinuation of distressing AVH. The feeling that others have it in for you can be regarded as distrust or suspiciousness. Delusional ideation has been associated with persistence of AVH in adolescence . The finding of this study that having the feeling that others have it in for you was associated with discontinuation of distressing AVH was therefore surprising. Other surprising findings from this study were that anxiety when meeting new people, having lived through events exactly as if they happened before and having the feeling as if parts of the body have changed predicted discontinuation of distressing AVH at 12-month follow-up. At this point, we do not have an evident theoretical explanation for these findings. The 95% confidence intervals for these predictors were wide and therefore must be read with caution. Usually, these variables are related to persistence of psychotic experiences and not discontinuation. This raises the question about the validity of the concept AVH in adolescents. Studies on APS found that they are more prevalent in populations under the age of 15/16 years than in older adolescents. At the same time, APS less frequently cause functional impairment or mental disorders in the younger age category, indicating that AVH have less clinical significance in younger adolescents, even when they experience distress from the AVH [5, 18, 50,51,52]. Potentially, even when young adolescents experience distress from the AVH, they are less related to psychopathology than we hypothesized.
Strengths and limitations
This study has some limitations. First, voice hearing was assessed with one question: “I have heard things other people cannot hear, like voices of people whispering or talking”. At baseline, this question was not specified by a time period, such as ‘in the past month’. This could have led to differences in the way the question was interpreted. If participants interpreted the question as ‘have you ever in your life heard things other people cannot hear, like voices of people whispering or talking’, we could have included participants in whom the distressing AVH had already discontinued. Nevertheless, the prevalence rates of (distressing) AVH at baseline were conform prevalence rates of AVH in adolescents (ranging from 4.7 to 35.3%) as presented in the meta-analysis of Kelleher et al. . Furthermore, the number, type and hostility of the voices and the degree of reality attached to the distressing AVH were not investigated. Therefore, the assessment of the distressing AVH was limited. Another limitation is that we were not able to research all predictors of AVH persistence found in previous studies (e.g. age of onset of AVH and developmental problems), since these were not assessed in the MasterMind study . Next, follow-up data was only obtained once at 12 months after baseline and participants were not asked whether they received mental health care. It therefore remains unknown from this study whether distress associated with the AVH predicts a need for mental health care. A potential limitation is that this study relied on the PQ-16, a self-report questionnaire, to measure AVH . Although the percentage of AVH in adolescents found in this study is in line with rates reported in previous non-clinical adolescent samples, data might have been prone to response bias. Participants might have misunderstood the questions or might have responded to questions in a ‘socially desirable way’, even though the questionnaires were anonymous . A recent review of screening instruments for identifying individuals at clinical high risk for psychosis concluded that the majority of measures, including the PQ-16, have relatively poor or underexplored psychometric properties . Although the current study did not have the objective to identify adolescents at clinical high risk for psychosis, the PQ-16 might not have been the most optimal method to measure AVH, risking overestimation of AVH. However, a previous study by Kelleher et al. in 11–13-year-old non-clinical adolescents found that self-reported AVH, defined as a positive answer to the question “Have you ever heard voices or sounds that no one else can hear?”, had good positive predictive value (71.4%) and good negative predictive value (90.4%) when compared to AVH assessed via a clinical interview . In the current study we used a positive answer to the statement “I have heard things other people cannot hear, like voices of people whispering or talking” to determine the presence of AVH, which is a similar question to the one asked by Kelleher et al. To increase clinical significance and to reduce overestimation of AVH prevalence, we rated a positive answer on this item only as AVH if adolescents reported distress associated with the experience. Also a limitation is that one of the questionnaires, the FAS, had a low internal consistency in this study. This indicates that in this study the items of the FAS did not fully measure the same construct or that the answers to the items were inconsistent. Because the FAS did not predict the outcome in 8 or more of the imputed datasets and it therefore was not regarded as a predictor of spontaneous discontinuation of distressing AVH, we did not take additional steps to remove it from analyses. Next, it might have added extra value to the study if a linear multivariable regression analysis with ‘no AVH’, ‘AVH without distress’ and ‘distressing AVH’ as outcome groups would have been performed, because this might have differentiated the risk of future mental health problems. However, since only nine participants reported AVH without distress, such analysis was not possible. Finally, almost a quarter (22.5%) of the participants with distressing AVH at baseline did not participate in the follow-up. Reasons for dropout at follow-up were: not present at follow-up measurement, participants or their parents withdrew their consent or school withdrew their consent. Analysis of the dropout population revealed that dropouts more often had divorced parents, were more frequently born abroad and had more conduct problems. These factors are potentially related to a higher risk of distressing AVH persistence. This implies that the included participants comprised a group with more favourable outcome and therefore discontinuation rates might be overestimated.
The main strengths of this study are that it is based on a large school-based sample of young adolescents and that it includes a large number of variables. Because this is a population-based sample, adolescents of all socio-demographic backgrounds and educational levels are included. Furthermore, this is one of few AVH studies investigating adolescents instead of young children or adults. Since adolescence is the period during which the first signs of psychopathology often emerge, more research specifically on adolescents with AVH is needed. Another strength of the current study is that the study’s description of AVH took distress into account. Persistence of distressing AVH in healthy individuals increases the risk of mental health problems . Therefore, using distress of AVH as an extra outcome criterion helps differentiating between adolescents at risk and not at risk of mental health problems. This increases clinical significance of the current study. Finally, we have used the LASSO method for our statistical analyses. This technique allowed us to identify the most important predictors for spontaneous discontinuation of distressing AVH within the large set of potential predictors. The difference in significant predictors found by the LASSO analyses and the conventional multivariable regression analysis indicates that important predictors can be missed if selected only based on conventional forward regression strategies.
The rates presented in the current study suggest that distressing AVH in healthy adolescents are common, but transitory in approximately two-thirds of those adolescents. This study’s results show that it is possible to predict discontinuation of AVH in this population up to a certain extent. However, several predictors were difficult to interpret and, except for cannabis use, do not provide leads for screening or preventive measures at schools.
The dataset used and analysed during the current study is available from the corresponding author on reasonable request.
Area under the curve
Attenuated psychotic symptoms
Auditory verbal hallucinations
Comprehensive assessment of at-risk mental states
Diagnostic interview schedule for children
Family affluence scale
Least absolute shrinkage and selection operator
Multivariate imputation by chained equations
- N :
Number of participants
16-Item prodromal questionnaire
92-Item prodromal questionnaire
Post-traumatic stress disorder
Receiver operating curve
Rosenberg self-esteem scale
Social and health assessment scale
Strengths and difficulties questionnaire (for age 4–17 years)
Statistical package for the social sciences
- U :
Non-parametric Mann–Whitney U tests
- χ2 :
Pearson’s Chi-square test
Kelleher I, Connor D, Clarke MC et al (2012) Prevalence of psychotic symptoms in childhood and adolescence: a systematic review and meta-analysis of population-based studies. Psychol Med 42:1857–1863. https://doi.org/10.1017/S0033291711002960
Moseley P, Fernyhough C, Ellison A (2013) Auditory verbal hallucinations as atypical inner speech monitoring, and the potential of neurostimulation as a treatment option. Neurosci Biobehav Rev 37:2794–2805. https://doi.org/10.1016/j.neubiorev.2013.10.001
Bartels-Velthuis AA, Wigman JTW, Jenner JA et al (2016) Course of auditory vocal hallucinations in childhood: 11-year follow-up study. Acta Psychiatr Scand 134:6–15. https://doi.org/10.1111/acps.12571
Dominguez DG, Wichers M, Lieb MR et al (2011) Evidence that onset of clinical psychosis is an outcome of progressively more persistent subclinical psychotic experiences: an 8-year cohort study. Schizophr Bull 37:84–93. https://doi.org/10.1093/schbul/sbp022
Schimmelmann BG, Michel C, Martz-Irngartinger A et al (2015) Age matters in the prevalence and clinical significance of ultra-high-risk for psychosis symptoms and criteria in the general population: findings from the BEAR and BEARS-Kid studies. World Psychiatry 14:189–197. https://doi.org/10.1002/wps.20216
de Leede-Smith S, Barkus E (2013) A comprehensive review of auditory verbal hallucinations: lifetime prevalence, correlates and mechanisms in healthy and clinical individuals. Front Hum Neurosci 7:1–25. https://doi.org/10.3389/fnhum.2013.00367
Fonseca Pedrero E, Debbané M (2017) Schizotypal traits and psychotic-like experiences during adolescence: an update. Psicothema 29:5–17. https://doi.org/10.7334/psicothema2016.209
van Os J, Linscott RJ, Myin-Germeys I et al (2009) A systematic review and meta-analysis of the psychosis continuum: evidence for a psychosis proneness–persistence–impairment model of psychotic disorder. Psychol Med 39:179–195. https://doi.org/10.1017/S0033291708003814
Linscott RJ, Van Os J (2013) An updated and conservative systematic review and meta-analysis of epidemiological evidence on psychotic experiences in children and adults: on the pathway from proneness to persistence to dimensional expression across mental disorders. Psychol Med 43:1133–1149. https://doi.org/10.1017/S0033291712001626
van Os J, Reininghaus U (2016) Psychosis as a transdiagnostic and extended phenotype in the general population. World Psychiatry 15:118–124. https://doi.org/10.1002/wps.20310
De Loore E, Gunther N, Drukker M et al (2011) Persistence and outcome of auditory hallucinations in adolescence: a longitudinal general population study of 1800 individuals. Schizophr Res 127:252–256. https://doi.org/10.1016/j.schres.2011.01.015
Wigman JTW, Van Winkel R, Raaijmakers QAW et al (2011) Evidence for a persistent, environment-dependent and deteriorating subtype of subclinical psychotic experiences: a 6-year longitudinal general population study. Psychol Med 41:2317–2329. https://doi.org/10.1017/S0033291711000304
Mackie CJ, Castellanos-Ryan N, Conrod PJ (2010) Developmental trajectories of psychotic-like experiences across adolescence: impact of victimization and substance use. Psychol Med 41:47–58. https://doi.org/10.1017/s0033291710000449
Baumeister D, Sedgwick O, Howes O, Peters E (2017) Auditory verbal hallucinations and continuum models of psychosis: a systematic review of the healthy voice-hearer literature. Clin Psychol Rev 51:125–141. https://doi.org/10.1016/j.cpr.2016.10.010
Daalman K, Diederen KMJ, Hoekema L et al (2016) Five year follow-up of non-psychotic adults with frequent auditory verbal hallucinations: are they still healthy? Psychol Med 46:1897–1907. https://doi.org/10.1017/S0033291716000386
Hoffman RE, McGlashan TH (1997) Synaptic elimination, neurodevelopment, and the mechanism of hallucinated “voices” in schizophrenia. Am J Psychiatry 154:1683–1689. https://doi.org/10.1176/ajp.154.12.1683
Corcoran C, Walker E, Huot R et al (2003) The stress cascade and schizophrenia: etiology and onset. Schizophr Bull 29:671–692. https://doi.org/10.1093/oxfordjournals.schbul.a007038
Schultze-Lutter F, Ruhrmann S, Michel C et al (2018) Age effects on basic symptoms in the community: a route to gain new insight into the neurodevelopment of psychosis? Eur Arch Psychiatry Clin Neurosci. https://doi.org/10.1007/s00406-018-0949-4
el Bouhaddani S, van Domburgh L, Schaefer B et al (2018) Peer status in relation to psychotic experiences and psychosocial problems in adolescents: a longitudinal school-based study. Eur Child Adolesc Psychiatry 27:701–710. https://doi.org/10.1007/s00787-017-1063-2
el Bouhaddani S, van Domburgh L, Schaefer B et al (2019) Psychotic experiences among ethnic majority and minority adolescents and the role of discrimination and ethnic identity. Soc Psychiatry Psychiatr Epidemiol 54:343–353. https://doi.org/10.1007/s00127-019-01658-1
Ising HK, Veling W, Loewy RL et al (2012) The validity of the 16-item version of the prodromal questionnaire (PQ-16) to screen for ultra high risk of developing psychosis in the general help-seeking population. Schizophr Bull 38:1288–1296. https://doi.org/10.1093/schbul/sbs068
de Jong Y, Mulder CL, Boon AE et al (2018) Screening for psychosis risk among adolescents in child and adolescent mental health services: a description of the first step with the 16-item version of the prodromal questionnaire (PQ-16). Early Interv Psychiatry 12:669–676. https://doi.org/10.1111/eip.12362
Boyce W, Torsheim T, Currie C, Zambon A (2006) The Family Affluence Scale as a measure of national wealth: validation of an adolescent self-report measure. Soc Indic Res 78:473–487. https://doi.org/10.1007/s11205-005-1607-6
Andersen A, Krølner R, Currie C et al (2008) High agreement on family affluence between children’s and parents’ reports: international study of 11-year-old children. J Epidemiol Community Health 62:1092–1094. https://doi.org/10.1136/jech.2007.065169
Sinclair SJ, Blais MA, Gansler DA et al (2010) Psychometric properties of the Rosenberg self-esteem scale: overall and across demographic groups living within the United States. Eval Health Prof 33:56–80. https://doi.org/10.1177/0163278709356187
Berry JW, Phinney JS, Sam DL, Vedder P (2006) Immigrant youth: acculturation, identity and adaptation. Appl Psychol an Int Rev 55:303–332. https://doi.org/10.1111/j.1464-0597.2006.00256.x
van Widenfelt BM, Goedhart AW, Treffers PDA, Goodman R (2003) Dutch version of the strengths and difficulties questionnaire (SDQ). Eur Child Adolesc Psychiatry 12:281–289. https://doi.org/10.1007/s00787-003-0341-3
Goodman R (1997) The strengths and difficulties questionnaire: a research note. J Child Psychol Psychiatry 38:581–586. https://doi.org/10.1111/j.1469-7610.1997.tb01545.x
Muris P, Meesters C, van den Ber F (2003) The strengths and difficulties questionnaire (SDQ). Further evidence for its reliability and validity in a community sample of Dutch children and adolescents. Eur Child Adolesc Psychiatry 12:1–8. https://doi.org/10.1007/s00787-003-0298-2
Coie JD, Dodge KA, Coppotelli H (1982) Dimensions and types of social status: a cross-age perspective. Dev Psychol 18:557–570. https://doi.org/10.1037/0012-1618.104.22.1687
Ruchkin V, Schwab-Stone M, Vermeiren R (2004) Social and health assessment (SAHA): psychometric development summary. Yale University, New Haven
Suk E, van Mill J, Vermeiren R et al (2009) Adolescent suicidal ideation: a comparison of incarcerated and school-based samples. Eur Child Adolesc Psychiatry 18:377–383. https://doi.org/10.1007/s00787-009-0740-1
Shaffer D, Fisher P, Lucas CP et al (2000) NIMH diagnostic interview schedule for children version IV (NIMH DISC-IV): description, differences from previous versions, and reliability of some common diagnoses. J Am Acad Child Adolesc Psychiatry 39:28–38. https://doi.org/10.1097/00004583-200001000-00014
Adriaanse M, Van Domburgh L, Hoek HW et al (2015) Prevalence, impact and cultural context of psychotic experiences among ethnic minority youth. Psychol Med 45:637–646. https://doi.org/10.1017/S0033291714001779
Pearlin LI, Schooler C (1978) The structure of coping. J Health Soc Behav 19:2–21. https://doi.org/10.2307/2136319
Gadermann AM, Guhn M, Zumbo BD (2012) Estimating ordinal reliability for Likert-type and ordinal item response data: a conceptual, empirical and practical guide. Pract Assess 17:1–13
Bland JM, Altman DG (2011) Statistics notes: Cronbach’s alpha. Br Med J 314:572
van Buuren S, Groothuis-Oudshoorn K (2011) mice: multivariate imputation by chained equations in R. J Stat Softw 45:1–67. https://doi.org/10.18637/jss.v045.i03
Tibshirani R (1996) Regression shrinkage and selection via the LASSO. J R Stat Soc Ser B 58:267–288. https://doi.org/10.2307/41262671
Friedman J, Hastie T, Tibshirani R (2010) Regularization paths for generalized linear models via coordinate descent. J Stat Softw 33:1–22. https://doi.org/10.1163/ej.9789004178922.i-328.7
Stevens G, van Dorsselaer S, Boer M et al (2017) Health and well-being of adolescents in The Netherlands (in Dutch), Utrecht
Moore TH, Zammit S, Lingford-Hughes A et al (2007) Cannabis use and risk of psychotic or affective mental health outcomes: a systematic review. Lancet 370:319–328. https://doi.org/10.1016/S0140-6736(07)61162-3
Krabbendam L (2008) Childhood psychological trauma and psychosis: a commentary on ‘The relationship between trauma and beliefs about hearing voices: a study of psychiatric and non-psychiatric voice hearers’ by Andrew et al. Psychol Med 38:1405–1408. https://doi.org/10.1017/S0033291708002705
van der Graaff J, Carlo G, Crocetti E et al (2018) Prosocial behavior in adolescence: gender differences in development and links with empathy. J Youth Adolesc 47:1086–1099. https://doi.org/10.1007/s10964-017-0786-1
Scourfield J, John B, Martin N, McGuffin P (2004) The development of prosocial behaviour in children and adolescents: a twin study. J Child Psychol Psychiatry 45:927–935. https://doi.org/10.1111/j.1469-7610.2004.t01-1-00286.x
Hay DF (1994) Prosocial development. J child Psychol psychiatry 35:29–71. https://doi.org/10.1111/j.1469-7610.1994.tb01132.x
Eisenberg N, Fabes RA (1998) Prosocial development. In: Handbook of child psychology, 5th ed. Wiley, Hoboken, pp 701–788
Bonvin P, Bless G, Schuepbach M (2008) Grade retention: decision-making and effects on learning as well as social and emotional development. Sch Eff Sch Improv 19:1–19. https://doi.org/10.1080/09243450701856499
Meisels SJ, Liaw F (1993) Failure in grade: do retained students catch up? J Educ Res 87:69–77. https://doi.org/10.1080/00220671.1993.9941169
Schultze-Lutter F, Hubl D, Schimmelmann BG, Michel C (2017) Age effect on prevalence of ultra-high risk for psychosis symptoms: replication in a clinical sample of an early detection of psychosis service. Eur Child Adolesc Psychiatry 26:1401–1405. https://doi.org/10.1007/s00787-017-0994-y
Ribolsi M, Lin A, Wardenaar KJ et al (2017) Clinical presentation of attenuated psychosis syndrome in children and adolescents: is there an age effect ? Psychiatry Res 252:169–174. https://doi.org/10.1016/j.psychres.2017.02.050
Cornblatt BA, Carrión RE, Auther A et al (2015) Psychosis prevention: a modified clinical high risk perspective from the recognition and prevention (RAP) program. Am J Psychiatry 172:986–994. https://doi.org/10.1176/appi.ajp.2015.13121686.Psychosis
Rosenman R, Tennekoon V, Hill LG (2011) Measuring bias in self-reported data. Int J Behav Healthc Res 2:320–332. https://doi.org/10.1504/IJBHR.2011.043414
Addington J, Stowkowy J, Weiser M (2015) Screening tools for clinical high risk for psychosis. Early Interv Psychiatry 9:345–356. https://doi.org/10.1111/eip.12193
This work was supported by the Netherlands Organisation for Health Research and Development, Grant no. 41700004. The authors gratefully acknowledge all participating adolescents and teachers, and all research assistants involved.
Conflict of interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
The study procedures have been approved by the Medical Ethics Committee of the VU University Medical Center (VUmc) Amsterdam [reference number 2013.247] and have therefore been performed in accordance with the 1964 Declaration of Helsinki and its later amendments.
Electronic supplementary material
Below is the link to the electronic supplementary material.
About this article
Cite this article
Brink, V., van Driel, C., el Bouhaddani, S. et al. Spontaneous discontinuation of distressing auditory verbal hallucinations in a school-based sample of adolescents: a longitudinal study. Eur Child Adolesc Psychiatry 29, 777–790 (2020). https://doi.org/10.1007/s00787-019-01393-7
- Auditory verbal hallucinations