Cultural adaptation and validation of the Attribution Questionnaire for stigma towards disability pension applicants for use among psychiatrists and general practitioners in Sweden

Abstract

Background

This study aimed to culturally translate the Attribution Questionnaire (AQ) to the Swedish language and examine the reliability and validity of the new Swedish version to measure stigma towards disability pension applicants in the Swedish context among psychiatrists and general practitioners.

Methods

The AQ was translated from the original English version into Swedish using the recommended guidelines for cultural translation of questionnaires. Steps included forward/back-translation, use of expert committee and pretesting. Cronbach’s alpha was used to determine internal consistency and structural equation modelling (SEM) was used to test the responsibility model of stigma compared to the original English version.

Results

1,414 physicians completed the questionnaire (23.6%). Cultural translation resulted in many modifications to the original questionnaire to increase the external validity. Internal reliability of the AQ Swedish version (AQ-S) was 0.733 and is considered acceptable. Pity and Segregation-coercion sub-scales showed limited consistency. SEM findings show that the responsibility model of stigma is an acceptable fit for the Swedish setting.

Conclusion

Findings show that the AQ-S is comparable to the other versions of the AQ and is a reliable measure to assess and monitor stigma among physicians in the Swedish setting. Our study shows that cultural translation does not significantly impact the validity of the questionnaire.

Peer Review reports

Background

Reducing stigma is a key priority for the Swedish Government [1]. Evidence shows that mental illness-related stigma among health care providers is a barrier to access treatment recovery [2] and contributes to the burden of disease [3]. However, few stigma measures exist that are culturally appropriate for the Swedish context. In this study, we aim to culturally translate the widely validated Attribution Questionnaire [4] to measure the attitudes of Swedish physicians, particularly related to disability pension applicants.

A brief overview of stigma

In this paper, stigma is defined as a social response to any feature that deviates from the ‘norm’ and leads to others discrediting the individual with that feature [5, 6]. We can break stigma down into three social responses—stereotypes (e.g. beliefs), prejudice (e.g. negative attitudes) and discrimination (e.g. unfair treatment of others based on stereotypes or beliefs). Researchers have idenifed several different types of stigmas including public, self, perceived, vicarious, and structural; two have dominated large scale studies: public and self-stigma the former was the target of this study [7, 8]. Negative attitudes and discrimination directed towards individuals with mental health problems as a result of their condition is public stigma. Self-stigma occurs when the person with a mental illness internalises and applies the negative attitudes and discrimination to themselves. In this paper, we focus on the former, public stigma, in the context of physicians. We know that like the general population, physicians also hold negative attitudes [2, 3] but to the best of our knowledge, physicians’ attitudes towards people with mental illness has not been measured in the Swedish context particularly related to disability pension.

Main ways to combat public stigma

Research suggests two main ways to change the stigma of many illnesses [8, 9]. Educational approaches incorporate factual information to challenge myths about mental illness; e.g., contrary to the myth of people with mental illness being dangerous, epidemiological research shows prevalence is very low. Contact challenges stigma when the general public has interactions with people with lived experience of mental illness and recovery. Meta-analyses suggest that contact approaches have a significantly better impact than educational approaches [10, 11].

Attribution theory and stigma

Attribution theory has been used to explain stigma related to mental illness [4]. Weiner [12] argues that when presented with an event or situation, people try to determine who is responsible. If individuals are not held responsible (external attribution), then others are more likely to engage in helping behaviour. In contrast, if an individual is held responsible (internal attribution), then others are more likely to engage in punishing behaviour. Corrigan and Markowitz [4] drew on attribution theory to develop a conceptual model explaining public stigma related to mental illnesses. The widely tested and validated model (see Fig. 1) suggests that judgements about personal responsibility are predictors of behaviours. Previous studies show a correlation between such attitudes and subsequent behaviours [13]. We chose the Attribution Questionnaire because the questionnaire has been validated in many countries and across different population sub-groups, including physicians [14,15,16,17,18,19]. We chose this model because this study is part of a larger study measuring physicians’ attitudes toward disability pension—government payments to those unable to work as a result of their disability—applicants with mental illness. In the broader study, we hypothesize that attribution of personal responsibility is a central tenant to the disability pension process and could influence physicians’ behaviours in this process.

Fig. 1
figure1

Source: Adapted from [4]

Responsibility model of stigma [4].

Cross-cultural adaptation of the Attribution Questionnaire

The Attribution Questionnaire [4] (see Additional file 1: Table 1 for original questions) is an American questionnaire that we wanted to culturally translate in the Swedish context. The original Attribution Questionnaire has nine stigmatizing constructs about people with mental illness. In this study, we focus on four of those nine constructs. Responsibility (blame): people have control over and are responsible for their mental illness and related symptoms. Anger: irritated or annoyed because the people are to blame for their mental illness. Pity: sympathy because people are overcome by their illness. Help: the provision of assistance to people with mental illness. The questionnaire uses a hypothetical vignette patient (Harry) who has schizophrenia [4]. Participants rate how much they agree with each statement made about the patient on a Likert scale from 1 (not at all) to 9 (very much) [9]. Yang et al. [20] argue that although stigma appears to be a universal phenomenon, how stigma manifests could be culturally specific. Building on this argument, items to measure stigma should not be one-size-fits-all. The Attribution Questionnaire has been tested and validated in other settings, for example, Italy [14, 18, 19], Spain [15] and Turkey [17]. However, to the best of our knowledge, only the Turkish study adapted the Attribution Questionnaire both for language and culture [17]. In fact, in two of the translated versions, the authors note that a significant limitation of the translated version was that it excluded cultural variability. Cross-cultural adaptation of questionnaires goes beyond translating items from one language to another. The purpose also ensures that the translated text is culturally meaningful for use the target population in the new setting [21]. Adaptation is not only respectful to the culture; research shows that it is also essential to maintain the content validity of the instrument [22, 23]. Cultural adaptation has become popular in the health status questionnaires [21] (e.g. the International Quality of Life Assessment), and we want to apply it to stigma measurements.

Overall, we aim to describe the process used to culturally adapt and validate the Attribution Questionnaire in the Swedish context. More specifically, the research questions were:

  1. 1.

    What aspects (if any) of the modified version of the Attribution Questionnaire need modification for the Swedish context?

  2. 2.

    How does cultural adaptation impact the validity of the questionnaire?

Methods

The translation and cross-cultural adaptation of the Attribution Questionnaire were performed according to the cultural translation guidelines indicated in the scientific literature [21, 22, 24] that include forward translation, back translation, consultation with an expert panel, pretesting and final consensus. We aimed to maintain the integrity of the Attribution Questionnaire while adapting the items to the Swedish cultural equivalents. The following describes how those steps were applied in this study:

Expert committee

The expert committee comprised representatives from the Swedish Social Insurance Agency, psychiatrists, psychologists, general practitioners (GPs) and researchers. All members had some mental health or medical background. The committee discussed the different versions of the translations, content of the vignettes and suitability of the wording for the Swedish context. To achieve equivalence between the source and target documents, the committee was asked to make decisions on four areas of cultural translation (see Table 1). For this study, between March 2017 and May 2018, we met two times and corresponded via email. We focused our cultural translation using the expert committee rather than backwards translation. The committee was bilingual in Swedish and English. However, we did also professionally back translate the documents in the process.

Table 1 Socio-demographic characteristics of the sample (n = 1,414)

Cultural translation

We used one of the items in the helping subscale to illustrate how we applied the cultural translation steps. One item asks whether the respondent would share a carpool with the vignette patient each day. First, a professional translator translated the question from English to Swedish. Then, a bilingual member of the research team checked the translation. Both the English and Swedish versions were sent to the expert committee for review. The committee discussed whether translation was accurate from a semantic perspective i.e. does the Swedish version ask what the English version intended? But also, whether the questions met idiomatic—colloquialisms, or idioms that are challenging to translate, experiential—questions that try capturing everyday experiences and life in the setting and conceptual equivalence—words that hold different conceptual meanings between cultures [21].

The lead author presented the different types of equivalences to the committee and provided examples. The committee then discussed each item to determine if any further modifications were needed. Consensus among the committee showed that carpool is not a experience used in Sweden and suggested that this might be more an American experience. In Sweden, you may give a person a ride but it usually is more casual rather than a regular occurrence and needed to be convenient for the driver. At this point, we changed the carpool to give a ride in your car. We then did cognitive testingFootnote 1 [25] using 3 experts—two medical doctors who are also public health researchers and one psychiatric epidemiologist. All agreed this question was still problematic and suggested some changes. At the next expert committee meeting, discussions continued that this item was problematic and still not suited to the Swedish context. Consensus led to changing the questions from “I would share a carpool with (name) each day” to “How likely are you to drive this person to work if you could meet?” In the end, we needed to replace the word carpool but also add an element of convenience to fit the Swedish context. We then sent the survey for back translation. Finally, we had 22 physicians complete a pilot survey but also provide comments on the questions. A few pilot participants commented that it was clear that the survey was not developed in the Swedish context. However, the pilot participants completed the surveys and we examined responses for any missing results or large ranges between answers. All changes were discussed with the research team which included a co-creator (PWC) of the original version of the Attribution Questionnaire and who was involved in this process. Consensus among the research team was needed before any items were modified from their original version. Comments and changes were systematically recorded throughout this process.

For the anger sub-scale, we deleted two items due to semantic equivalence based on advice from the expert committee, cognitive testing and the pilot survey comments. The comments were largely unanimous that the meaning between the three items in the anger scale were not different enough to warrant the three questions and led to participant frustration. For example, angry, irritated and aggravated do not translate into Swedish with enough semantic difference to be meaningful to the respondents. As such, the anger sub-scale was each reduced to two items.

The original responsibility and pity sub-scales each have three items and all of them were preserved in the cultural translation. Semantic-equivalence was needed for all items but no major modifications.

Sample

We posted the questionnaire to 6,000 Swedish psychiatrists and GPs, representing all of the psychiatrists and a random sample of approximately two thirds of GPs. 1,414 (23.6%) self-completed the questionnaire via post or online. Inclusion criteria were (1) registered practitioner in Sweden and (2) a psychiatrist or GP. We received addresses from the Hälso och sjukvårdens adressregister (Swedish register of health professional addresses). Hälso och sjukvårdens adressregister provided background information such as age, sex and location. Statistics Sweden administered the survey, then returned the anonymised results.

Statistical analysis

We used Cronbach’s alpha to estimate the instrument reliability with an acceptable level of > 0.70 [26]. We used Structural Equation Modelling (SEM) to test the responsibility model of stigma for the Swedish version of the AQ-27. We used several goodness-of-fit indicators to assess the model and used Schreiber, Nora [27] cut-off criteria: chi-square absolute and predictive fit (nonsignificant χ2 indicates a good fit), root mean square error of approximation (RMSEA) (RMSEA,0.06 to 0.08 indicates acceptable fit), Tucker-Lewis index (RLI ≥ 0.95), and Comparative fit index (≥ 0.95 for acceptance). We also conducted confirmatory factor analysis (CFA) to confirm that the factors in the Swedish versin loaded into the correct constructs (see Additional file 1: Tables 2 and 3). CFA results confirmed factor loading.

This study was approved by the Stockholm Regional Ethics Board (Dnr 2018/683-31/5).

Results

Table 1 summarizes the participant characteristics. Gender distribution among participants was relatively similar. Participant’s ages ranged from 25 to 90 (mean = 52.85, SD = 13.23). Most participants worked in the public setting (60%) and had experience completing a disability pension assessment.

Instrument reliability

Overall, internal consistency reliability for the Attribution Questionnaire-Swedish version (AQ-S) was acceptable (α =  0.733). Table 2 provides Cronbach’s alpha coefficients for each factor and compares these results with the Attribution Questionnaire translation of Italian version (AQ-I) [9], the Spanish version (AQ-E) [10].

Table 2 Comparison of Cronbach’s alpha coefficients in studies using the Attribution Questionnaire

Responsibility model of stigma

The final analytic sample was 1,323. The model has four latent variables: Responsibility (Responsibility 1, Responsibility 2, Responsibility 3), Pity (Pity 1, Pity 2), Anger (Anger 1, Anger 2) and Helping Behaviour (Helping Behaviour 1, Helping Behaviour 2, Helping Behaviour 3, Helping Behaviour 4). Standardized path coefficients are provided on each arrow in Fig. 2. Chi-squared was significant, χ 2(50) = 465.417, ρ < 0.001. The comparative fit index = 0.916 and the RMSEA (0.079) indicate a reasonable fit. The Tucker Lewis index = 0.889 was below the criterion level. Overall, data supports that the model is an acceptable fit.

Fig. 2
figure2

The four-factor measurement of the responsibility model. Note: The rectangles represent observed variables and the ovals represent the unobserved latent variables

Discussion

Reducing stigma towards those with mental illness remains a key priority of many governments [1, 28, 29]. The Swedish Government’s commitment to reduce stigma demonstrates the need for appropriate measurements available in the local language to monitor how attitudes are changing. In this study, we wanted to determine if the American designed Attribution Questionnaire could be culturally translated for Swedish physicians. The Attribution Questionnaire could be a helpful tool for measuring and monitoring stigma in the Swedish setting. Overall, results showed that the questionnaire is suitable for measuring physicians’ attitudes in the Swedish context. However, modifications were necessary to make the questionnaire externally valid in the new setting.

Results from our SEM model are acceptable [27] but the correlations between the latent factors are weaker than previous studies [4, 14, 15]. Similar to Akyurek, Efe [17] we found a negative and weak relationship between the responsibility and pity latent factors compared to other translated versions that found a stronger relationship [14, 15]. However, our sample, comprised only of physicians, differed from the other studies that included mostly students [4, 18] one including medical students [19], or the general population [14, 15]. Physicians, in general, would have more contact with those with mental illness compared to the other studies’ sample populations. As such, the theoretical model may be more applicable to general populations than physicians. Furthermore, since we used a truncated version of the Attribution Questionnaire is difficult to directly compare results with previous version of the questionnaire.

The importance of the expert committee

The expert committee played a significant role in modifying the questionnaire, much more than the process of back-translation. Previous questionnaire translation emphasises the role of back-translation as best practice for translating questionnaires [30, 31]. However, Epstein, Osborne [24] argue that an expert committee can play more pivotal role when translating across cultures. Our findings support this assertion, indeed, the questionnaire benefited greatly from the use of an expert group. It was the expert committee not the back-translation that identified the semantic issues and found experiential equivalence. Overall, our study supports the inclusion of an expert committee for culturally translating a questionnaire.

Cultural adaptation and the validity of the questionnaire

Overall, we found that cultural adaptation makes the questionnaire more relevant to the local context. Our results support that questionnaires should be translated for language and culture [21,22,23, 32, 33]. External validation—whether the results can be generalised or useful outside of the research context—is essential. Cultural translation increases the external validity of the questionnaire and ultimately the usefulness of results. Internal consistency—how well a survey measures what you want to measure—is also important and can be impacted by cultural translation. Our results showed that Cronbach’s alpha for some factors, in particular, ‘Responsibility’ were much higher compared to the Italian and Spanish translated versions of the Attribution Questionnaire (Responsibility α: AQ-S = 0.819, AQ-I = 0.615 and AQ-E = 0.390) [14, 15].

Limitations

This study is part of a broader project on physicians’ attitudes towards disability pension applicants in Sweden. As such, the vignettes used with the survey were changed from the original American vignette of Harry with schizophrenia to Johan/Johanna with depression, alcohol dependence or low back pain. Such changes could explain why the internal consistency varies between the different translated versions. It is difficult to determine if the results from the SEM for the Attribution Questionnaire are not as strong due to the modifications made by the research team or the cultural differences between the contexts or both [15]. Due to feasbility contstraints, our sample included only two thirds of GPs registered in Sweden. A third party—the Hälso och sjukvårdens adressregister—provided the addresses and randomly selected the two thirds before releasing the data for our use. As such, this could impact on the quality of our sample. Survey response rate was low, which could bias the results. Nevertheless, the sample size was bigger than that of many other studies, and concerned two groups of physicians that more frequently deal with disability pension applicants in their work. We also could have included persons with lived experience of mental illness in the expert committee to get their views on the cultural translation. Finally, we were unable run the SEM analysis and the impact on the model of different type of providers e.g. GPs versus psychiatrists.

Strengths

To the best of our knowledge, only one other study has culturally translated the Attribution Questionnaire [17]. Additionally, compared to the other Attribution Questionnaire translations [14, 15], our sample size is much larger. As such, our results could be more reliable in terms of the SEM and internal consistency analysis. Our results also demonstrate that the Attribution Questionnaire can be modified to suit specific contexts or sub-groups and still remain a meaningful measure of stigma.

Implications for policy

Given the Swedish Government’s initiative to reduce stigma, we recommend that the AQ-S could be an efficient tool to measure and monitor stigma in the Swedish setting, especially among physicians but also the wider population. In particular, Swedish policy-makers could use the AQ-S to determine whether newly implemented anti-stigma strategies are working. However, the AQ-S should be validated among other sub-groups.

Implications for practice

Disability pension is not a universal program. Government adjudicators must decide who ‘deserves’ to receive disability pension and who does not. However, these decisions must be based on unbiased information and not discriminatory attitudes. The AQ-S is practical tool to help gauge whether disability pension applicants, regardless of their diagnosis, receive a fair assessment. While this study focuses on this in relation to physicians, the AQ-S could also measure stigma among adjudicators themselves.

Implications for future research

Further examination of intersectionality—the idea that various forms of social stratification can intersect to create cumulative discrimination or disadvantage [34] in the context of disability pension is vital. While this study explored the intersection of gender and disability, we intend to expand this exploration to include ethnicity and other factors e.g. socioeconomic status in future studies. We need a more nuanced understanding of what factors might lead to positive or negative attitudes among physicians and other policy-makers. The vignettes created in this study could be amended to explore such ‘intersectional stigma’ [35]. A better understanding of intersectional stigma and disability pension would also provide clearer pathways for policy intervention to address any inequalities that may exist.

Conclusion

Our findings demonstrate that the Swedish version of the Attribution Questionnaire (AQ-S) provides a validated instrument with acceptable psychometric properties for the assessment of stigma among physicians in Sweden.

Availability of data and materials

The data are not publicly available due to privacy or ethical restrictions.

Notes

  1. 1.

    In survey development, cognitive testing can be used as a method to ensure the quality of the survey items and ensure that the interpretation of the questions is as intended. In this study, we cognitively tested the questionnaire with 3 participants that had medical or mental health backgrounds. The participants were asked to complete the questionnaire prior to meeting. We spent 90 min going through the questionnaire using think-aloud techniques—asking participants to talk through their answers and verbal probing—asking participants what the questions means to them. The interviewer took fieldnotes and documented comments made by the participants. Comments were summarised and then discussed with the project team and also the expert committee.

Abbreviations

AQ:

Attribution Questionnaire

AQ-I:

Attribution Questionnaire Italian Version

AQ-E:

Attribution Questionnaire Spanish Version

AQ-S:

Attribution Questionnaire Swedish version

CFA:

Confirmatory Factor Analysis

GP:

General practitioners

RMSEA:

Root mean square error of approximation

SEM:

Structural Equation Modelling

References

  1. 1.

    Uppdrag att minska stigma kring psykisk ohälsa och suicid [press release]. Stockholmd: Socialdepartementet 2018.

  2. 2.

    Knaak S, Mantler E, Szeto A. Mental illness-related stigma in healthcare: barriers to access and care and evidence-based solutions. Healthcare management forum. Los Angeles: SAGE Publications; 2017.

    Google Scholar 

  3. 3.

    Weiss MG, Ramakrishna J, Somma D. Health-related stigma: rethinking concepts and interventions. Psychol Health Med. 2006;11(3):277–87.

    Article  Google Scholar 

  4. 4.

    Corrigan P, Markowitz FE, Watson A, Rowan D, Kubiak MA. An attribution model of public discrimination towards persons with mental illness. J Health Soc Behav. 2003;44:162–79.

    Article  Google Scholar 

  5. 5.

    Link BG, Yang LH, Phelan JC, Collins PY. Measuring mental illness stigma. Schizophr Bull. 2004;30(3):511–41.

    Article  Google Scholar 

  6. 6.

    Yang LH, Cho S, Kleinman A. Stigma of mental illness. International encyclopedia of public health. Amsterdam: Elsevier Inc.; 2008. p. 219–30.

    Google Scholar 

  7. 7.

    Corrigan PW, editor.On the stigma of mental illness: practical strategies for research and social change. American Psychological Association; 2005. https://doi.org/10.1037/10887-000

  8. 8.

    Corrigan PW, editor. The stigma of disease and disability: Understanding causes and overcoming injustices. American Psychological Association; 2014. https://doi.org/10.1037/14297-000

  9. 9.

    Corrigan PW, Watson AC. Understanding the impact of stigma on people with mental illness. World Psychiatry. 2002;1(1):16.

    PubMed  PubMed Central  Google Scholar 

  10. 10.

    Corrigan PW, Morris SB, Michaels PJ, Rafacz JD, Rüsch N. Challenging the public stigma of mental illness: a meta-analysis of outcome studies. Psychiatric Services. 2012;63(10):963–73.

    Article  Google Scholar 

  11. 11.

    Griffiths KM, Carron-Arthur B, Parsons A, Reid R. Effectiveness of programs for reducing the stigma associated with mental disorders. A meta-analysis of randomized controlled trials. World Psychiatry. 2014;13(2):161–75.

    Article  Google Scholar 

  12. 12.

    Weiner B. Judgments of responsibility: a foundation for a theory of social conduct. New York: Guilford Press; 1995.

    Google Scholar 

  13. 13.

    Evans SC, Roberts MC, Keeley JW, Blossom JB, Amaro CM, Garcia AM, et al. Vignette methodologies for studying clinicians’ decision-making: validity, utility, and application in ICD-11 field studies. J Health Psychol. 2015;15(2):160–70.

    Google Scholar 

  14. 14.

    Pingani L, Forghieri M, Ferrari S, Ben-Zeev D, Artoni P, Mazzi F, et al. Stigma and discrimination toward mental illness: translation and validation of the Italian version of the attribution questionnaire-27 (AQ-27-I). Soc Psychiatry Psychiatr Epidemiol. 2012;47(6):993–9.

    Article  Google Scholar 

  15. 15.

    Muñoz M, Guillén AI, Pérez-Santos E, Corrigan PW. A structural equation modeling study of the Spanish Mental Illness Stigma Attribution Questionnaire (AQ-27-E). Am J Orthopsychiatry. 2015;85(3):243.

    Article  Google Scholar 

  16. 16.

    Mittal D, Corrigan P, Sherman MD, Chekuri L, Han X, Reaves C, et al. Healthcare providers’ attitudes toward persons with schizophrenia. Psychiatr Rehabil J. 2014;37(4):297.

    Article  Google Scholar 

  17. 17.

    Akyurek G, Efe A, Kayihan H. Stigma and discrimination towards mental illness: translation and validation of the Turkish version of the Attribution Questionnaire-27 (AQ-27-T). Community Ment Health J. 2019;55(8):1369–76.

    Article  Google Scholar 

  18. 18.

    Ferrari S, Bressi C, Busnelli E, Mattei G, Pozzoli S, Oliva A, Galeazzi GM, Pingani L. Stigma on Mental Health among High School Students: Validation of the Italian Version of the Attribution Questionnaire-27 (AQ-27-I) in a High School Student Population. International Journal of Environmental Research and Public Health. 2020;17(14):5207.

    Article  Google Scholar 

  19. 19.

    Pingani L, Catellani S, Del Vecchio V, Sampogna G, Ellefson SE, Rigatelli M, Fiorillo A, Evans-Lacko S, Corrigan PW. Stigma in the context of schools: analysis of the phenomenon of stigma in a population of university students. BMC Psychiatry. 2016;16(1):1–7.

    Article  Google Scholar 

  20. 20.

    Yang LH, Kleinman A, Link BG, Phelan JC, Lee S, Good B. Culture and stigma: adding moral experience to stigma theory. Soc Sci Med. 2007;64(7):1524–35.

    Article  Google Scholar 

  21. 21.

    Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25(24):3186–91.

    Article  Google Scholar 

  22. 22.

    Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12):1417–32.

    Article  Google Scholar 

  23. 23.

    Wagner AK, Gandek B, Aaronson NK, Acquadro C, Alonso J, Apolone G, et al. Cross-cultural comparisons of the content of SF-36 translations across 10 countries: results from the IQOLA project. J Clin Epidemiol. 1998;51(11):925–32.

    Article  Google Scholar 

  24. 24.

    Epstein J, Osborne RH, Elsworth GR, Beaton DE, Guillemin F. Cross-cultural adaptation of the Health Education Impact Questionnaire: experimental study showed expert committee, not back-translation, added value. J Clin Epidemiol. 2015;68(4):360–9.

    Article  Google Scholar 

  25. 25.

    Alaimo K, Olson CM, Frongillo EA. Importance of cognitive testing for survey items: an example from food security questionnaires. Journal of Nutrition Education. 1999;31(5):269–75.

    Article  Google Scholar 

  26. 26.

    Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Int J Med Educ. 2011;2:53.

    Article  Google Scholar 

  27. 27.

    Schreiber JB, Nora A, Stage FK, Barlow EA, King J. Reporting structural equation modeling and confirmatory factor analysis results: a review. J Educ Res. 2006;99(6):323–38.

    Article  Google Scholar 

  28. 28.

    Stigma and Discrimination [press release]. Ottawa: Mental Health Commission of Canada 2020.

  29. 29.

    UK Parliament (2015) Mental health stigma [press release].

  30. 30.

    Caminiti C, Diodati F, Filiberti S, Marcomini B, Annunziata MA, Ollari M, et al. Cross-cultural adaptation and patients’ judgments of a Question Prompt List for Italian-speaking cancer patients. BMC Health Serv Res. 2010;10(1):16.

    Article  Google Scholar 

  31. 31.

    Goncalves R, Cabri J, Pinheiro J, Ferreira P. Cross-cultural adaptation and validation of the Portuguese version of the Knee injury and Osteoarthritis Outcome Score (KOOS). Osteoarthritis Cartilage. 2009;17(9):1156–62.

    Article  Google Scholar 

  32. 32.

    Uysal-Bozkir Ö, Parlevliet JL, de Rooij SE. Insufficient cross-cultural adaptations and psychometric properties for many translated health assessment scales: a systematic review. J Clin Epidemiol. 2013;66(6):608–18.

    Article  Google Scholar 

  33. 33.

    Sullivan M, Karlsson J. The Swedish SF-36 Health Survey III. Evaluation of criterion-based validity: results from normative population. J Clin Epidemiol. 1998;51(11):1105–13.

    Article  Google Scholar 

  34. 34.

    Hankivsky O, Cormier R. Intersectionality and public policy: some lessons from existing models. Political Res Q. 2011;64(1):217–29.

    Article  Google Scholar 

  35. 35.

    Turan JM, Elafros MA, Logie CH, Banik S, Turan B, Crockett KB, Pescosolido B, Murray SM. Challenges and opportunities in examining and addressing intersectional stigma and health. BMC Medicine. 2019;17(1):7.

    Article  Google Scholar 

Download references

Acknowledgements

We would like to the members of the expert panel for their time and expertise.

Funding

Open Access funding provided by Karolinska. Institute Ashley McAllister is supported by a Swedish Research for Health, Working Life and Welfare Postdoctoral Fellowship [2017-01998]. The funders played no part in the authors' analyses or interpretation of data or decision to publish.

Author information

Affiliations

Authors

Contributions

AMc conceptualised the study, acquisition of data, conducted the analysis and interpretation of data. PC and BB contributed to the study design, analysis, background, and interpretation of results. AMc drafted the manuscript with feedback from all authors. All authors contributed to the final draft of the manuscript. AMc is the guarantor of the article. The corresponding author attests that all listed authors meet the authorship criteria and that no others meeting the criteria have been omitted. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Ashley McAllister.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the Stockholm Regional Ethics Board (Dnr 2018/683–31/5). Participants received a participation information statement before completing the survey that informed them that completion of the survey constituted implied consent.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1:

Table 1. Original Attribution Questionnaire. Table 2. Rotated factor loadings based on confirmatory factor analysis of the AQ. Table 3. Concordance between AQ scales and factor loadings.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

McAllister, A., Burström, B. & Corrigan, P. Cultural adaptation and validation of the Attribution Questionnaire for stigma towards disability pension applicants for use among psychiatrists and general practitioners in Sweden. BMC Psychol 9, 27 (2021). https://doi.org/10.1186/s40359-021-00523-8

Download citation

Keywords

  • Cross-cultural adaptation
  • Expert committee
  • Mental illness
  • Validation
  • Stigma
  • Structural equation modelling