Theory and intervention equivalence and bias: New constructs and adaptation of the systematic test of equivalence procedure

Abstract

The importance of cross-cultural validity, equivalence, and bias when engaged in cross-cultural and cultural activities (e.g., research, practice, training, supervision, consultation, teaching) are discussed. Two new forms of equivalence (Theory; Intervention) and bias (Theory; Intervention) also are introduced, as is an adaptation of the Systematic Test of Equivalence Procedure (STEP; Gerstein, L.H. 2018. Systematic test of equivalence procedure: New method to investigate cross-cultural validity. Revista de Cercetare si Interventie Sociala, 62, 278–293), which was originally created to enhance equivalence and reduce bias when conducting cross-cultural or cultural studies. Assuming future research supports the validity and relevance of the modified STEP approach, this strategy could offer researchers, clinicians, and others a tool to examine theory and intervention equivalence and bias in their professional activities. Recommendations for conducting projects to investigate the validity of employing STEP when examining the equivalence or bias of existing and future theories and intervention strategies are presented as well.

This is a preview of subscription content, access via your institution.

Data Availability

Data sharing not applicable to this article as no datasets were generated or analysed during the current study.

Notes

  1. 1.

    A Likert response format was assumed to be a relevant and valid approach to gather responses from the target experts and/or participants. When developing this step for a STEP study, the investigator must first establish the most appropriate response format to use.

References

  1. Allport, G. W. (1954). The nature of prejudice. Reading, MA: Addison-Wesley.

    Google Scholar 

  2. Atari, R., & Gerstein, L.H. (2019, April). The assessment of well-being among Arab communities. Poster presented at the 11th annual Muslim mental health conference. Tempe, AZ.

  3. Bellare, Y., & Gerstein, L.H. (2018, August). Everyday stranger harassment and coping among Asian Indian and U.S. college students. Poster presented at Annual Convention of the American Psychological Association, San Francisco, CA.

  4. Bowman, C. G. (1993). Street harassment and the informal ghettoization of women. Harvard Law Review, 106, 517–580. https://doi.org/10.2307/1341656.

    Article  Google Scholar 

  5. Bush, R. A. B., & Folger, P. (1994). The promise of mediation: Responding to conflict through empowerment and recognition. San Francisco: Jossey-Bass.

    Google Scholar 

  6. Bush, R. A. B., & Pope, S. G. (2002). Changing the quality of conflict interaction: The principles and practice of transformative mediation. Pepperdine Dispute Resolution Law Journal, 3(1), 67–96 https://scholarlycommons.law.hofstra.edu/faculty_scholarship/162.

    Google Scholar 

  7. Choi, S., & Choi, S. (2016). Conceptualizing Ryff’s psychological well-being model with Confucian perspective. Korean Journal of Sociology, 50, 101–123.

    Article  Google Scholar 

  8. Diallo, Y., & Hall, M. (1989). The healing drum: African wisdom teachings. Rochester: Destny Books.

  9. Dik, B. J., Eldridge, B. M., Steger, M. F., & Duffy, R. D. (2012). Development and validation of the calling and vocation questionnaire (CVQ) and brief calling scale (BCS). Journal of Career Assessment, 20, 242–263.

    Article  Google Scholar 

  10. Fairchild, K., & Rudman, L. A. (2008). Everyday stranger harassment and women’s objectification. Social Justice Research, 21, 338–357. https://doi.org/10.1007/s11211-008-0073-0.

    Article  Google Scholar 

  11. Fouad, N. A., & Kantamneni, N. (2010). Cultural validity of Holland’s theory. In J. G. Ponterotto, J. M. Casas, L. A. Suzuki, & C. M. Alexander (Eds.), Handbook of multicultural counseling (3rd ed., pp. 703–714). Thousand Oaks, CA: Sage Publications.

    Google Scholar 

  12. Gerstein, L. H. (2011). Research, practice and training across and within cultures: Simply complicated! Journal of Asia Pacific Counseling, 1(1), 1–12.

    Article  Google Scholar 

  13. Gerstein, L. H. (2018). Systematic test of equivalence procedure: New method to investigate cross-cultural validity. Revista de Cercetare si Interventie Sociala, 62, 278–293.

    Google Scholar 

  14. Gerstein, L. H., Chan, Y., Hutchison, A., Fung, A. L. C., Kinsey, R., & Jeffers, H. (2018). The teenage nonviolence test: Applicability in Hong Kong? Current Psychology, 37(1), 313–324. https://doi.org/10.1007/s12144-016-9514-3.

  15. Gerstein, L. H., Heppner, P. P., Ægisdóttir, S., Leung, S. A., & Norsworthy, K. L. (2009). International handbook of cross-cultural counseling: Cultural assumptions and practices worldwide. Thousand Oaks, CA: Sage Publications.

    Google Scholar 

  16. Gerstein, L. H., Mayton, D., Hutchison, A., & Kirkpatrick, D. (2014). The teenage nonviolence test: A factor analytic investigation. Revista de Cercetare si Interventie Sociala, 44, 9–19.

    Google Scholar 

  17. Gim Chung, R. H., Kim, B. S. K., & Abreu, J. M. (2004). Asian American multidimensional acculturation scale: Development, factor analysis, reliability, and validity. Cultural Diversity and Ethnic Minority Psychology, 10, 66–80. https://doi.org/10.1037/1099-9809.10.1.66.

    Article  Google Scholar 

  18. Hardin, E. E., Robitschek, C., Flores, L. Y., Navarro, R. L., & Ashton, M. W. (2014). The cultural lens approach to evaluating cultural validity of psychological theory. American Psychologist, 69, 656–668.

    Article  Google Scholar 

  19. Harper, C. (2006). Mediator as peacemaker: The case for activist transformative-narrative mediation. Journal of Dispute Resolution, 2, 595–611 https://scholarship.law.missouri.edu/jdr/vol2006/iss2/10.

    Google Scholar 

  20. Hays, P. A. (2009). Integrating evidence-based practice, cognitive–behavior therapy, and multicultural therapy: Ten steps for culturally competent practice. Professional Psychology: Research and Practice, 40, 354–360.

    Article  Google Scholar 

  21. Hays, D. G., & Erford, B. T. (2018). Developing multicultural counseling competence: A systems approach (3rd ed.). New York: Pearson.

    Google Scholar 

  22. He, J., & van de Vijver, F. (2012). Bias and equivalence in cross-cultural research. Online Readings in Psychology and Culture, Unit 2. Retrieved from http://scholarworks.gvsu.edu/orpc/vol2/iss2/8

  23. Hwang, K. K. (1987). Face and favor: The Chinese power game. American Journal of Sociology, 92, 944–974.

    Article  Google Scholar 

  24. International Test Commission. (2015). ITC guidelines for translating and adapting tests, version 1. Retrieved from https://www.intestcom.org/files/guideline_test_adaptation.pdf

  25. Joshanloo, M. (2014). Eastern conceptualizations of happiness: Fundamental differences with western views. Journal of Happiness Studies, 15, 475–493. https://doi.org/10.1007/s10902-013-9431-1.

  26. Kim, T.S., & Gerstein, L.H. (2011, August). Cross-cultural validity of career calling in Korea: Preliminary research. Poster presented at the annual meeting of the American Psychological Association. Washington, DC.

  27. Lau, W. Y., Chan, C. K., Li, J. C., & Au, T. K. (2010). Effectiveness of group cognitive-behavioral treatment for childhood anxiety in community clinics. Behaviour Research and Therapy, 48, 1067–1077. https://doi.org/10.1016/j.brat.2010.07.007.

    Article  PubMed  Google Scholar 

  28. Leong, T. L., & Brown, M. T. (1995). Theoretical issues in cross-cultural career development: Cultural validity and cultural specificity. In B. W. Walsh & S. H. Osipow (Eds.), Handbook of vocational psychology: Theory, research, and practice (2nd ed., pp. 143–180). Mahwah, NJ: Lawrence Erlbaum Associates, Inc..

    Google Scholar 

  29. Lonner, W. J. (1985). Issues in testing and assessment in cross-cultural counseling. The Counseling Psychologist, 13, 599–614.

    Article  Google Scholar 

  30. Malpass, R. S., & Poortinga, Y. H. (1986). Strategies for design and analysis. In W. J. Lonner & J. W. Berry (Eds.), Field methods in cross-cultural research (pp. 47–83). Beverly Hills, CA: Sage Publications.

    Google Scholar 

  31. Mayton, D. M., Weedman, J., Sonnen, J., Grubb, C., & Hirose, M. (1999, August). The teenage nonviolence test: Internal structure and reliability. Paper presented at the annual meeting of the American Psychological Association, Boston, MA.

  32. McKinley, N. M., & Hyde, J. S. (1996). The objectified body consciousness scale development and validation. Psychology of Women Quarterly, 20, 181–215. https://doi.org/10.1111/j.1471-6402.1996.tb00467.x.

  33. Naeem, F., Phiri, P., Munshi, T., Rathod, S., Ayub, M., Gobbi, M., & Kingdon, D. (2015). Using cognitive behaviour therapy with south Asian Muslims: Findings from the culturally sensitive CBT project. International Review of Psychiatry, 27, 233–246. https://doi.org/10.3109/09540261.2015.1067598.

    Article  PubMed  Google Scholar 

  34. Nathani, P., & Gerstein, L. H. (2016, March). Acculturation and help seeking: Asian Indians in the United States. Poster presented at the Great Lakes regional counseling psychology conference, Indiana University, Bloomington, Indiana.

  35. Norsworthy, K. L. (2017). Mindful activism: Embracing the complexities of international border crossings. American Psychologist, 72, 1035–1044.

  36. Nsamenang, A. B. (2001). Indigenous view on human development: A West African perspective. In N. J. Smelser & P. B. Baltes (Eds.-in-Chief) (Eds.), International encyclopedia of the social and behavioral sciences. London: Elsevier.

  37. Pettigrew, T. F. (1998). Intergroup contact theory. Annual Review of Psychology, 49, 65–85.

    Article  Google Scholar 

  38. Quintana, S. M., Troyano, N., & Taylor, G. (2001). Cultural validity and inherent challenges in quantitative methods for multicultural research. In J. G. Ponterotto, J. M. Casas, L. A. Suzuki, & C. M. Alexander (Eds.), Handbook of multicultural counseling (2nd ed., pp. 604–630). Thousand Oaks, CA: Sage Publications.

    Google Scholar 

  39. Ryff, C. D. (1989). Happiness is everything, or is it? Explorations on the meaning of psychological well-being. Journal of Personality and Social Psychology, 57, 1069–1081.

    Article  Google Scholar 

  40. Sedlmeier, P., & Srinivas, K. (2016). How do theories of cognition and consciousness in ancient Indian thought systems relate to current Western theorizing and research? Frontiers in Psychology, 7, 343. https://doi.org/10.3389/fpsyg.2016.00343.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Senn, C. Y., & Dzinas, K. (1996). Measuring fear of rape: A new scale. Canadian Journal of Behavioural Science, 28, 141–144. https://doi.org/10.1037/0008-400X.28.2.141.

    Article  Google Scholar 

  42. Splevins, K., Cohen, K., Bowley, J., & Joseph, S. (2010). Theories of posttraumatic growth: Cross- cultural perspectives. Journal of Loss and Trauma, 15, 259–277.

    Article  Google Scholar 

  43. Tanaka-Matsumi, J. (2004). Japanese forms of psychotherapy: Naikan therapy and morita therapy. In U. P. Gielen, J. M. Fish, M. Jefferson, & J. G. Draguns (Eds.), Handbook of culture, therapy, and healing (pp. 277–229). Mahwah, NJ: Lawrence Erlbaum Associates Publishers.

    Google Scholar 

  44. Tedeschi, R. G., & Calhoun, L. G. (2004). Posttraumatic growth: Conceptual foundations and empirical evidence. Psychological Inquiry, 15, 1–18.

    Article  Google Scholar 

  45. Tennen, H., & Affleck, G. (2009). Assessing positive life change: In search of meticulous methods. In C. Park, S. Lechner, A. L. Stanton, & M. H. Antoni (Eds.), Medical illness and positive life change: Can crisis lead to personal transformation? (pp. 31–49). Washington, DC: American Psychological Association.

    Google Scholar 

  46. Tinsley, H. E. A., St. Aubin, T. M., & Brown, M. T. (1982). College students’ help-seeking preferences. Journal of Counseling Psychology, 29, 523–533.

    Article  Google Scholar 

  47. Ungerleider, J. (1999). Music and poetry build bi-communal peace culture in Cyprus: ‘My country is cut in two.’ In people building peace: 35 inspiring stories from around the world (pp. 297–301). Utrecht: European Centre for Conflict Prevention.

  48. Vázquez, C., Pérez-Sales, P., & Ochoa, C. (2014). Posttraumatic growth: Challenges from a cross-cultural viewpoint. In G. A. Fava & C. Ruini (Eds.), Increasing psychological well-being in clinical and educational settings, cross-cultural advancements in positive psychology (Vol. 8, pp. 57–74). Dordrecht: Springer Science+Business Media. https://doi.org/10.1007/978-94-017-8669-0_4.

    Google Scholar 

  49. Veronese, G., Pepe, A., Dagdoukee, J., Addimando, L., & Yaghi, S. (2017). Measuring well- being in Israel and Palestine: The subjective well-being assessment scale. Psychological Reports, 120, 1160–1177.

    Article  Google Scholar 

  50. van de Vijver, F. J. R. (2001). The evolution of cross-cultural research methods. In D. Matsumoto (Ed.), Handbook of culture and psychology (pp. 77–97). New York: Oxford University Press.

    Google Scholar 

  51. van de Vijver, F. J. R., & He, J. (2016). Bias assessment and prevention in noncognitive outcome measures in context assessments. In S. Kuger, E. Klieme, N. Jude, & D. Kaplan (Eds.), Assessing contexts of learning world-wide extended context assessment framework and documentation of questionnaire material (pp. 229–253). New York: Springer.

    Google Scholar 

  52. Waitoki, W., Dudgeon, P., & Nikora, L. W. (2018). Indigenous psychology in Aotearoa/New Zealand and Australia. In S. Fernando & R. Moodley (Eds.), Global psychologies mental health and the global south (pp. 163–184). London: Palgrave Macmillan. https://doi.org/10.1057/978-1-349-95816-0_10.

    Google Scholar 

  53. Wang, L. (2014, July). The building and implementing of the WISER school counseling model in Taiwan. Invited speech at the international symposium in school guidance and counseling, Hijiyama University, Hiroshima, Japan.

  54. Wang, L.-F., Wei, M., Koay, E. Y. Y., Lo, M. H., & Lee, M.-Y. (2019). The development and validation of the emotional cultivation scale: An east Asian cultural perspective. Journal of Counseling Psychology, 66, 409–423. https://doi.org/10.1037/cou0000346.

    Article  PubMed  Google Scholar 

  55. Wong, D. F. (2008). Cognitive behavioral treatment groups for people with chronic depression in Hong Kong: A randomized wait-list control design. Depression and Anxiety, 25, 142–148.

    Article  Google Scholar 

  56. Ægisdóttir, S., & Gerstein, L. H. (2009). Beliefs about psychological services (BAPS): Development & psychometric properties. Counselling Psychology Quarterly, 22, 197–219.

  57. Ægisdóttir, S., Gerstein, L. H., & Cinarbas, D. (2008). Methodological issues in cross-cultural counseling research: Equivalence, bias and translations. The Counseling Psychologist, 36, 188–219.

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Lawrence H. Gerstein.

Ethics declarations

Conflict of Interest

I hereby state that there is no conflict of interest.

Ethical Approval and Informed Consent

As this article does not discuss a research study, and therefore, no participants were involved, it was not necessary to seek Ethical (IRB) Approval and Informed Consent to write this paper.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Gerstein, L.H. Theory and intervention equivalence and bias: New constructs and adaptation of the systematic test of equivalence procedure. Curr Psychol (2021). https://doi.org/10.1007/s12144-020-01256-4

Download citation

Keywords

  • Cross-cultural validity
  • Equivalence
  • Bias
  • Systematic test of equivalence procedure