Advertisement

Neuropsychology Review

, Volume 28, Issue 3, pp 269–284 | Cite as

RBANS Validity Indices: a Systematic Review and Meta-Analysis

  • Robert D. Shura
  • Timothy W. Brearly
  • Jared A. Rowland
  • Sarah L. Martindale
  • Holly M. Miskey
  • Kevin Duff
Review

Abstract

Neuropsychology practice organizations have highlighted the need for thorough evaluation of performance validity as part of the neuropsychological assessment process. Embedded validity indices are derived from existing measures and expand the scope of validity assessment. The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) is a brief instrument that quickly allows a clinician to assess a variety of cognitive domains. The RBANS also contains multiple embedded validity indicators. The purpose of this study was to synthesize the utility of those indicators to assess performance validity. A systematic search was completed, resulting in 11 studies for synthesis and 10 for meta-analysis. Data were synthesized on four indices and three subtests across samples of civilians, service members, and veterans. Sufficient data for meta-analysis were only available for the Effort Index, and related analyses indicated optimal cutoff scores of ≥1 (AUC = .86) and ≥ 3 (AUC = .85). However, outliers and heterogeneity were present indicating the importance of age and evaluation context. Overall, embedded validity indicators have shown adequate diagnostic accuracy across a variety of populations. Recommendations for interpreting these measures and future studies are provided.

Keywords

RBANS Embedded validity indicators Effort Systematic review Meta-analysis 

Notes

Compliance with Ethical Standards

Conflict of Interest

There are no conflicts of interest to disclose.

Financial Disclosure

This work was supported by resources of Salisbury Veterans Affairs Health Care System; the Mid-Atlantic Mental Illness Research Education and Clinical Center; and the Department of Veterans Affairs Office of Academic Affiliations Advanced Fellowship Program in Mental Illness Research and Treatment.

Disclaimer

The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs, the Department of Defense, or the U.S. Government.

References

  1. Armistead-Jehle, P., & Hansen, C. L. (2011). Comparison of the repeatable battery for the assessment of neuropsychological status effort index and stand-alone symptom validity tests in a military sample. Archives of Clinical Neuropsychology, 26(7), 592–601.  https://doi.org/10.1093/arclin/acr049.CrossRefPubMedGoogle Scholar
  2. Armistead-Jehle, P., Gervais, R. O., & Green, P. (2012). Memory complaints inventory and symptom validity test performance in a clinical sample. Archives of Clinical Neuropsychology, 27(7), 725–734.CrossRefPubMedGoogle Scholar
  3. Barker, M. D., Horner, M. D., & Bachman, D. L. (2010). Embedded indices of effort in the repeatable battery for the assessment of neuropsychological status (Rbans) in a geriatric sample. The Clinical Neuropsychologist, 24(6), 1064–1077.  https://doi.org/10.1080/13854046.2010.486009.CrossRefPubMedGoogle Scholar
  4. Bayan, S. M., Nitch, S., Kinney, D., & Kaminetskaya, M. (2018). Exploratory analysis of CVLT-II forced-choice recognition and RBANS EI base rates for forensically-committed, psychotic-disordered inpatients: Implications on clinical decision-making. Applied Neuropsychology: Adult, 25(1), 71-81.  https://doi.org/10.1080/23279095.2016.1247092.
  5. Beatty, W. W. (2004). RBANS analysis of verbal memory in multiple sclerosis. Archives of Clinical Neuropsychology, 19(6), 825–834.  https://doi.org/10.1016/j.acn.2003.12.001.CrossRefPubMedGoogle Scholar
  6. Benitez, A., Horner, M. D., & Bachman, D. (2011). Intact cognition in depressed elderly veterans providing adequate effort. Archives of Clinical Neuropsychology, 26(3), 184–193.CrossRefPubMedGoogle Scholar
  7. Boone, K. B. (2009). The need for continuous and comprehensive sampling of effort/response bias during neuropsychological examinations. The Clinical Neuropsychologist, 23(4), 729–741.  https://doi.org/10.1080/13854040802427803.CrossRefPubMedGoogle Scholar
  8. Boone, K. B. (2013). Clinical practice of forensic neuropsychology: An evidence-based approach. New York: Guilford.Google Scholar
  9. Bortnik, K. E., Horner, M. D., & Bachman, D. L. (2013). Performance on standard indexes of effort among patients with dementia. Applied Neuropsychology: Adult, 20(4), 233–242.  https://doi.org/10.1080/09084282.2012.695757.CrossRefGoogle Scholar
  10. Burton, R. L., Enright, J., O'connell, M. E., Lanting, S., & Morgan, D. (2014). RBANS embedded measures of suboptimal effort in dementia: Effort scale has a lower failure rate than the effort index. Archives of Clinical Neuropsychology, 30(1), 1–6.CrossRefPubMedGoogle Scholar
  11. Bush, S. S., Ruff, R. M., Troster, A. I., Barth, J. T., Koffler, S. P., Pliskin, N. H., et al. (2005). Symptom validity assessment: practice issues and medical necessity NAN policy & planning committee. Archives of Clinical Neuropsychology, 20(4), 419–426.  https://doi.org/10.1016/j.acn.2005.02.002.CrossRefPubMedGoogle Scholar
  12. Carter, K. R., Scott, J. G., Adams, R. L., & Linck, J. (2016). Base rate comparison of suboptimal scores on the RBANS effort scale and effort index in Parkinson’s disease. The Clinical Neuropsychologist, 30(7), 1118–1125.  https://doi.org/10.1080/13854046.2016.1206145.CrossRefPubMedGoogle Scholar
  13. Crawford, J. R., Garthwaite, P. H., Morrice, N., & Duff, K. (2012). Some supplementary methods for the analysis of the RBANS. Psychological Assessment, 24(2), 365–374.  https://doi.org/10.1037/a0025652.CrossRefPubMedGoogle Scholar
  14. Crighton, A. H., Wygant, D. B., Holt, K. R., & Granacher, R. P. (2015). Embedded effort scales in the repeatable battery for the assessment of neuropsychological status: Do they detect neurocognitive malingering? Archives of Clinical Neuropsychology, 30(3), 181–185.CrossRefPubMedGoogle Scholar
  15. Deeks, J. J., Macaskill, P., & Irwig, L. (2005). The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. Journal of Clinical Epidemiology, 58(9), 882–893.  https://doi.org/10.1016/j.jclinepi.2005.01.016.CrossRefPubMedGoogle Scholar
  16. Dickerson, F., Boronow, J. J., Stallings, C., Origoni, A. E., Cole, S. K., & Yolken, R. H. (2004). Cognitive functioning in schizophrenia and bipolar disorder: Comparison of performance on the repeatable battery for the assessment of neuropsychological status. Psychiatry Research, 129(1), 45–53.  https://doi.org/10.1016/j.psychres.2004.07.002.CrossRefPubMedGoogle Scholar
  17. van Driel, M. L., De Sutter, A., De Maeseneer, J., & Christiaens, T. (2009). Searching for unpublished trials in Cochrane reviews may not be worth the effort. Journal of Clinical Epidemiology, 62(8), 838–844.e833.  https://doi.org/10.1016/j.jclinepi.2008.09.010.CrossRefPubMedGoogle Scholar
  18. Duff, K., & Ramezani, A. (2015). Regression-based normative formulae for the repeatable battery for the assessment of neuropsychological status for older adults. Archives of Clinical Neuropsychology, 30(7), 600–604.  https://doi.org/10.1093/arclin/acv052.CrossRefPubMedGoogle Scholar
  19. Duff, K., Patton, D., Schoenberg, M. R., Mold, J., Scott, J. G., & Adams, R. L. (2003). Age- and education-corrected independent normative data for the RBANS in a community dwelling elderly sample. The Clinical Neuropsychologist, 17(3), 351–366.  https://doi.org/10.1076/clin.17.3.351.18082.CrossRefPubMedGoogle Scholar
  20. Duff, K., Schoenberg, M. R., Patton, D., Mold, J., Scott, J. G., & Adams, R. L. (2004). Predicting change with the RBANS in a community dwelling elderly sample. Journal of the International Neuropsychological Society, 10(6), 828–834.CrossRefPubMedGoogle Scholar
  21. Duff, K., Beglinger, L. J., Theriault, D., Allison, J., & Paulsen, J. S. (2010). Cognitive deficits in Huntington's disease on the repeatable battery for the assessment of neuropsychological status. Journal of Clinical and Experimental Neuropsychology, 32(3), 231–238.  https://doi.org/10.1080/13803390902926184.CrossRefPubMedGoogle Scholar
  22. Duff, K., Spering, C. C., O’Bryant, S. E., Beglinger, L. J., Moser, D. J., Bayless, J. D., et al. (2011). The RBANS effort index: Base rates in geriatric samples. Applied Neuropsychology, 18(1), 11–17.  https://doi.org/10.1080/09084282.2010.523354.CrossRefPubMedPubMedCentralGoogle Scholar
  23. Dunham, K. J., Shadi, S., Sofko, C. A., Denney, R. L., & Calloway, J. (2014). Comparison of the repeatable battery for the assessment of neuropsychological status effort scale and effort index in a dementia sample. Archives of Clinical Neuropsychology, 29(7), 633–641.  https://doi.org/10.1093/arclin/acu042.CrossRefPubMedPubMedCentralGoogle Scholar
  24. Fazio, R. L., Sanders, J. F., & Denney, R. L. (2015). Comparison of performance of the test of memory malingering and word memory test in a criminal forensic sample. Archives of Clinical Neuropsychology, 30(4), 293–301.  https://doi.org/10.1093/arclin/acv024.CrossRefPubMedGoogle Scholar
  25. Gogos, A., Joshua, N., & Rossell, S. L. (2010). Use of the repeatable battery for the assessment of neuropsychological status (RBANS) to investigate group and gender differences in schizophrenia and bipolar disorder. The Australian and New Zealand Journal of Psychiatry, 44(3), 220–229.  https://doi.org/10.3109/00048670903446882.CrossRefPubMedGoogle Scholar
  26. Gold, J. M., Queern, C., Iannone, V. N., & Buchanan, R. W. (1999). Repeatable battery for the assessment of neuropsychological status as a screening test in schizophrenia I: Sensitivity, reliability, and validity. The American Journal of Psychiatry, 156(12), 1944–1950.  https://doi.org/10.1176/ajp.156.12.1944.PubMedGoogle Scholar
  27. Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., & Millis, S. R. (2009). American Academy of clinical neuropsychology consensus conference statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23(7), 1093–1129.  https://doi.org/10.1080/13854040903155063.CrossRefPubMedGoogle Scholar
  28. Hook, J. N., Marquine, M. J., & Hoelzle, J. B. (2009). Repeatable battery for the assessment of neuropsychological status effort index performance in a medically ill geriatric sample. Archives of Clinical Neuropsychology, 24(3), 231–235.CrossRefPubMedGoogle Scholar
  29. Jones, A. (2016). Repeatable battery for the assessment of neuropsychological status: Effort index cutoff scores for psychometrically defined malingering groups in a military sample. Archives of Clinical Neuropsychology, 31(3), 273–283.  https://doi.org/10.1093/arclin/acw006.CrossRefPubMedGoogle Scholar
  30. Lippa, S. M., Hawes, S., Jokic, E., & Caroselli, J. S. (2013). Sensitivity of the RBANS to acute traumatic brain injury and length of post-traumatic amnesia. Brain Injury, 27(6), 689–695.  https://doi.org/10.3109/02699052.2013.771793.CrossRefPubMedGoogle Scholar
  31. Lippa, S. M., Agbayani, K. A., Hawes, S., Jokic, E., & Caroselli, J. S. (2014). Effort in acute traumatic brain injury: Considering more than pass/fail. Rehabilitation Psychology, 59(3), 306–312.CrossRefPubMedPubMedCentralGoogle Scholar
  32. Lippa, S. M., Lange, R. T., Bhagwat, A., & French, L. M. (2017). Clinical utility of embedded performance validity tests on the repeatable battery for the assessment of neuropsychological status (RBANS) following mild traumatic brain injury. Appl Neuropsychol Adult, 24(1), 73–80.  https://doi.org/10.1080/23279095.2015.1100617.CrossRefPubMedGoogle Scholar
  33. Macaskill, P., Gatsonis, C., Deeks, J., Harbord, R., & Takwoingi, Y. (2010). Analysing and Presenting Results. In J. Deeks, P. Bossuyt & C. Gatsonis (Eds.), Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy Version 1.0 (pp. 1–61). The Cochrane Collaboration. Retrieved from http://methods.cochrane.org/ 
  34. McKay, C., Casey, J. E., Wertheimer, J., & Fichtenberg, N. L. (2007). Reliability and validity of the RBANS in a traumatic brain injured sample. Archives of Clinical Neuropsychology, 22(1), 91–98.  https://doi.org/10.1016/j.acn.2006.11.003.CrossRefPubMedGoogle Scholar
  35. McKay, C., Wertheimer, J. C., Fichtenberg, N. L., & Casey, J. E. (2008). The repeatable battery for the assessment of neuropsychological status (RBANS): Clinical utility in a traumatic brain injury sample. The Clinical Neuropsychologist, 22(2), 228–241.  https://doi.org/10.1080/13854040701260370.CrossRefPubMedGoogle Scholar
  36. Moore, R. C., Davine, T., Harmell, A. L., Cardenas, V., Palmer, B. W., & Mausbach, B. T. (2013). Using the repeatable battery for the assessment of neuropsychological status (RBANS) effort index to predict treatment group attendance in patients with schizophrenia. Journal of the International Neuropsychological Society, 19(2), 198–205.CrossRefPubMedGoogle Scholar
  37. Morra, L. F., Gold, J. M., Ossenfort, K., & Strauss, G. (2014). C-78 predicting insufficient effort in schizophrenia using the repeated battery for the assessment of neuropsychological status effort index. Archives of Clinical Neuropsychology, 29(6), 602–603.CrossRefGoogle Scholar
  38. Morra, L. F., Gold, J. M., Sullivan, S. K., & Strauss, G. P. (2015). Predictors of neuropsychological effort test performance in schizophrenia. Schizophrenia Research, 162(1), 205–210.CrossRefPubMedPubMedCentralGoogle Scholar
  39. Novitski, J., Steele, S., Karantzoulis, S., & Randolph, C. (2012). The repeatable battery for the assessment of neuropsychological status effort scale. Archives of Clinical Neuropsychology, 27(2), 190–195.  https://doi.org/10.1093/arclin/acr119.CrossRefPubMedGoogle Scholar
  40. O'mahar, K. M., Duff, K., Scott, J. G., Linck, J. F., Adams, R. L., & Mold, J. W. (2011). Brief report: The temporal stability of the repeatable battery for the assessment of neuropsychological status effort index in geriatric samples. Archives of Clinical Neuropsychology, 27(1), 114–118.CrossRefPubMedPubMedCentralGoogle Scholar
  41. Patton, D. E., Duff, K., Schoenberg, M. R., Mold, J., Scott, J. G., & Adams, R. L. (2003). Performance of cognitively normal African Americans on the RBANS in community dwelling older adults. The Clinical Neuropsychologist, 17(4), 515–530.  https://doi.org/10.1076/clin.17.4.515.27948.CrossRefPubMedGoogle Scholar
  42. Paulson, D., Horner, M. D., & Bachman, D. (2015). A comparison of four embedded validity indices for the RBANS in a memory disorders clinic. Archives of Clinical Neuropsychology, 30(3), 207–216.  https://doi.org/10.1093/arclin/acv009.CrossRefPubMedGoogle Scholar
  43. Peck, C., Masse, A., & Schroeder, R. (2014). C-86 the utility of the RBANS effort index in an inpatient psychiatric setting. Archives of Clinical Neuropsychology, 29(6), 605.CrossRefGoogle Scholar
  44. Rabin, L. A., Barr, W. B., & Burton, L. A. (2005). Assessment practices of clinical neuropsychologists in the United States and Canada: A survey of INS, NAN, and APA division 40 members. Archives of Clinical Neuropsychology, 20(1), 33–65.  https://doi.org/10.1016/j.acn.2004.02.005.CrossRefPubMedGoogle Scholar
  45. Randolph, C., Tierney, M. C., Mohr, E., & Chase, T. N. (1998). The repeatable battery for the assessment of neuropsychological status (RBANS): Preliminary clinical validity. Journal of Clinical and Experimental Neuropsychology, 20(3), 310–319.  https://doi.org/10.1076/jcen.20.3.310.823.CrossRefPubMedGoogle Scholar
  46. Review Manager (RevMan) [Computer program]. (2014). Version 5.3. Copenhagen: The Nordic Centre, The Cochrane Collaboration. Google Scholar
  47. Schoenberg, M. R., Rinehardt, E., Duff, K., Mattingly, M., Bharucha, K. J., & Scott, J. G. (2012). Assessing reliable change using the repeatable battery for the assessment of neuropsychological status (RBANS) for patients with Parkinson's disease undergoing deep brain stimulation (DBS) surgery. The Clinical Neuropsychologist, 26(2), 255–270.  https://doi.org/10.1080/13854046.2011.653587.CrossRefPubMedGoogle Scholar
  48. Schroeder, R. W., Twumasi-Ankrah, P., Baade, L. E., & Marshall, P. S. (2012). Reliable digit span: A systematic review and cross-validation study. Assessment, 19(1), 21–30.  https://doi.org/10.1177/1073191111428764.CrossRefPubMedGoogle Scholar
  49. Sieck, B. C., Smith, M. M., Duff, K., Paulsen, J. S., & Beglinger, L. J. (2012). Symptom validity test performance in the Huntington disease clinic. Archives of Clinical Neuropsychology, 28(2), 135–143.CrossRefPubMedGoogle Scholar
  50. Silverberg, N. D., Wertheimer, J. C., & Fichtenberg, N. L. (2007). An effort index for the repeatable battery for the assessment of neuropsychological status (RBANS). The Clinical Neuropsychologist, 21(5), 841–854.  https://doi.org/10.1080/13854040600850958.CrossRefPubMedGoogle Scholar
  51. Slick, D. J., Sherman, E. M., & Iverson, G. L. (1999). Diagnostic criteria for malingered neurocognitive dysfunction: Proposed standards for clinical practice and research. The Clinical Neuropsychologist, 13(4), 545–561.  https://doi.org/10.1076/1385-4046(199911)13:04;1-y;ft545.CrossRefPubMedGoogle Scholar
  52. Sollman, M. J., & Berry, D. T. (2011). Detection of inadequate effort on neuropsychological testing: A meta-analytic update and extension. Archives of Clinical Neuropsychology, 26(8), 774–789.  https://doi.org/10.1093/arclin/acr066.CrossRefPubMedGoogle Scholar
  53. Umaki, T. M., & Denney, R. L. (2013). Neurocognitive deficits associated with the hepatitis C virus among incarcerated men. The Clinical Neuropsychologist, 27(3), 426–436.  https://doi.org/10.1080/13854046.2012.758315.CrossRefPubMedGoogle Scholar
  54. Vickers, A. J., & Smith, C. (2000). Incorporating data from dissertations in systematic reviews. International Journal of Technology Assessment in Health Care, 16(2), 711–713.CrossRefPubMedGoogle Scholar
  55. Wilk, C. M., Gold, J. M., Humber, K., Dickerson, F., Fenton, W. S., & Buchanan, R. W. (2004). Brief cognitive assessment in schizophrenia: Normative data for the repeatable battery for the assessment of neuropsychological status. Schizophrenia Research, 70(2–3), 175–186.  https://doi.org/10.1016/j.schres.2003.10.009.CrossRefPubMedGoogle Scholar
  56. Young, J. C., Baughman, B. C., & Roper, B. L. (2012). Validation of the repeatable battery for the assessment of neuropsychological status--effort index in a veteran sample. The Clinical Neuropsychologist, 26(4), 688–699.  https://doi.org/10.1080/13854046.2012.679624.CrossRefPubMedGoogle Scholar
  57. Zimmer, A., Heyanka, D., & Proctor-Weber, Z. (2017). Concordance validity of PVTs in a sample of veterans referred for mild TBI. Applied Neuropsychology: Adult, 1–10.Google Scholar

Copyright information

© This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply 2018

Authors and Affiliations

  1. 1.VA Mid-Atlantic Mental Illness Research, Education, and Clinical Center (MIRECC)Salisbury Veterans Affairs Health Care System (SVAHCS)SalisburyUSA
  2. 2.Mental Health & Behavioral Sciences Service LineSVAHCSSalisburyUSA
  3. 3.Department of Psychiatry and Behavioral SciencesWake Forest School of MedicineWinston-SalemUSA
  4. 4.Neuropsychology AssessmentWalter Reed National Military Medical CenterBethesdaUSA
  5. 5.Research & Academic Affairs Service LineSVAHCSSalisburyUSA
  6. 6.Department of Neurobiology and AnatomyWake Forest School of MedicineWinston-SalemUSA
  7. 7.Center for Alzheimer’s Care, Imaging, & Research, Department of NeurologyUniversity of UtahSalt Lake CityUSA

Personalised recommendations