Advertisement

Comparing, Combining and Converting Screening Instruments

  • A. J. Larner
Chapter

Abstract

This chapter examines various methods of comparing, combining and converting various screening instruments. Methods of comparing cognitive scales include not only the standard measures of discrimination considered in previous chapters but also weighted comparison and effect size, as well as meta-analysis. The diagnostic utility of combinations of scales, both cognitive and non-cognitive, is also considered, as well as ways to make approximate conversions between the scores of different screening tests.

Keywords

Dementia Diagnosis Combinations Cohen’s d Effect size Equivalent increase Limits of agreement Linear regression equation Meta-analysis Weighted comparison 

References

  1. Abdel-Aziz K, Larner AJ. Six-item Cognitive Impairment Test (6CIT): pragmatic diagnostic accuracy study for dementia and MCI. Int Psychogeriatr. 2015;27:991–7.CrossRefPubMedGoogle Scholar
  2. Abreu ID, Nunes PV, Diniz BS, Forlenza OV. Combining functional scales and cognitive tests in screening for mild cognitive impairment at a university-based memory clinic in Brazil. Rev Bras Psiquiatr. 2008;30:346–9.CrossRefPubMedGoogle Scholar
  3. Alexopoulos P, Ebert A, Richter-Schmidinger T, et al. Validation of the German revised Addenbrooke’s cognitive examination for detecting mild cognitive impairment, mild dementia in Alzheimer’s disease and frontotemporal lobar degeneration. Dement Geriatr Cogn Disord. 2010;29:448–56.CrossRefPubMedGoogle Scholar
  4. Ashford JW. Screening for memory disorders, dementia and Alzheimer’s disease. Aging Health. 2008;4:399–432.CrossRefGoogle Scholar
  5. Barberger-Gateau P, Commenges D, Gagnon M, Letenneur L, Sauvel C, Dartigues JF. Instrumental activities of daily living as a screening tool for cognitive impairment and dementia in elderly community dwellers. J Am Geriatr Soc. 1992;40:1129–34.CrossRefPubMedGoogle Scholar
  6. Bier JC, Ventura M, Donckels V, et al. Is the Addenbrooke’s Cognitive Examination effective to detect frontotemporal dementia? J Neurol. 2004;251:428–31.CrossRefPubMedGoogle Scholar
  7. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307–10.CrossRefPubMedGoogle Scholar
  8. Cacho J, Benito-Leon J, Garcia-Garcia R, Fernandez-Calvo B, Vincente-Villardon JL, Mitchell AJ. Does the combination of the MMSE and Clock Drawing Test (Mini-clock) improve the detection of mild Alzheimer’s disease and mild cognitive impairment? J Alzheimers Dis. 2010;22:889–96.CrossRefPubMedGoogle Scholar
  9. Chang YL, Bondi MW, McEvoy LK, et al. Global clinical dementia rating of 0.5 in MCI masks variability related to level of function. Neurology. 2011;76:652–9.CrossRefPubMedPubMedCentralGoogle Scholar
  10. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20:37–46.CrossRefGoogle Scholar
  11. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum; 1988.Google Scholar
  12. Cohen J. A power primer. Psychol Bull. 1992;112:155–9.CrossRefPubMedGoogle Scholar
  13. Connon P, Larner AJ. Combining informant (AD8) and patient (MACE) cognitive screening. Poster P0030, Association of British Neurologists Annual Meeting, Liverpool, 3–5 May, 2017.Google Scholar
  14. Cordell CB, Borson S, Boustani M, et al. Medicare Detection of Cognitive Impairment Workgroup. Alzheimer’s Association recommendations for operationalizing the detection of cognitive impairment during the Medicare Annual Wellness Visit in a primary care setting. Alzheimers Dement. 2013;9:141–50.Google Scholar
  15. Damian AM, Jacobson SA, Hentz JG, et al. The Montreal Cognitive Assessment and the Mini-Mental State Examination as screening instruments for cognitive impairment: item analyses and threshold scores. Dement Geriatr Cogn Disord. 2011;31:126–31.CrossRefPubMedGoogle Scholar
  16. De Lepeleire J, Aertgeerts B, Umbach I, et al. The diagnostic value of IADL evaluation in the detection of dementia in general practice. Aging Ment Health. 2004;8:52–7.CrossRefPubMedGoogle Scholar
  17. De Lepeleire J, Heyrman J, Baro F, Buntinx F. A combination of tests for the diagnosis of dementia had a significant diagnostic value. J Clin Epidemiol. 2005;58:217–25.CrossRefPubMedGoogle Scholar
  18. Doraiswamy PM, Bieber F, Kaiser L, Krishnan KR, Reuning-Scherer J, Gulanski B. The Alzheimer’s Disease Assessment Scale: patterns and predictors of baseline cognitive performance in multicenter Alzheimer’s disease trials. Neurology. 1997;48:1511–7.CrossRefPubMedGoogle Scholar
  19. Dos Santos Kawata KH, Hashimoto R, Nishio Y, et al. A validation study of the Japanese version of the Addenbrooke’s Cognitive Examination-Revised. Dement Geriatr Cogn Dis Extra. 2012;2:29–37.CrossRefPubMedPubMedCentralGoogle Scholar
  20. Ferman TJ, Smith GE, Boeve BF, et al. DLB fluctuations: specific features that reliably differentiate DLB from AD and normal aging. Neurology. 2004;62:181–7.CrossRefPubMedGoogle Scholar
  21. Flicker L, Logiudice D, Carlin JB, Ames D. The predictive value of dementia screening instruments in clinical populations. Int J Geriatr Psychiatry. 1997;12:203–9.CrossRefPubMedGoogle Scholar
  22. Folstein MF, Folstein SE, McHugh PR. “Mini-Mental State.” A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12:189–98.Google Scholar
  23. Galvin JE, Roe CM, Powlishta KK, et al. The AD8. A brief informant interview to detect dementia. Neurology. 2005;65:559–64.CrossRefPubMedPubMedCentralGoogle Scholar
  24. Galvin JE, Roe CM, Xiong C, Morris JE. Validity and reliability of the AD8 informant interview in dementia. Neurology. 2006;67:1942–8.CrossRefPubMedGoogle Scholar
  25. Garcia-Caballero A, Garcia-Lado I, Gonzalez-Hermida J, et al. Validation of the Spanish version of the Addenbrooke’s Cognitive Examination in a rural community in Spain. Int J Geriatr Psychiatry. 2006;21:239–45.CrossRefPubMedGoogle Scholar
  26. Hancock P, Larner AJ. The diagnosis of dementia: diagnostic accuracy of an instrument measuring activities of daily living in a clinic-based population. Dement Geriatr Cogn Disord. 2007;23:133–9.CrossRefPubMedPubMedCentralGoogle Scholar
  27. Hancock P, Larner AJ. Diagnostic utility of the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE) and its combination with the Addenbrooke’s Cognitive Examination-Revised (ACE-R) in a memory clinic-based population. Int Psychogeriatr. 2009;21:526–30.CrossRefPubMedPubMedCentralGoogle Scholar
  28. Hancock P, Larner AJ. Test Your Memory (TYM) test: diagnostic utility in a memory clinic population. Int J Geriatr Psychiatry. 2011;26:976–80.CrossRefPubMedPubMedCentralGoogle Scholar
  29. Hancock P, Larner AJ. Cornell Scale for Depression in Dementia: clinical utility in a memory clinic. Int J Psychiatry Clin Pract. 2015;19:71–4.CrossRefPubMedGoogle Scholar
  30. Harbord RM, Egger M, Sterne JA. A modified test for small-study effects in meta-analyses of controlled trials with binary endpoints. Stat Med. 2006;25:3443–57.CrossRefPubMedGoogle Scholar
  31. Hsieh S, Schubert S, Hoon C, Mioshi E, Hodges JR. Validation of the Addenbrooke’s Cognitive Examination III in frontotemporal dementia and Alzheimer’s disease. Dement Geriatr Cogn Disord. 2013;36:242–50.CrossRefPubMedGoogle Scholar
  32. Juva K, Sulkava R, Erkinjuntti T, Ylikoski R, Valvanee J, Tilvis R. Staging the severity of dementia: comparison of clinical (CDR, DSM-III-R), functional (ADL, IADL) and cognitive (MMSE) scales. Acta Neurol Scand. 1994;90:293–8.CrossRefPubMedGoogle Scholar
  33. Kalbe E, Kessler J, Calabrese P, et al. DemTect: a new, sensitive cognitive screening test to support the diagnosis of mild cognitive impairment and early dementia. Int J Geriatr Psychiatry. 2004;19:136–43.CrossRefPubMedPubMedCentralGoogle Scholar
  34. Larner AJ. An audit of the Addenbrooke’s Cognitive Examination (ACE) in clinical practice. Int J Geriatr Psychiatry. 2005;20:593–4.CrossRefPubMedGoogle Scholar
  35. Larner AJ. Addenbrooke’s Cognitive Examination (ACE) for the diagnosis and differential diagnosis of dementia. Clin Neurol Neurosurg. 2007a;109:491–4.CrossRefPubMedGoogle Scholar
  36. Larner AJ. DemTect: 1-year experience of a neuropsychological screening test for dementia. Age Ageing. 2007b;36:326–7.CrossRefPubMedPubMedCentralGoogle Scholar
  37. Larner AJ. New tests are needed. BMA News. 2007c;19 May:10.Google Scholar
  38. Larner AJ. ACE-R: cross-sectional and longitudinal use for cognitive assessment. In: Fisher A, Hanin I, editors. New trends in Alzheimer and Parkinson related disorders: ADPD 2009. Collection of selected free papers from the 9th International Conference on Alzheimer’s and Parkinson’s disease AD/PD. Prague, Czech Republic, March 11–15, 2009. Bologna: Medimond International Proceedings; 2009. p. 103–7.Google Scholar
  39. Larner AJ. Dementia in clinical practice: a neurological perspective. Studies in the dementia clinic. London: Springer; 2012a.CrossRefGoogle Scholar
  40. Larner AJ. Screening utility of the Montreal Cognitive Assessment (MoCA): in place of—or as well as—the MMSE? Int Psychogeriatr. 2012b;24:391–6.CrossRefPubMedPubMedCentralGoogle Scholar
  41. Larner AJ. Mini-Mental Parkinson (MMP) as a dementia screening test: comparison with the Mini-Mental State Examination (MMSE). Curr Aging Sci. 2012c;5:136–9.Google Scholar
  42. Larner AJ. Can the informant Fluctuation Composite Score help in the diagnosis of synucleinopathies? A pragmatic study. Int J Geriatr Psychiatry. 2012d;27:1094–5.CrossRefPubMedGoogle Scholar
  43. Larner AJ. Addenbrooke’s Cognitive Examination-Revised (ACE-R): pragmatic study of cross-sectional use for assessment of cognitive complaints of unknown aetiology. Int J Geriatr Psychiatry. 2013a;28:547–8.CrossRefPubMedGoogle Scholar
  44. Larner AJ. Comparing diagnostic accuracy of cognitive screening instruments: a weighted comparison approach. Dement Geriatr Cogn Disord Extra. 2013b;3:60–5.CrossRefGoogle Scholar
  45. Larner AJ. Dementia in clinical practice: a neurological perspective. Pragmatic studies in the cognitive function clinic. London: Springer; 2014a.CrossRefGoogle Scholar
  46. Larner AJ. Effect size (Cohen’s d) of cognitive screening instruments examined in pragmatic diagnostic accuracy studies. Dement Geriatr Cogn Dis Extra. 2014b;4:236–41.CrossRefPubMedPubMedCentralGoogle Scholar
  47. Larner AJ. Mini-Addenbrooke’s Cognitive Examination: a pragmatic diagnostic accuracy study. Int J Geriatr Psychiatry. 2015a;30:547–8.CrossRefPubMedGoogle Scholar
  48. Larner AJ. Mini-Addenbrooke’s Cognitive Examination diagnostic accuracy for dementia: reproducibility study. Int J Geriatr Psychiatry. 2015b;30:1103–4.CrossRefPubMedGoogle Scholar
  49. Larner AJ. AD8 informant questionnaire for cognitive impairment: pragmatic diagnostic test accuracy study. J Geriatr Psychiatry Neurol. 2015c;28:198–202.CrossRefPubMedPubMedCentralGoogle Scholar
  50. Larner AJ. Diagnostic test accuracy studies in dementia. A pragmatic approach. London: Springer; 2015d.Google Scholar
  51. Larner AJ. Optimizing the cutoffs of cognitive screening instruments in pragmatic diagnostic accuracy studies: maximising accuracy or Youden index? Dement Geriatr Cogn Disord. 2015e;39:167–75.CrossRefPubMedPubMedCentralGoogle Scholar
  52. Larner AJ. The Q* index: a useful global measure of dementia screening test accuracy? Dement Geriatr Cogn Dis Extra. 2015f;5:265–70.CrossRefPubMedPubMedCentralGoogle Scholar
  53. Larner AJ. Speed versus accuracy in cognitive assessment when using CSIs. Prog Neurol Psychiatry. 2015g;19(1):21–4.CrossRefGoogle Scholar
  54. Larner AJ. Performance-based cognitive screening instruments: an extended analysis of the time versus accuracy trade-off. Diagnostics (Basel). 2015h;5:504–12.CrossRefGoogle Scholar
  55. Larner AJ. M-ACE vs. MoCA: a weighted comparison. Int J Geriatr Psychiatry. 2016a;31:1089–90.CrossRefPubMedPubMedCentralGoogle Scholar
  56. Larner AJ. Cognitive screening instruments for the diagnosis of mild cognitive impairment. Prog Neurol Psychiatry. 2016b;20(2):21–6.CrossRefGoogle Scholar
  57. Larner AJ. Correlation or limits of agreement? Applying the Bland-Altman approach to the comparison of cognitive screening instruments. Dement Geriatr Cogn Disord. 2016c;42:247–54.CrossRefPubMedPubMedCentralGoogle Scholar
  58. Larner AJ. MACE versus MoCA: equivalence or superiority? Pragmatic diagnostic test accuracy study. Int Psychogeriatr. 2017a;29:931–7.CrossRefPubMedPubMedCentralGoogle Scholar
  59. Larner AJ. Short Montreal Cognitive Assessment: validation and reproducibility. J Geriatr Psychiatry Neurol. 2017b;30:104–8.CrossRefPubMedGoogle Scholar
  60. Larner AJ. Does combining an informant questionnaire with patient performance scales improve diagnostic test accuracy for cognitive impairment? Int J Geriatr Psychiatry. 2017c;32:466–7.CrossRefPubMedGoogle Scholar
  61. Larner AJ. Converting cognitive screening instrument test scores to MMSE scores: regression equations. Int J Geriatr Psychiatry. 2017d;32:351–2.CrossRefPubMedGoogle Scholar
  62. Larner AJ, Hancock P. Does combining cognitive and functional scales facilitate the diagnosis of dementia? Int J Geriatr Psychiatry. 2012;27:547–8.CrossRefPubMedPubMedCentralGoogle Scholar
  63. Larner AJ, Hancock P. ACE-R or MMSE? A weighted comparison. Int J Geriatr Psychiatry. 2014;29:767–8.CrossRefPubMedPubMedCentralGoogle Scholar
  64. Larner AJ, Mitchell AJ. A meta-analysis of the accuracy of the Addenbrooke’s Cognitive Examination (ACE) and the Addenbrooke’s Cognitive Examination-Revised (ACE-R) in the detection of dementia. Int Psychogeriatr. 2014;26:555–63.CrossRefPubMedPubMedCentralGoogle Scholar
  65. Lawton MP, Brody EM. Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist. 1969;9:179–86.CrossRefPubMedGoogle Scholar
  66. Lees RA, Hendry BK, Broomfield N, Stott D, Larner AJ, Quinn TJ. Cognitive assessment in stroke: feasibility and test properties using differing approaches to scoring of incomplete items. Int J Geriatr Psychiatry. 2017;32:1072–8.CrossRefPubMedGoogle Scholar
  67. Mackinnon A, Mulligan R. Combining cognitive testing and informant report to increase accuracy in screening for dementia. Am J Psychiatry. 1998;155:1529–35.CrossRefPubMedGoogle Scholar
  68. Mackinnon A, Khalilian A, Jorm AF, Korten AE, Christensen H, Mulligan R. Improving screening accuracy for dementia in a community sample by augmenting cognitive testing with informant report. J Clin Epidemiol. 2003;56:358–66.CrossRefPubMedGoogle Scholar
  69. Mallett S, Halligan S, Thompson M, Collins GS, Altman DG. Interpreting diagnostic accuracy studies for patient care. BMJ. 2012;344:e3999.CrossRefGoogle Scholar
  70. Malloy PF, Cummings JL, Coffey CE, et al. Cognitive screening instruments in neuropsychiatry: a report of the Committee on Research of the American Neuropsychiatric Association. J Neuropsychiatry Clin Neurosci. 1997;9:189–97.CrossRefPubMedPubMedCentralGoogle Scholar
  71. Mathuranath PS, Nestor PJ, Berrios GE, Rakowicz W, Hodges JR. A brief cognitive test battery to differentiate Alzheimer’s disease and frontotemporal dementia. Neurology. 2000;55:1613–20.CrossRefPubMedPubMedCentralGoogle Scholar
  72. Mioshi E, Dawson K, Mitchell J, Arnold R, Hodges JR. The Addenbrooke’s Cognitive Examination Revised: a brief cognitive test battery for dementia screening. Int J Geriatr Psychiatry. 2006;21:1078–85.Google Scholar
  73. Mitchell AJ. A meta-analysis of the accuracy of the mini-mental state examination in the detection of dementia and mild cognitive impairment. J Psychiatr Res. 2009;43:411–31.CrossRefPubMedGoogle Scholar
  74. Mitchell AJ. The Mini-Mental State Examination (MMSE): an update on its diagnostic validity for cognitive disorders. In: Larner AJ, editor. Cognitive screening instruments. A practical approach. London: Springer; 2013. p. 15–46.Google Scholar
  75. Mitchell AJ. The Mini-Mental State Examination (MMSE): update on its diagnostic accuracy and clinical utility for cognitive disorders. In: Larner AJ, editor. Cognitive screening instruments. A practical approach. 2nd ed. London: Springer; 2017. p. 37–48.Google Scholar
  76. Moons KGM, Stijnen T, Michel BC, Büller HR, Van Es GA, Grobbee DE, Habbema DF. Application of treatment thresholds to diagnostic-test evaluation: an alternative to the comparison of areas under receiver operating characteristic curves. Med Decis Making. 1997;17:447–54.CrossRefPubMedGoogle Scholar
  77. Narasimhalu K, Lee J, Auchus AP, Chen CP. Improving detection of dementia in Asian patients with low education: combining the Mini-Mental State Examination and the Informant Questionnaire on Cognitive Decline in the Elderly. Dement Geriatr Cogn Disord. 2008;25:17–22.CrossRefPubMedGoogle Scholar
  78. Nasreddine ZS, Phillips NA, Bédirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53:695–9.CrossRefPubMedPubMedCentralGoogle Scholar
  79. Newman JC, Feldman R. Copyright and open access at the bedside. N Engl J Med. 2011;365:2447–9.CrossRefPubMedGoogle Scholar
  80. Roalf DR, Moberg PJ, Xie SX, Wolk DA, Moelter ST, Arnold SE. Comparative accuracies of two common screening instruments for the classification of Alzheimer’s disease, mild cognitive impairment and healthy aging. Alzheimers Dement. 2013;9:529–37.CrossRefPubMedGoogle Scholar
  81. Shua-Haim J, Koppuzha G, Shua-Haim V, Gross J. A simple score system for clock drawing in patients with Alzheimer’s disease. Am J Alzheimers Dis Other Demen. 1997;12:212–5.CrossRefGoogle Scholar
  82. Stokholm J, Vogel A, Johannsen P, Waldemar G. Validation of the Danish Addenbrooke’s Cognitive Examination as a screening test in a memory clinic. Dement Geriatr Cogn Disord. 2009;27:361–5.CrossRefPubMedGoogle Scholar
  83. van Steenoven I, Aarsland D, Hurtig H, et al. Conversion between mini-mental state examination, Montreal Cognitive Assessment, and Dementia Rating Scale-2 scores in Parkinson’s disease. Mov Disord. 2014;29:1809–15.CrossRefPubMedPubMedCentralGoogle Scholar
  84. Walter SD. Properties of the summary receiver operating characteristic (SROC) curve for diagnostic test data. Stat Med. 2002;21:1237–56.CrossRefPubMedGoogle Scholar
  85. Williamson J, Larner AJ. MACE for diagnosis of dementia and MCI: 3-year pragmatic diagnostic test accuracy study. Dement Geriatr Cogn Disord. 2018;45 in press.Google Scholar
  86. Wojtowicz A, Larner AJ. Diagnostic test accuracy of cognitive screeners in older people. Prog Neurol Psychiatry. 2017;21(1):17–21.CrossRefGoogle Scholar
  87. Woodworth RS. Accuracy of voluntary movements. Psychol Rev. 1899;3:1–101.Google Scholar
  88. Yoshida H, Terada S, Honda H, et al. Validation of Addenbrooke’s cognitive examination for detecting early dementia in a Japanese population. Psychiatry Res. 2011;185:211–4.CrossRefPubMedGoogle Scholar
  89. Yoshida H, Terada S, Honda H, et al. Validation of the revised Addenbrooke’s Cognitive Examination (ACE-R) for detecting mild cognitive impairment and dementia in a Japanese population. Int Psychogeriatr. 2012;24:28–37.CrossRefPubMedGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • A. J. Larner
    • 1
  1. 1.Cognitive Function ClinicWalton Centre for Neurology and NeurosurgeryLiverpoolUK

Personalised recommendations