Advertisement

Reliability and validity of self-reported questionnaires to measure pain and disability in adults with neck pain and its associated disorders: part 3—a systematic review from the CADRE Collaboration

  • N. LemeunierEmail author
  • S. da Silva-Oolup
  • K. Olesen
  • H. Shearer
  • L. J. Carroll
  • O. Brady
  • E. Côté
  • P. Stern
  • T. Tuff
  • M. Suri-Chilana
  • P. Torres
  • J. J. Wong
  • D. Sutton
  • K. Murnaghan
  • P. Côté
Review Article

Abstract

Purpose

To determine the reliability and validity of self-reported questionnaires to measure pain and disability in adults with grades I–IV neck pain and its associated disorders (NAD).

Methods

We updated the systematic review of the 2000–2010 Bone and Joint Decade Task Force on Neck Pain and its Associated Disorders and systematically searched databases from 2005 to 2017. Independent reviewers screened and critically appraised studies using standardized tools. Evidence from low-risk-of-bias studies was synthesized according to best evidence synthesis principles. Validity studies were ranked according to the Sackett and Haynes classification.

Results

We screened 2823 articles, and 26 were eligible for critical appraisal; 18 were low risk of bias. Preliminary evidence suggests that the Neck Disability Index (original and short versions), Whiplash Disability Questionnaire, Neck Pain Driving Index, and ProFitMap-Neck may be valid and reliable to measure disability in patients with NAD. We found preliminary evidence for the validity and reliability of pain measurements including the Body Pain Diagram, Visual Analogue Scale, the Numeric Rating Scale and the Pain-DETECT Questionnaire.

Conclusion

The evidence supporting the validity and reliability of instruments used to measure pain and disability is preliminary. Further validity studies are needed to confirm the clinical utility of self-reported questionnaires to assess pain and disability in patients with NAD.

Graphical abstract

These slides can be retrieved under Electronic Supplementary Material.

Keywords

Neck pain Disability Self-reported questionnaire Reliability/validity Systematic review 

Notes

Acknowledgements

The authors acknowledge and thank Mrs. Sophie Despeyroux, librarian at the Haute Autorité de Santé, for her suggestions and review of the search strategy. This research was undertaken, in part, thanks to funding from the Canada Research Chairs program to Dr. Pierre Côté, Canada Research Chair in Disability Prevention and Rehabilitation at the University of Ontario Institute of Technology.

Funding

This study was funded by the Institut Franco-Européen de Chiropraxie, the Association Française de Chiropraxie and the Fondation de Recherche en Chiropraxie in France. None of these associations were involved in the collection of data, data analysis, interpretation of data, or drafting of the manuscript.

Compliance with ethical standards

Conflict of interest

The authors declare that they have no conflict of interest.

Supplementary material

586_2019_5949_MOESM1_ESM.pptx (138 kb)
Supplementary material 1 (PPTX 138 kb)

References

  1. 1.
    Nordin M, Carragee EJ, Hogg-Johnson S et al (2008) Assessment of neck pain and its associated disorders: results of the Bone and Joint Decade 2000–2010 Task Force on Neck Pain and Its Associated Disorders. Spine Phila Pa 1976 33(4 Suppl):S101–S122CrossRefGoogle Scholar
  2. 2.
    Schellingerhout JM, Verhagen AP, Heymans MW, Koes BW, de Vet HC, Terwee CB (2012) Measurement properties of disease-specific questionnaires in patients with neck pain: a systematic review. Qual Life Res 21(4):659–670CrossRefGoogle Scholar
  3. 3.
    Lemeunier N, da Silva-Oolup S, Chow N, Southerst D, Carroll L, Wong JJ, Shearer H, Mastragostino P, Cox J, Côté E, Murnaghan K, Sutton D, Cȏté P (2017) Reliability and validity of clinical tests to assess the anatomical integrity of the cervical spine in adults with neck pain and its associated disorders: Part 1. A systematic review from the Cervical Assessment and Diagnosis Research Evaluation (CADRE) Collaboration. European Spine J 26(9):2225–2241Google Scholar
  4. 4.
    Moser N, Lemeunier N, Southerst D, Shearer H, Murnaghan K, Sutton D, Côté P (2017) Validity and reliability of clinical tests to assess the cervical spine injuries in adults with neck pain and its associated disorders: Part 2. A systematic review from the Cervical Assessment and Diagnosis Research Evaluation (CADRE) Collaboration. European Spine J 27(6):1219–1233Google Scholar
  5. 5.
    Lemeunier N, da Silva-Oolup S, Olesen K, Carroll LJ, Shearer H, Wong JJ, Brady OD, Côté E, Stern P, Sutton D, Suri M, Torres P, Tuff T, Murnaghan K, Côté P (2019) Reliability and validity of clinical tests to assess measurements of pain and disability in adults with neck pain and its associated disorders: Part 3. A systematic review from the Cervical Assessment and Diagnosis Research Evaluation (CADRE) Collaboration. European Spine J (accepted)Google Scholar
  6. 6.
    Lemeunier N, Jeoun EB, Suri M, Tuff T, Shearer H, Mior S, Wong JJ, da Silva-Oolup S, Torres P, D’Silva C, Stern P, Yu H, Millan M, Sutton, Murnaghan K, Cȏté P (2018) Reliability and validity of clinical tests to assess the posture, pain location and cervical mobility in adults with neck pain and its associated disorders: Part 4. A systematic review from the Cervical Assessment and Diagnosis Research Evaluation (CADRE) Collaboration. Musculoskelet Sci Pract 38:128–147CrossRefGoogle Scholar
  7. 7.
    Lemeunier N, Suri M, Welsh P, Shearer H, Nordin M, Wong JJ, Torres, da Silva-Oolup S, D’Silva C, Jeoun EB, Stern P, Yu H, Murnaghan K, Sutton D, Côté P (2018) Reliability and validity of clinical tests to assess the functionality of the cervical spine in adults with neck pain and its associated disorders: Part 5. A systematic review from the Cervical Assessment and Diagnosis Research Evaluation (CADRE) Collaboration. European J Physiotherapy (submitted)Google Scholar
  8. 8.
    Guzman J, Hurwitz EL, Carroll LJ et al (2010) A new conceptual model for neck pain—linking onset, course, and care: The Bone and Joint Decade 2000–2010 Task Force on Neck Pain and Its Associated Disorders. Spine (Phila Pa 1976) 33(4):101–122Google Scholar
  9. 9.
    Spitzer WO, Skovron ML, Salmi LR, Cassidy JD, Duranceau J, Suissa S, Zeiss E (1995) Scientific monograph of the Quebec Task Force on Whiplash-Associated Disorders: redefining “whiplash” and its management. Spine (Phila Pa 1976) 20(8 Suppl):1S–73S (Review. Erratum in: Spine 1995 Nov 1;20(21):2372) Google Scholar
  10. 10.
    Holbrook A. Self-reported measure. Encyclopedia of survey research methods. http://srmo.sagepub.com/view/encyclopedia-of-survey-research-methods/n523.xml
  11. 11.
    Jarvis M, Russel J. Chapter 4—Research methods. In: Broché (ed) Exploring psychology: AS student book for AQA A, Broché Editions, p 91Google Scholar
  12. 12.
    Haywood KL (2006) Patient-reported outcome I: measuring what matters in musculoskeletal care. Musculoskelet Care 4(4):187–203CrossRefGoogle Scholar
  13. 13.
    Bonica J (1979) The need of a taxonomy. Pain 6(3):247–248CrossRefGoogle Scholar
  14. 14.
    World Health Organization (2016) World Health Organization [internet]. World Health Organization, Geneva, Switzerland. Disabilities; 2016 [cited 4 Oct 2016]. http://www.who.int/topics/disabilities/en/
  15. 15.
    Fletcher RH, Fletcher SW, Fletcher GS (2012) Clinical epidemiology: the essentials, 5th edn. Lippincott Williams & Wilkins, PhiladelphiaGoogle Scholar
  16. 16.
    Lucas N, Macaskill P, Irwig L, Moran R, Rickards L, Turner R, Bogduk N (2013) The reliability of a quality appraisal tool for studies of diagnostic reliability (QAREL). BMC Med Res Methodol 13:111CrossRefGoogle Scholar
  17. 17.
    Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, Leeflang MM, Sterne JA, Bossuyt PM, QUADAS-2 Group (2011) QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med 155(8):529–536CrossRefGoogle Scholar
  18. 18.
    Sackett DL, Haynes RB (2002) The architecture of diagnostic research. BMJ 324(7336):539–541CrossRefGoogle Scholar
  19. 19.
    Slavin RE (1995) Best evidence synthesis: an intelligent alternative to meta-analysis. J Clin Epidemiol 48(1):9–18CrossRefGoogle Scholar
  20. 20.
    Viera AJ, Garrett JM (2005) Understanding interobserver agreement: the kappa statistic. Fam Med 37(5):360–363Google Scholar
  21. 21.
    Moher D, Liberati A, Tetzlaff J, Altman DG, Grp P (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Br Med J 89(9):873–880Google Scholar
  22. 22.
    Bossuyt PM, Reitsma JB, Bruns DE et al (2003) Toward complete and accurate reporting of studies diagnostic accuracy: the STARD initiative. Am J Clin Pathol 119:18–22CrossRefGoogle Scholar
  23. 23.
    Björklund M, Hamberg J, Heiden M, Barnekow-Bergkvist M (2012) The ProFitMap-neck—reliability and validity of a questionnaire for measuring symptoms and functional limitations in neck pain. Disabil Rehabil 34(13):1096–1107CrossRefGoogle Scholar
  24. 24.
    Stupar M, Côté P, Beaton DE, Boyle E, Cassidy JD (2015) A test–retest reliability study of the whiplash disability questionnaire in patients with acute whiplash-associated disorders. J Manip Physiol Ther 38:629–636CrossRefGoogle Scholar
  25. 25.
    Takasaki H, Johnston V, Treleaven JM, Jull GA (2012) The Neck Pain Driving Index (NPDI) for chronic whiplash-associated disorders: development, reliability, and validity assessment. Spine J 12:912–920CrossRefGoogle Scholar
  26. 26.
    Walton DM, MacDermid JC (2013) A brief 5-item version of the Neck Disability Index shows good psychometric properties. Health Qual Life Outcomes 11:108CrossRefGoogle Scholar
  27. 27.
    Young BA, Walker MJ, Strunce JB, Boyles RE, Whitman JM, Childs JD (2009) Responsiveness of the Neck Disability Index in patients with mechanical neck disorders. Spine J 9:802–808CrossRefGoogle Scholar
  28. 28.
    Prushansky T, Handelzalts S, Pevzner E (2007) Reproducibility of pressure pain threshold and visual analog scale findings in chronic whiplash patients. Clin J Pain 23(4):339–345CrossRefGoogle Scholar
  29. 29.
    Southerst D, Stupar M, Côté P, Mior S, Stern P (2013) The reliability of measuring pain distribution and location using body pain diagrams in patients with acute whiplash-associated disorders. National University of Health Sciences, Lombard, pp 395–402Google Scholar
  30. 30.
    Cleland JA, Childs JD, Whitman JM (2008) Psychometric properties of the Neck Disability Index and Numeric Pain Rating Scale in patients with mechanical neck pain. Arch Phys Med Rehabil 89(1):69–74CrossRefGoogle Scholar
  31. 31.
    Mehta SH, Macdermid JC, Carlesso LC, McPhee C (2010) Concurrent validation of the DASH and the QuickDASH in comparison to neck-specific scales in patients with neck pain. Spine 35(24):2150–2156CrossRefGoogle Scholar
  32. 32.
    Pink J, Petrou S, Williamson E, Williams M, Lamb SE (2014) Properties of patient-reported outcome measures in individuals following acute whiplash injury. Health Qual Life Outcomes 12(1):1CrossRefGoogle Scholar
  33. 33.
    See KS, Treleaven J (2015) Identifying upper limb disability in patients with persistent whiplash. Man Ther 20(3):487–493CrossRefGoogle Scholar
  34. 34.
    Stupar M, Côté P, Beaton DE, Boyle E, Cassidy JD (2015) Structural and construct validity of the Whiplash Disability Questionnaire in adults with acute whiplash-associated disorders. Spine J 15(11):2369–2377CrossRefGoogle Scholar
  35. 35.
    van der Velde G, Beaton D, Hogg-Johnston S, Hurwitz E, Tennant A (2009) Rasch analysis provides new insights into the measurement properties of the neck disability index. Arthritis Care Res 61(4):544–551CrossRefGoogle Scholar
  36. 36.
    Young IA, Cleland JA, Michener LA, Brown C (2010) Reliability, construct validity, and responsiveness of the neck disability index, patient-specific functional scale, and numeric pain rating scale in patients with cervical radiculopathy. Am J Phys Med Rehabil 89(10):831–839CrossRefGoogle Scholar
  37. 37.
    Bolton JE, Humphreys BK, Van Hedel HJA (2010) Validity of weekly recall ratings of average pain intensity in neck pain patients. J Manip Physiol Ther 33(8):612–617CrossRefGoogle Scholar
  38. 38.
    Tampin B, Briffa NK, Slater H (2013) Self-reported sensory descriptors are associated with quantitative sensory testing parameters in patients with cervical radiculopathy, but not in patients with fibromyalgia. Eur J Pain (UK) 17(4):621–633CrossRefGoogle Scholar
  39. 39.
    Ferrari R, Russell A, Kelly AJ (2006) Assessing whiplash recovery—the Whiplash Disability Questionnaire. Aust Fam Physician 35(8):653–654Google Scholar
  40. 40.
    Barbero M, Moresi F, Leoni D, Gatti R, Egloff M, Falla G (2015) Test–retest reliability of pain extent and pain location using a novel method for pain drawing analysis. Eur J Pain 19:1129–1138CrossRefGoogle Scholar
  41. 41.
    Hayashi K, Arai YC, Morimoto A, Aono S, Yoshimoto T, Nishihara M, Osuga T, Inoue S, Ushida T (2015) Associations between pain drawing and psychological characteristics of different body region pains. Pain Pract 15(4):300–307CrossRefGoogle Scholar
  42. 42.
    Odole AC, Adegoke BO, Akomas NC (2011) Validity and test re-test reliability of the neck disability index in the Nigerian clinical setting. Afr J Med Med Sci 40(2):135–138Google Scholar
  43. 43.
    Provenzano DA, Fanciullo GJ, Jamison RN, McHugo GJ, Baird JC (2007) Computer assessment and diagnostic classification of chronic pain patients. Pain Med 8(suppl 3):S167–S175CrossRefGoogle Scholar
  44. 44.
    Çakıt BD, Genç H, Altuntaş V, Erdem HR (2009) Disability and related factors in patients with chronic cervical myofascial pain. Clin Rheumatol 28(6):647–654CrossRefGoogle Scholar
  45. 45.
    En MC, Clair DA, Edmondston SJ (2009) Validity of the Neck Disability Index and Neck Pain and Disability Scale for measuring disability associated with chronic, non-traumatic neck pain. Man Ther 14(4):433–438CrossRefGoogle Scholar
  46. 46.
    Forestier R, Françon A, Saint Arroman F, Bertolino C (2007) French version of the Copenhagen neck functional disability scale. Jt Bone Spine 74(2):155–159CrossRefGoogle Scholar
  47. 47.
    Malik AA, Robinson S, Khan WS, Dillon B, Lovell ME (2017) Assessment of range of movement, pain and disability following a whiplash injury. Open Orthop J 11:541–545CrossRefGoogle Scholar
  48. 48.
    Gabel A, Cuesta-Vargas Barr S, Winkeljohn Black S, Osborne JW, Melloh M (2016) Confirmatory factor analysis of the neck disability index, comparing patients with whiplash associated disorders to a control group with non-specific neck pain. Eur Spine J 8:2078–2086CrossRefGoogle Scholar
  49. 49.
    Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL et al (2010) The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: An international Delphi study. Qual Life Res 19(4):539–549CrossRefGoogle Scholar
  50. 50.
    Juni P, Holenstein F, Sterne J et al (2002) Direction and impact of language bias in meta-analyses of controlled trials: empirical study. Int J Epidemiol 31:115–123CrossRefGoogle Scholar
  51. 51.
    Moher D, Fortin P, Jadad AR et al (1996) Completeness of reporting of trials published in languages other than English: implications for conduct and reporting of systematic reviews. Lancet 347:363–366CrossRefGoogle Scholar
  52. 52.
    Moher D, Pham B, Lawson ML et al (2003) The inclusion of reports of randomised trials published in languages other than English in systematic reviews. Health Technol Assess 7:1–90CrossRefGoogle Scholar
  53. 53.
    Morrison A, Polisena J, Husereau D et al (2012) The effect of English-language restriction on systematic review-based metaanalyses: a systematic review of empirical studies. Int J Technol Assess Health Care 28:138–144CrossRefGoogle Scholar
  54. 54.
    Sutton AJ, Duval SJ, Tweedie RL et al (2000) Empirical assessment of effect of publication bias on meta-analyses. BMJ 320:1574–1577CrossRefGoogle Scholar
  55. 55.
    Margolis RB, Chibnall JT, Tait RC (1998) Test–retest reliability of the pain drawing instrument. Pain 33:49–51CrossRefGoogle Scholar
  56. 56.
    Hudak PL, Amadio PC, Bombardier C, Beaton D, Cole D, Davis A et al (1996) Development of an upper extremity outcome measure: the DASH. Am J Ind Med 30:372CrossRefGoogle Scholar
  57. 57.
    Vernon H, Mior S (1991) The Neck Disability Index: a study of reliability and validity. JMPT 14:409–415Google Scholar
  58. 58.
    Bijur PE, Latimer CT, Gallagher EJ (2003) Validation of a verbally administered numerical rating scale of acute pain for use in the emergency department. Acad Emerg Med 10:390–392CrossRefGoogle Scholar
  59. 59.
    Freynhagen R, Baron R, Gockel U, Tölle TR (2006) Pain-DETECT: a new screening questionnaire to identify neuropathic components in patients with back pain. Curr Med Res Opin 22:1911–1920CrossRefGoogle Scholar
  60. 60.
    Carlsson AM (1983) Assessment of chronic pain. I. Aspects of the reliability and validity of the visual analogic scale. Pain 16:87–101CrossRefGoogle Scholar
  61. 61.
    Pinfold M, Niere KR, O’Leary EF, Hoving JL, Green S, Buchbinder R (2004) Validity and internal consistency of a chiplash-specific disability measure. Spine 29:263–268CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2019

Authors and Affiliations

  • N. Lemeunier
    • 1
    • 2
    • 3
    Email author
  • S. da Silva-Oolup
    • 4
  • K. Olesen
    • 4
  • H. Shearer
    • 2
    • 3
  • L. J. Carroll
    • 5
  • O. Brady
    • 6
  • E. Côté
    • 7
  • P. Stern
    • 4
  • T. Tuff
    • 4
  • M. Suri-Chilana
    • 4
  • P. Torres
    • 8
  • J. J. Wong
    • 2
    • 3
    • 4
  • D. Sutton
    • 2
    • 3
  • K. Murnaghan
    • 3
  • P. Côté
    • 2
    • 3
    • 9
  1. 1.Institut Franco-Européen de Chiropraxie (IFEC)ToulouseFrance
  2. 2.UOIT-CMCC Centre for Disability Prevention and RehabilitationUniversity of Ontario Institute of Technology (UOIT)OshawaCanada
  3. 3.Canadian Memorial Chiropractic College (CMCC)TorontoCanada
  4. 4.Graduate Education and Research ProgramsCanadian Memorial Chiropractic College (CMCC)TorontoCanada
  5. 5.School of Public HealthUniversity of AlbertaEdmontonCanada
  6. 6.School of Physical Therapy and Rehabilitation Sciences, Morsani College of MedicineUniversity of South FloridaTampaUSA
  7. 7.Department of Ophthalmology and Vision SciencesUniversity of TorontoTorontoCanada
  8. 8.Rehabilitation Centre, San Cristobal ClinicSantiago Spine GroupSantiagoChile
  9. 9.Faculty of Health SciencesUniversity of Ontario Institute of Technology (UOIT)OshawaCanada

Personalised recommendations