Differential item functioning of the PROMIS physical function, pain interference, and pain behavior item banks across patients with different musculoskeletal disorders and persons from the general population
To investigate the validity of comparisons across patients with different musculoskeletal disorders and persons from the general population by evaluating differential item functioning (DIF) for the PROMIS physical function (PROMIS-PF), pain interference (PROMIS-PI), and pain behavior (PROMIS-PB) item banks.
Patients with chronic pain, rheumatoid arthritis (RA), or osteoarthritis (OA); patients receiving physiotherapy (PT); and persons from the Dutch general population completed the full Dutch-Flemish PROMIS-PF (121-items), PROMIS-PI (40-items), or PROMIS-PB (39-items) banks. DIF was assessed with ordinal logistic regression models and McFadden’s pseudo R2-change of ≥ 2% as critical value. The impact of DIF on item scores and the T-scores per bank was examined by inspecting item characteristic curves (ICCs) and test characteristic curves (TCCs).
2762 patients with chronic pain, 2029 with RA, 1247 with OA, 805 receiving PT, and 1310 healthy persons participated. For the PROMIS-PF, 25 out of 121 items were flagged for DIF, of which 10 items were flagged in multiple comparisons. For the PROMIS-PI, only 2 out of 40 items were flagged for DIF and for the PROMIS-PB, only 3 out of 39 items. Most DIF items had R2 values just above the critical value of 2% and all showed uniform DIF. The ICCs and TCCs showed that the magnitude and impact of DIF on the item and T-scores were negligible.
This study supports the universal applicability of PROMIS across (patient) populations. Comparisons across patients with different musculoskeletal disorders and persons from the general population are valid, when applying the PROMIS-PF, PROMIS-PI, and PROMIS-PB banks.
KeywordsPROMIS Chronic pain Rheumatoid arthritis Hip or knee osteoarthritis General population Differential item functioning
The Dutch-Flemish PROMIS group is an initiative that aims to translate, investigate, and implement PROMIS item banks, short forms, and CATS in the Netherlands and Flanders (http://www.dutchflemishpromis.nl). The CHECK-cohort study is funded by the Dutch Arthritis Foundation. Involved are Erasmus Medical Center Rotterdam; Kennemer Gasthuis Haarlem; Leiden University Medical Center; Maastricht University Medical Center; Martini Hospital Groningen/Allied Health Care Center for Rheumatology and Rehabilitation Groningen; Medical Spectrum Twente Enschede/Ziekenhuisgroep Twente Almelo; Reade Center for Rehabilitation and Rheumatology; St. Maartenskliniek Nijmegen; University Medical Center Utrecht; and Wilhelmina Hospital Assen.
Compliance with ethical standards
Conflict of interest
Dr. C.B. Terwee is president of the PROMIS Health Organization. All authors are members of the Dutch-Flemish PROMIS group. All authors have no financial or non-financial conflicts of interest.
As this study did not involve experiments with patients, it was exempt from ethical approval according to the Dutch Medical Research in Human Subjects Act (WMO) by the medical ethics committee of the VU University Medical Center, and of Slotervaart and Reade, Amsterdam.
Human and animal rights
All procedures performed in this study involving human participants were in accordance with the ethical standards of the institutional and national research committees and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. This article does not contain any studies with animals performed by any of the authors.
According to the Dutch Medical Research in Human Subjects Act (WMO), obtaining informed consent was not necessary. The waiver includes that a signature from the patient on a separate informed consent form was not required, but that completion of the questionnaire by the patient can be considered as informed consent.
- 2.Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., … Hays, R. (2010). The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. Journal of Clinical Epidemiology, 63(11), 1179–1194. https://doi.org/10.1016/j.jclinepi.2010.04.011.CrossRefPubMedPubMedCentralGoogle Scholar
- 3.Fries, J. F., Bruce, B., Bjorner, J., & Rose, M. (2006). More relevant, precise, and efficient items for assessment of physical function and disability: Moving beyond the classic instruments. Annals of the Rheumatic Diseases, 65(Suppl 3), iii16–i21. https://doi.org/10.1136/ard.2006.059279.CrossRefPubMedPubMedCentralGoogle Scholar
- 6.Oude Voshaar, M. A. H., ten Klooster, P. M., Glas, C. A. W., Vonkeman, H. E., Krishnan, E., & van de Laar, M. A. F. J. (2014). Relative Performance of Commonly Used Physical Function Questionnaires in rheumatoid arthritis and a patient-reported outcomes measurement information system computerized adaptive test. Arthritis & Rheumatology, 66(10), 2900–2908. https://doi.org/10.1002/art.38759.CrossRefGoogle Scholar
- 7.Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., … Cella, D. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the Patient-Reported Outcomes Measurement Information System (PROMIS). Medical Care, 45(5), 22–31. https://doi.org/10.1097/01.mlr.0000250483.85507.04.CrossRefGoogle Scholar
- 8.Holland, P., & Wainer, H. (1993). Differential item functioning. Hillsdale, NJ: Lawrence Erlbaum Associates.Google Scholar
- 9.Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
- 10.Rose, M., Bjorner, J. B., Gandek, B., Bruce, B., Fries, J. F., & Ware, J. E. (2014). The PROMIS Physical Function item bank was calibrated to a standardized metric and shown to improve measurement efficiency. Journal of Clinical Epidemiology, 67(5), 516–526. https://doi.org/10.1016/j.jclinepi.2013.10.024.CrossRefPubMedPubMedCentralGoogle Scholar
- 13.Crins, M. H. P., Roorda, L. D., Smits, N., de Vet, H. C. W., Westhovens, R., Cella, D., … Terwee, C. B. (2016). Calibration of the Dutch-Flemish PROMIS Pain Behavior item bank in patients with chronic pain. European Journal of Pain, 20(2), 284–296. https://doi.org/10.1002/ejp.727.CrossRefPubMedGoogle Scholar
- 14.Crins, M. H. P., Roorda, L. D., Smits, N., de Vet, H. C. W., Westhovens, R., Cella, D., … Terwee, C. B. (2015). Calibration and validation of the Dutch-Flemish PROMIS pain interference item bank in patients with chronic pain. PLoS ONE, 10(7), 1–18. https://doi.org/10.1371/journal.pone.0134094.CrossRefGoogle Scholar
- 15.Oude Voshaar, M. A. H., ten Klooster, P. M., Glas, C. A. W., Vonkeman, H. E., Taal, E., Krishnan, E., … van de Laar, M. A. F. J. (2014). Calibration of the PROMIS physical function item bank in Dutch patients with rheumatoid arthritis. PLoS ONE, 9(3), e92367. https://doi.org/10.1371/journal.pone.0092367.CrossRefPubMedPubMedCentralGoogle Scholar
- 16.Crins, M. H. P., Terwee, C. B., Klausch, T., Smits, N., de Vet, H. C. W., Westhovens, R., … Roorda, L. D. (2017). The Dutch-Flemish PROMIS physical function item bank exhibited strong psychometric properties in patients with chronic pain. Journal of Clinical Epidemiology, 87, 47–58. https://doi.org/10.1016/j.jclinepi.2017.03.011.CrossRefPubMedGoogle Scholar
- 18.Paz, S. H., Spritzer, K. L., Reise, S. P., & Hays, R. D. (2017). Differential item functioning of the patient-reported outcomes information system (PROMIS®) pain interference item bank by language (Spanish versus English). Quality of Life Research, 26(6), 1451–1462. https://doi.org/10.1007/s11136-017-1499-3.CrossRefPubMedPubMedCentralGoogle Scholar
- 19.Crins, M., Terwee, C., Westhovens, R., Schaardenburg van, D., Smits, N., Joly, J., … Roorda, L. (2018). First validation of the full PROMIS pain interference and pain behavior item banks in patients with rheumatoid arthritis. Arthritis Care & Research (submitted for publication).Google Scholar
- 20.Schuller, W., Terwee, C., Klausch, T., Roorda, L., Rohrich, D., Ostelo, R., … de Vet, H. (2018). Validation of the Dutch-Flemish PROMIS pain behavior item bank in patients with musculoskeletal complaints. PLoS ONE (submitted for publication).Google Scholar
- 23.Paz, S. H., Spritzer, K. L., Morales, L. S., & Hays, R. D. (2013). Evaluation of the Patient-Reported Outcomes Information System (PROMIS(®)) Spanish-language physical functioning items. Quality of Life Research, 22(7), 1819–1830. https://doi.org/10.1007/s11136-012-0292-6.CrossRefPubMedGoogle Scholar
- 24.Wesseling, J., Boers, M., Viergever, M. A., Hilberdink, W. K. H. A., Lafeber, F. P. J. G., Dekker, J., & Bijlsma, J. W. J. (2016). Cohort Profile: Cohort Hip and Cohort Knee (CHECK) study. International Journal of Epidemiology, 45(1), 36–44. https://doi.org/10.1093/ije/dyu177.CrossRefPubMedGoogle Scholar
- 25.Wesseling, J., Dekker, J., Van Den Berg, W. B., Bierma-Zeinstra, S. M. A., Boers, M., Cats, H. A., … Bijlsma, J. W. J. (2009). CHECK (Cohort Hip and Cohort Knee): Similarities and differences with the osteoarthritis initiative. Annals of the Rheumatic Diseases, 68(9), 1413–1419. https://doi.org/10.1136/ard.2008.096164.CrossRefPubMedGoogle Scholar
- 26.Terwee, C. B., Roorda, L. D., de Vet, H. C. W., Dekker, J., Westhovens, R., van Leeuwen, J., … Boers, M. (2014). Dutch-Flemish translation of 17 item banks from the Patient-Reported Outcomes Measurement Information System (PROMIS). Quality of Life Research, 23(6), 1733–1741. https://doi.org/10.1007/s11136-013-0611-6.CrossRefPubMedGoogle Scholar
- 27.PROMIS. (2017). PROMIS pain interference scoring manual. Retrieved November 29, 2017, from http://www.healthmeasures.net/images/PROMIS/manuals/PROMIS_Pain_Interference_Scoring_Manual_02232017.pdf.
- 28.PROMIS. (2015). PROMIS pain behavior scoring manual. Retrieved November 29, 2017, from http://www.healthmeasures.net/images/promis/manuals/PROMIS_Pain_Behavior_Scoring_Manual.pdf.
- 30.Crane, P. K., Gibbons, L. E., Jolley, L., & van Belle, G. (2006). Differential item functioning analysis with ordinal logistic regression techniques: DIFdetect and difwithpar. Medical Care, 44(11 Suppl 3), S115–S123. https://doi.org/10.1097/01.mlr.0000245183.28384.ed.CrossRefPubMedGoogle Scholar
- 32.Choi, S. W., Gibbons, L. E., & Crane, P. K. (2016). Logistic ordinal regression differential item functioning using IRT, version 0.3-3. Retrieved December 14, 2016, from https://cran.r-project.org/web/packages/lordif/lordif.pdf.
- 33.Scott, N. W., Fayers, P. M., Aaronson, N. K., Bottomley, A., de Graeff, A., Groenvold, M., … Sprangers, M. A. G. (2010). Differential item functioning (DIF) analyses of health-related quality of life instruments using logistic regression. Health and Quality of Life Outcomes, 8, 1–9. https://doi.org/10.1186/1477-7525-8-81.CrossRefGoogle Scholar
- 34.PROMIS. (2014). Minimum requirements for the release of PROMIS instruments after translation and recommendations for further psychometric evaluation. Retrieved June 2, 2018, from http://www.healthmeasures.net/images/PROMIS/Standards_for_release_of_PROMIS_instruments_after_translation_v8.pdf.
- 36.Hung, M., Hon, S. D., Franklin, J. D., Kendall, R. W., Lawrence, B. D., Neese, A., … Brodke, D. S. (2014). Psychometric properties of the promis physical function item bank in patients with spinal disorders. Spine, 39(2), 158–163. https://doi.org/10.1097/BRS.0000000000000097.CrossRefPubMedGoogle Scholar