Original Study| Volume 19, ISSUE 10, P846-851.e2, October 2018

Using PROMIS Pain Interference Items to Improve Quality Measurement in Inpatient Rehabilitation Facilities



      To evaluate the Patient-Reported Outcomes Measurement Information System (PROMIS) pain interference items for use in a quality measure and to compare the resulting quality score, along with internal reliability and validity, to a similar item set in the Minimum Data Set Version 3.0 (MDS).


      Cross-sectional, observational study.


      One freestanding inpatient rehabilitation facility (IRF) and one large hospital-based IRF.


      Patients with neurologic disorders. Of 1055 consecutive admissions, 26% were excluded based on clinician-determined cognitive impairment or emotional distress. Of the remainder, 50% consented and completed the survey near the end of their IRF stay (N = 391). Of these, more than half (57%) reported pain over the last day (n = 224).


      Psychometric statistics and quality scores were computed from a 55-question survey, including the MDS and PROMIS pain interference items.


      Estimates for internal reliability were higher for the PROMIS 2-item scale compared to the MDS: Cronbach α (0.86 vs 0.48) and interitem correlations (0.75 vs 0.31). The PROMIS-2 items were better able to detect differences in patients with mild and severe pain intensity (Cohen d = 1.57) relative to the corresponding MDS items (Cohen d = 0.81). Two quality scores based on the PROMIS-2 items, reflecting low and high levels of pain interference, showed 46% or 12% of patients meeting these thresholds. This compared to a 30% rate when patients were classified by the MDS as experiencing pain interference.


      PROMIS pain interference items appear to be more internally consistent than similar MDS items. The graded PROMIS items permit the creation of multiple quality scores, showing predictable overlap with corresponding MDS quality scores. Because PROMIS items provide finer distinctions, they allow greater latitude in reporting quality scores. We recommend further study of pain interference scores across IRFs to improve their reliability and validity.


      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Journal of the American Medical Directors Association
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Basch E.
        New frontiers in patient-reported outcomes: Adverse event reporting, comparative effectiveness, and quality assessment.
        Annu Rev Med. 2014; 65: 307-317
        • Saver B.G.
        • Martin S.A.
        • Adler R.N.
        • et al.
        Care that matters: Quality measurement and health care.
        PLoS Med. 2015; 12: e1001902
        • Basch E.
        • Spertus J.
        • Dudley R.A.
        • et al.
        Methods for developing patient-reported outcome-based performance measures (PRO-PMs).
        Value Health. 2015; 18: 493-504
        • Solomon L.S.
        • Hays R.D.
        • Zaslavsky A.M.
        • et al.
        Psychometric properties of a group-level consumer assessment of health plans study (CAHPS) instrument.
        Med Care. 2005; 43: 53-60
        • Dworkin R.H.
        • Turk D.C.
        • Farrar J.T.
        • et al.
        Core outcome measures for chronic pain clinical trials: IMMPACT recommendations.
        Pain. 2005; 113: 9-19
        • National Quality Measures Clearinghouse
        Home Health Care: Percentage of Home Health Episodes of Care During Which the Patient's Frequency of Pain When Moving Around Improved.
        Agency for Healthcare Research and Quality, Rockville, MD2016
        • National Quality Measures Clearinghouse
        Pain Management: Percentage of Patients With Documented Assessment of the Impact of Pain on Function and Quality of Life.
        Agency for Healthcare Research and Quality, Rockville, MD2014
        • Streiner D.L.
        • Norman G.R.
        • Cairney J.
        Health Measurement Scales: A Practical Guide to Their Development and Use.
        Oxford University Press, New York2014
        • Saliba D.
        • Jones M.
        • Streim J.
        • et al.
        Overview of significant changes in the minimum data set for nursing homes version 3.0.
        J Am Med Dir Assoc. 2012; 13: 595-601
        • Saliba D.
        • Buchanan J.
        Development and Validation of a Revised Nursing Home Assessment Tool: MDS 3.0.
        RAND Health Corporation, Santa Monica, CA2008
        • Cadogan M.P.
        • Edelen M.O.
        • Lorenz K.A.
        • et al.
        The relationship of reported pain severity to perceived effect on function of nursing home residents.
        J Gerontol A Biol Sci Med Sci. 2008; 63: 969-973
        • Amtmann D.
        • Cook K.F.
        • Jensen M.P.
        • et al.
        Development of a PROMIS item bank to measure pain interference.
        Pain. 2010; 150: 173-182
        • Cella D.
        • Yount S.
        • Rothrock N.
        • et al.
        The Patient-Reported Outcomes Measurement Information System (PROMIS): Progress of an NIH roadmap cooperative group during its first two years.
        Med Care. 2007; 45: S3-S11
        • Cella D.
        • Riley W.
        • Stone A.
        • et al.
        The patient-reported outcomes measurement information system (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008.
        J Clin Epidemiol. 2010; 63: 1179-1194
        • Reeve B.B.
        • Hays R.D.
        • Bjorner J.B.
        • et al.
        Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the Patient-Reported Outcomes Measurement Information System (PROMIS).
        Med Care. 2007; 45: S22-S31
        • Cadogan M.P.
        • Schnelle J.F.
        • Al-Sammarrai N.R.
        • et al.
        A standardized quality assessment system to evaluate pain detection and management in the nursing home.
        J Am Med Dir Assoc. 2005; 6: 1-9
        • Heinemann A.W.
        • Deutsch A.
        • Cella D.
        • et al.
        Feasibility of collecting patient-reported outcomes for inpatient rehabilitation quality reporting.
        Health Serv Res. 2017; ([published online June 15, 2017])
        • Stone A.A.
        • Broderick J.E.
        • Junghaenel D.U.
        • et al.
        PROMIS fatigue, pain intensity, pain interference, pain behavior, physical function, depression, anxiety, and anger scales demonstrate ecological validity.
        J Clin Epidemiol. 2016; 74: 194-206
        • Jacobs J.W.
        • Bernhard M.R.
        • Delgado A.
        • Strain J.J.
        Screening for organic mental syndromes in the medically ill.
        Ann Intern Med. 1977; 86: 40-46
        • Foreman M.D.
        Reliability and validity of mental status questionnaires in elderly hospitalized patients.
        Nurse Res. 1987; 36: 216-220
        • Kaufman D.M.
        • Weinberger M.
        • Strain J.J.
        • Jacobs J.W.
        Detection of cognitive deficits by a brief mental status examination: The Cognitive Capacity Screening Examination, a reappraisal and a review.
        Gen Hosp Psychiatry. 1979; 1: 247-255
        • Comrey A.L.
        Factor-analytic methods of scale development in personality and clinical psychology.
        J Consult Clin Psychol. 1988; 56: 754