Skip to main content
Top
Published in: BMC Primary Care 1/2014

Open Access 01-12-2014 | Research article

Patient reported outcome measures (PROMs) in primary care: an observational pilot study of seven generic instruments

Authors: Jan-Willem Weenink, Jozé Braspenning, Michel Wensing

Published in: BMC Primary Care | Issue 1/2014

Login to get access

Abstract

Background

Patient reported outcome measures (PROMs) have been introduced in studies to assess healthcare performance. The development of PROMs for primary care poses specific challenges, including a preference for generic measures that can be used across diseases, including early phases or mild conditions. This pilot study aimed to explore the potential usefulness of seven generic measures for assessing health outcomes in primary care patients.

Methods

A total of 300 patients in three general practices were invited to participate in the study, shortly after their visit to the general practitioner. Patients received a written questionnaire, containing seven validated instruments, focused on patient empowerment (PAM-13 or EC-17), quality of life (EQ-5D or SF-12), mental health (GHQ-12), enablement (PEI) and perceived treatment effect (GPE). Furthermore, questions on non-specific symptoms and number of GP contacts were included. After 4 weeks patients received a second, identical, questionnaire. Response and missing items, total scores and dispersion, responsiveness, and associations between instruments and other measures were examined.

Results

A total of 124 patients completed the questionnaire at baseline, of whom 98 completed it both at baseline and 4 weeks later (response rate: 32.7%). The instruments had a full completion rate of 80% or higher. Differences between baseline and follow up were significant for the EQ-5D (p = 0.026), SF-12 PCS (p = 0.026) and the GPE (p = 0.006). A strong correlation (r ≥ 0.6) was found between the SF-12 MCS and GHQ-12, at both baseline measurement and after four weeks. Other observed associations between instruments were moderately strong. No strong correlations were found between instruments and non-specific symptoms or number of GP contacts.

Conclusions

The present study is among the first to explore the use of generic patient-reported outcome measures in primary care. It provides several leads for developing a generic PROM questionnaire in primary care as well as for potential limitations of such instruments.
Literature
1.
go back to reference Dawson J, Doll H, Fitzpatrick R, Jenkinson C, Carr AJ: The routine use of patient reported outcome measures in healthcare settings. BMJ. 2010, 340: c186-10.1136/bmj.c186.CrossRefPubMed Dawson J, Doll H, Fitzpatrick R, Jenkinson C, Carr AJ: The routine use of patient reported outcome measures in healthcare settings. BMJ. 2010, 340: c186-10.1136/bmj.c186.CrossRefPubMed
2.
go back to reference Fitzpatrick R, Davey C, Buxton MJ, Jones DR: Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess. 1998, 2: i-iv-1-74.PubMed Fitzpatrick R, Davey C, Buxton MJ, Jones DR: Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess. 1998, 2: i-iv-1-74.PubMed
4.
go back to reference Allen J, Gay B, Crebolder H, Heyrman J, Svab I, Ram P: The European definitions of the key features of the discipline of general practice: the role of the GP and core competencies. Br J Gen Pract. 2002, 52: 526-527.PubMedPubMedCentral Allen J, Gay B, Crebolder H, Heyrman J, Svab I, Ram P: The European definitions of the key features of the discipline of general practice: the role of the GP and core competencies. Br J Gen Pract. 2002, 52: 526-527.PubMedPubMedCentral
5.
go back to reference Safran DG, Kosinski M, Tarlov AR, Rogers WH, Taira DH, Lieberman N, Ware JE: The Primary Care Assessment Survey: tests of data quality and measurement performance. Med Care. 1998, 36: 728-739. 10.1097/00005650-199805000-00012.CrossRefPubMed Safran DG, Kosinski M, Tarlov AR, Rogers WH, Taira DH, Lieberman N, Ware JE: The Primary Care Assessment Survey: tests of data quality and measurement performance. Med Care. 1998, 36: 728-739. 10.1097/00005650-199805000-00012.CrossRefPubMed
6.
go back to reference Grol R, Wensing M, Mainz J, Jung HP, Ferreira P, Hearnshaw H, Hjortdahl P, Olesen F, Reis S, Ribacke M, Szecsenyi J: Patients in Europe evaluate general practice care: an international comparison. Br J Gen Pract. 2000, 50: 882-887.PubMedPubMedCentral Grol R, Wensing M, Mainz J, Jung HP, Ferreira P, Hearnshaw H, Hjortdahl P, Olesen F, Reis S, Ribacke M, Szecsenyi J: Patients in Europe evaluate general practice care: an international comparison. Br J Gen Pract. 2000, 50: 882-887.PubMedPubMedCentral
7.
go back to reference Wensing M, van Lieshout J, Jung HP, Hermsen J, Rosemann T: The Patients Assessment Chronic Illness Care (PACIC) questionnaire in The Netherlands: a validation study in rural general practice. BMC Health Serv Res. 2008, 8: 182-10.1186/1472-6963-8-182.CrossRefPubMedPubMedCentral Wensing M, van Lieshout J, Jung HP, Hermsen J, Rosemann T: The Patients Assessment Chronic Illness Care (PACIC) questionnaire in The Netherlands: a validation study in rural general practice. BMC Health Serv Res. 2008, 8: 182-10.1186/1472-6963-8-182.CrossRefPubMedPubMedCentral
8.
go back to reference Paterson C: Measuring outcomes in primary care: a patient generated measure, MYMOP, compared with the SF-36 health survey. BMJ. 1996, 312: 1016-1020. 10.1136/bmj.312.7037.1016.CrossRefPubMedPubMedCentral Paterson C: Measuring outcomes in primary care: a patient generated measure, MYMOP, compared with the SF-36 health survey. BMJ. 1996, 312: 1016-1020. 10.1136/bmj.312.7037.1016.CrossRefPubMedPubMedCentral
9.
go back to reference Reilly D, Mercer SW, Bikker AP, Harrison T: Outcome related to impact on daily living: preliminary validation of the ORIDL instrument. BMC Health Serv Res. 2007, 7: 139-10.1186/1472-6963-7-139.CrossRefPubMedPubMedCentral Reilly D, Mercer SW, Bikker AP, Harrison T: Outcome related to impact on daily living: preliminary validation of the ORIDL instrument. BMC Health Serv Res. 2007, 7: 139-10.1186/1472-6963-7-139.CrossRefPubMedPubMedCentral
10.
go back to reference Bergner M, Bobbitt RA, Carter WB, Gilson BS: The Sickness Impact Profile: development and final revision of a health status measure. Med Care. 1981, 19: 787-805. 10.1097/00005650-198108000-00001.CrossRefPubMed Bergner M, Bobbitt RA, Carter WB, Gilson BS: The Sickness Impact Profile: development and final revision of a health status measure. Med Care. 1981, 19: 787-805. 10.1097/00005650-198108000-00001.CrossRefPubMed
11.
go back to reference Spielberger CD: Manual for the State/Trait Anxiety Inventory (form Y): (Self Evaluation Questionnaire). 1983, Palo Alto: Consulting Psychologists Press Spielberger CD: Manual for the State/Trait Anxiety Inventory (form Y): (Self Evaluation Questionnaire). 1983, Palo Alto: Consulting Psychologists Press
12.
go back to reference Hibbard JH, Stockard J, Mahoney ER, Tusler M: Development of the Patient Activation Measure (PAM): conceptualizing and measuring activation in patients and consumers. Health Serv Res. 2004, 39: 1005-1026. 10.1111/j.1475-6773.2004.00269.x.CrossRefPubMedPubMedCentral Hibbard JH, Stockard J, Mahoney ER, Tusler M: Development of the Patient Activation Measure (PAM): conceptualizing and measuring activation in patients and consumers. Health Serv Res. 2004, 39: 1005-1026. 10.1111/j.1475-6773.2004.00269.x.CrossRefPubMedPubMedCentral
13.
go back to reference Kristjansson E, Tugwell PS, Wilson AJ, Brooks PM, Driedger SM, Gallois C, O'Connor AM, Qualman A, Santesso N, Wale J, Wells GA: Development of the effective musculoskeletal consumer scale. J Rheumatol. 2007, 34: 1392-1400.PubMed Kristjansson E, Tugwell PS, Wilson AJ, Brooks PM, Driedger SM, Gallois C, O'Connor AM, Qualman A, Santesso N, Wale J, Wells GA: Development of the effective musculoskeletal consumer scale. J Rheumatol. 2007, 34: 1392-1400.PubMed
14.
go back to reference Rabin R, de Charro F: EQ-5D: a measure of health status from the EuroQol Group. Ann Med. 2001, 33: 337-343. 10.3109/07853890109002087.CrossRefPubMed Rabin R, de Charro F: EQ-5D: a measure of health status from the EuroQol Group. Ann Med. 2001, 33: 337-343. 10.3109/07853890109002087.CrossRefPubMed
15.
go back to reference Lamers LM, Stalmeier PF, McDonnell J, Krabbe PF, Van Busschbach JJ: Measuring the quality of life in economic evaluations: the Dutch EQ-5D tariff. Ned Tijdschr Geneeskd. 2005, 149: 1574-1578.PubMed Lamers LM, Stalmeier PF, McDonnell J, Krabbe PF, Van Busschbach JJ: Measuring the quality of life in economic evaluations: the Dutch EQ-5D tariff. Ned Tijdschr Geneeskd. 2005, 149: 1574-1578.PubMed
16.
go back to reference Ware J, Kosinski M, Keller SD: A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996, 34: 220-233. 10.1097/00005650-199603000-00003.CrossRefPubMed Ware J, Kosinski M, Keller SD: A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996, 34: 220-233. 10.1097/00005650-199603000-00003.CrossRefPubMed
17.
go back to reference Goldberg DP, Williams PDPM: A User's Guide to the General Health Questionnaire. 1988, Windsor, UK: NFER-NELSON Goldberg DP, Williams PDPM: A User's Guide to the General Health Questionnaire. 1988, Windsor, UK: NFER-NELSON
18.
go back to reference Howie JG, Heaney DJ, Maxwell M, Walker JJ: A comparison of a Patient Enablement Instrument (PEI) against two established satisfaction scales as an outcome measure of primary care consultations. Fam Pract. 1998, 15: 165-171. 10.1093/fampra/15.2.165.CrossRefPubMed Howie JG, Heaney DJ, Maxwell M, Walker JJ: A comparison of a Patient Enablement Instrument (PEI) against two established satisfaction scales as an outcome measure of primary care consultations. Fam Pract. 1998, 15: 165-171. 10.1093/fampra/15.2.165.CrossRefPubMed
19.
go back to reference Kamper SJ, Ostelo RW, Knol DL, Maher CG, De Vet HC, Hancock MJ: Global Perceived Effect scales provided reliable assessments of health transition in people with musculoskeletal disorders, but ratings are strongly influenced by current status. J Clin Epidemiol. 2010, 63: 760-766. 10.1016/j.jclinepi.2009.09.009. e761CrossRefPubMed Kamper SJ, Ostelo RW, Knol DL, Maher CG, De Vet HC, Hancock MJ: Global Perceived Effect scales provided reliable assessments of health transition in people with musculoskeletal disorders, but ratings are strongly influenced by current status. J Clin Epidemiol. 2010, 63: 760-766. 10.1016/j.jclinepi.2009.09.009. e761CrossRefPubMed
20.
go back to reference Matalon A, Kotliroff A, Blumberg G, Yaphe J, Kitai E: Non-specific symptoms as clues to changes in emotional well-being. BMC Fam Pract. 2011, 12: 77-10.1186/1471-2296-12-77.CrossRefPubMedPubMedCentral Matalon A, Kotliroff A, Blumberg G, Yaphe J, Kitai E: Non-specific symptoms as clues to changes in emotional well-being. BMC Fam Pract. 2011, 12: 77-10.1186/1471-2296-12-77.CrossRefPubMedPubMedCentral
21.
go back to reference Cohen J: Statistical Power Analysis for the Behavioral Sciences. 1988, Hillsdale, N.J: L. Erlbaum Associates, 2 Cohen J: Statistical Power Analysis for the Behavioral Sciences. 1988, Hillsdale, N.J: L. Erlbaum Associates, 2
22.
go back to reference Beaton DE, Bombardier C, Katz JN, Wright JG: A taxonomy for responsiveness. J Clin Epidemiol. 2001, 54: 1204-1217. 10.1016/S0895-4356(01)00407-3.CrossRefPubMed Beaton DE, Bombardier C, Katz JN, Wright JG: A taxonomy for responsiveness. J Clin Epidemiol. 2001, 54: 1204-1217. 10.1016/S0895-4356(01)00407-3.CrossRefPubMed
23.
go back to reference Evans JD: Straightforward Statistics for the Behavioral Sciences. 1996, Pacific Grove: Brooks/Cole Evans JD: Straightforward Statistics for the Behavioral Sciences. 1996, Pacific Grove: Brooks/Cole
24.
go back to reference Streiner DL, Norman GR: Health Measurement Scales: A Practical Guide to their Development and Use. 2003, Oxford, New York: Oxford University Press, 3 Streiner DL, Norman GR: Health Measurement Scales: A Practical Guide to their Development and Use. 2003, Oxford, New York: Oxford University Press, 3
25.
go back to reference Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC: Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007, 60: 34-42. 10.1016/j.jclinepi.2006.03.012.CrossRefPubMed Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC: Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007, 60: 34-42. 10.1016/j.jclinepi.2006.03.012.CrossRefPubMed
26.
go back to reference Chen H, Rosenzweig EB, Gotzkowsky SK, Arneson C, Nelsen AC, Bourge RC: Treatment satisfaction is associated with improved quality of life in patients treated with inhaled treprostinil for pulmonary arterial hypertension. Health Qual Life Outcomes. 2013, 11: 31-10.1186/1477-7525-11-31.CrossRefPubMedPubMedCentral Chen H, Rosenzweig EB, Gotzkowsky SK, Arneson C, Nelsen AC, Bourge RC: Treatment satisfaction is associated with improved quality of life in patients treated with inhaled treprostinil for pulmonary arterial hypertension. Health Qual Life Outcomes. 2013, 11: 31-10.1186/1477-7525-11-31.CrossRefPubMedPubMedCentral
27.
go back to reference Van der Lucht F, Polder JJ: Rijksinstituut voor Volksgezondheid en Milieu RIVM. Towards Better Health: The Dutch 2010 Public Health Status and Forecasts Report. 2010 Van der Lucht F, Polder JJ: Rijksinstituut voor Volksgezondheid en Milieu RIVM. Towards Better Health: The Dutch 2010 Public Health Status and Forecasts Report. 2010
28.
go back to reference Cella D, Riley W, Stone A, Rothrock N, Reeve B, Yount S, Amtmann D, Bode R, Buysse D, Choi S, Cook K, Devellis R, DeWalt D, Fries JF, Gershon R, Hahn EA, Lai JS, Pilkonis P, Revicki D, Rose M, Weinfurt K, Hays R: The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. J Clin Epidemiol. 2010, 63: 1179-1194. 10.1016/j.jclinepi.2010.04.011.CrossRefPubMedPubMedCentral Cella D, Riley W, Stone A, Rothrock N, Reeve B, Yount S, Amtmann D, Bode R, Buysse D, Choi S, Cook K, Devellis R, DeWalt D, Fries JF, Gershon R, Hahn EA, Lai JS, Pilkonis P, Revicki D, Rose M, Weinfurt K, Hays R: The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. J Clin Epidemiol. 2010, 63: 1179-1194. 10.1016/j.jclinepi.2010.04.011.CrossRefPubMedPubMedCentral
29.
go back to reference Weenink JW, van Lieshout J, Jung HP, Wensing M: Patient Care Teams in treatment of diabetes and chronic heart failure in primary care: an observational networks study. Implement Sci. 2011, 6: 66-10.1186/1748-5908-6-66.CrossRefPubMedPubMedCentral Weenink JW, van Lieshout J, Jung HP, Wensing M: Patient Care Teams in treatment of diabetes and chronic heart failure in primary care: an observational networks study. Implement Sci. 2011, 6: 66-10.1186/1748-5908-6-66.CrossRefPubMedPubMedCentral
30.
go back to reference Jansink R, Braspenning J, Keizer E, van der Weijden T, Elwyn G, Grol R: No identifiable Hb1Ac or lifestyle change after a comprehensive diabetes programme including motivational interviewing: a cluster randomised trial. Scand J Prim Health Care. 2013, 31: 119-127. 10.3109/02813432.2013.797178.CrossRefPubMedPubMedCentral Jansink R, Braspenning J, Keizer E, van der Weijden T, Elwyn G, Grol R: No identifiable Hb1Ac or lifestyle change after a comprehensive diabetes programme including motivational interviewing: a cluster randomised trial. Scand J Prim Health Care. 2013, 31: 119-127. 10.3109/02813432.2013.797178.CrossRefPubMedPubMedCentral
31.
go back to reference Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, Cooper R, Felix LM, Pratap S: Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev. 2009, 3: MR000008-PubMed Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, Cooper R, Felix LM, Pratap S: Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev. 2009, 3: MR000008-PubMed
32.
go back to reference Kringos DS, Boerma WG, Hutchinson A, van der Zee J, Groenewegen PP: The breadth of primary care: a systematic literature review of its core dimensions. BMC Health Serv Res. 2010, 10: 65-10.1186/1472-6963-10-65.CrossRefPubMedPubMedCentral Kringos DS, Boerma WG, Hutchinson A, van der Zee J, Groenewegen PP: The breadth of primary care: a systematic literature review of its core dimensions. BMC Health Serv Res. 2010, 10: 65-10.1186/1472-6963-10-65.CrossRefPubMedPubMedCentral
33.
go back to reference Konig HH, Born A, Gunther O, Matschinger H, Heinrich S, Riedel-Heller SG, Angermeyer MC, Roick C: Validity and responsiveness of the EQ-5D in assessing and valuing health status in patients with anxiety disorders. Health Qual Life Outcomes. 2010, 8: 47-10.1186/1477-7525-8-47.CrossRefPubMedPubMedCentral Konig HH, Born A, Gunther O, Matschinger H, Heinrich S, Riedel-Heller SG, Angermeyer MC, Roick C: Validity and responsiveness of the EQ-5D in assessing and valuing health status in patients with anxiety disorders. Health Qual Life Outcomes. 2010, 8: 47-10.1186/1477-7525-8-47.CrossRefPubMedPubMedCentral
34.
go back to reference Brettschneider C, Konig HH, Herzog W, Kaufmann C, Schaefert R, Konnopka A: Validity and responsiveness of the EQ-5D in assessing and valuing health status in patients with somatoform disorders. Health Qual Life Outcomes. 2013, 11: 3-10.1186/1477-7525-11-3.CrossRefPubMedPubMedCentral Brettschneider C, Konig HH, Herzog W, Kaufmann C, Schaefert R, Konnopka A: Validity and responsiveness of the EQ-5D in assessing and valuing health status in patients with somatoform disorders. Health Qual Life Outcomes. 2013, 11: 3-10.1186/1477-7525-11-3.CrossRefPubMedPubMedCentral
35.
go back to reference Ozvacic Adzic Z, Katic M, Kern J, Lazic D, Cerovecki Nekic V, Soldo D: Patient, physician, and practice characteristics related to patient enablement in general practice in Croatia: cross-sectional survey study. Croat Med J. 2008, 49: 813-823. 10.3325/cmj.2008.49.813.CrossRefPubMed Ozvacic Adzic Z, Katic M, Kern J, Lazic D, Cerovecki Nekic V, Soldo D: Patient, physician, and practice characteristics related to patient enablement in general practice in Croatia: cross-sectional survey study. Croat Med J. 2008, 49: 813-823. 10.3325/cmj.2008.49.813.CrossRefPubMed
36.
go back to reference Redekop WK, Koopmanschap MA, Stolk RP, Rutten GEHM, Wolffenbuttel BHR, Niessen LW: Health-related quality of life and treatment satisfaction in Dutch patients with type 2 diabetes. Diabetes Care. 2002, 25: 458-463. 10.2337/diacare.25.3.458.CrossRefPubMed Redekop WK, Koopmanschap MA, Stolk RP, Rutten GEHM, Wolffenbuttel BHR, Niessen LW: Health-related quality of life and treatment satisfaction in Dutch patients with type 2 diabetes. Diabetes Care. 2002, 25: 458-463. 10.2337/diacare.25.3.458.CrossRefPubMed
Metadata
Title
Patient reported outcome measures (PROMs) in primary care: an observational pilot study of seven generic instruments
Authors
Jan-Willem Weenink
Jozé Braspenning
Michel Wensing
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Primary Care / Issue 1/2014
Electronic ISSN: 2731-4553
DOI
https://doi.org/10.1186/1471-2296-15-88

Other articles of this Issue 1/2014

BMC Primary Care 1/2014 Go to the issue