Skip to main content
Top
Published in: BMC Primary Care 1/2018

Open Access 01-12-2018 | Research article

Patient understanding of two commonly used patient reported outcome measures for primary care: a cognitive interview study

Authors: Mairead Murphy, Sandra Hollinghurst, Chris Salisbury

Published in: BMC Primary Care | Issue 1/2018

Login to get access

Abstract

Background

Standardised generic patient-reported outcome measures (PROMs) which measure health status are often unresponsive to change in primary care. Alternative formats, which have been used to increase responsiveness, include individualised PROMs (in which respondents specify the outcomes of interest in their own words) and transitional PROMs (in which respondents directly rate change over a period). The objective of this study was to test qualitatively, through cognitive interviews, two PROMs, one using each respective format.

Methods

The individualised PROM selected was the Measure Yourself Medical Outcomes Profile (MYMOP). The transitional PROM was the Patient Enablement Instrument (PEI). Twenty patients who had recently attended the GP were interviewed while completing the questionnaires. Interview data was analysed using a modification of Tourangeau’s model of cognitive processing: comprehension, response, recall and face validity.

Results

Patients found the PEI simple to complete, but for some it lacked face validity. The transitional scale was sometimes confused with a status scale and was problematic in situations when the relevant GP appointment was part of a longer episode of care. Some patients reported a high enablement score despite verbally reporting low enablement but high regard for their GP, which suggested hypothesis-guessing. The interpretation of the PEI items was inconsistent between patients.
MYMOP was more difficult for patients to complete, but had greater face validity than the PEI. The scale used was open to response-shift: some patients suggested they would recalibrate their definition of the scale endpoints as their illness and expectations changed.

Conclusions

The study provides information for both users of PEI/MYMOP and developers of individualised and transitional questionnaires.
Users should heed the recommendation that MYMOP should be interview-administered, and this is likely to apply to other individualised scales. The PEI is open to hypothesis-guessing and may lack face-validity for a longer episode of care (e.g. in patients with chronic conditions). Developers should be cognisant that transitional scales can be inconsistently completed: some patients forget during completion that they are measuring change from baseline. Although generic questionnaires require the content to be more general than do disease-specific questionnaires, developers should avoid questions which allow broad and varied interpretations.
Appendix
Available only for authorised users
Literature
1.
go back to reference Black N. Patient reported outcome measures could help transform healthcare. Br Med J. 2013;346:f167.CrossRef Black N. Patient reported outcome measures could help transform healthcare. Br Med J. 2013;346:f167.CrossRef
2.
go back to reference Heath I, et al. Quality in primary health care: a multidimensional approach to complexity. Br Med J. 2009;338:b1242.CrossRef Heath I, et al. Quality in primary health care: a multidimensional approach to complexity. Br Med J. 2009;338:b1242.CrossRef
3.
go back to reference Mokkink LB, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737–45.CrossRef Mokkink LB, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737–45.CrossRef
4.
go back to reference Salisbury C, et al. The content of general practice consultations: cross-sectional study based on video recordings. Br J Gen Pract. 2013;63(616):751–9.CrossRef Salisbury C, et al. The content of general practice consultations: cross-sectional study based on video recordings. Br J Gen Pract. 2013;63(616):751–9.CrossRef
5.
go back to reference Salisbury C, et al. Epidemiology and impact of multimorbidity in primary care: a retrospective cohort study. Br J Gen Pract. 2011;61(582):e12–21.CrossRef Salisbury C, et al. Epidemiology and impact of multimorbidity in primary care: a retrospective cohort study. Br J Gen Pract. 2011;61(582):e12–21.CrossRef
6.
go back to reference Ware JE Jr, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992;30(6):473–83.CrossRef Ware JE Jr, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992;30(6):473–83.CrossRef
7.
go back to reference Brooks R. EuroQol: the current state of play. Health Policy. 1996;37(1):53–72.CrossRef Brooks R. EuroQol: the current state of play. Health Policy. 1996;37(1):53–72.CrossRef
8.
go back to reference Venning P, et al. Randomised controlled trial comparing cost effectiveness of general practitioners and nurse practitioners in primary care. Br Med J. 2000;320(7241):1048–53.CrossRef Venning P, et al. Randomised controlled trial comparing cost effectiveness of general practitioners and nurse practitioners in primary care. Br Med J. 2000;320(7241):1048–53.CrossRef
9.
go back to reference McKinley RK, et al. Comparison of out of hours care provided by patients' own general practitioners and commercial deputising services: a randomised controlled trial. II: the outcome of care. Br Med J. 1997;314(7075):190–3.CrossRef McKinley RK, et al. Comparison of out of hours care provided by patients' own general practitioners and commercial deputising services: a randomised controlled trial. II: the outcome of care. Br Med J. 1997;314(7075):190–3.CrossRef
10.
go back to reference Paterson C. Measuring outcomes in primary care: a patient generated measure, MYMOP, compared with the SF-36 health survey. Br Med J. 1996;312(7037):1016–20.CrossRef Paterson C. Measuring outcomes in primary care: a patient generated measure, MYMOP, compared with the SF-36 health survey. Br Med J. 1996;312(7037):1016–20.CrossRef
11.
go back to reference Murphy M, et al. Patient and practitioners' views on the most important outcomes arising from primary care consultations: a qualitative study. BMC Fam Pract. 2015;16:108.CrossRef Murphy M, et al. Patient and practitioners' views on the most important outcomes arising from primary care consultations: a qualitative study. BMC Fam Pract. 2015;16:108.CrossRef
13.
go back to reference Murphy M, Hollinghurst S, Salisbury C. Qualitative assessment of the primary care outcomes questionnaire: a cognitive interview study. BMC Health Serv Res. 2018;18(1):79.CrossRef Murphy M, Hollinghurst S, Salisbury C. Qualitative assessment of the primary care outcomes questionnaire: a cognitive interview study. BMC Health Serv Res. 2018;18(1):79.CrossRef
14.
go back to reference Murphy M, et al. Primary care outcomes questionnaire: psychometric testing of a new instrument. Br J gen Pract. 2018;68(671):e433–40.CrossRef Murphy M, et al. Primary care outcomes questionnaire: psychometric testing of a new instrument. Br J gen Pract. 2018;68(671):e433–40.CrossRef
15.
go back to reference Howie JG, et al. Quality at general practice consultations: cross sectional survey. Br Med J. 1999;319(7212):738–43.CrossRef Howie JG, et al. Quality at general practice consultations: cross sectional survey. Br Med J. 1999;319(7212):738–43.CrossRef
16.
go back to reference Haddad S, et al. Patient perception of quality following a visit to a doctor in a primary care unit. Fam Pract. 2000;17(1):21–9.CrossRef Haddad S, et al. Patient perception of quality following a visit to a doctor in a primary care unit. Fam Pract. 2000;17(1):21–9.CrossRef
17.
go back to reference Schwarz N. Cognitive aspects of survey methodology. Appl Cogn Psychol. 2007;21(2):277–87.CrossRef Schwarz N. Cognitive aspects of survey methodology. Appl Cogn Psychol. 2007;21(2):277–87.CrossRef
18.
go back to reference Tourangeau, R., Cognitive sciences and survey methods., in Cognitive Aspects of Survey Methodology: Building a Bridge Between Disciplines, T. Jabine, et al., editors. 1984: Washington, DC, National Academy Press. p. 73–100. Tourangeau, R., Cognitive sciences and survey methods., in Cognitive Aspects of Survey Methodology: Building a Bridge Between Disciplines, T. Jabine, et al., editors. 1984: Washington, DC, National Academy Press. p. 73–100.
19.
go back to reference Willis, G., Cognitive Interviewing - A How To Guide. 1999, Research Triangle Institute. Willis, G., Cognitive Interviewing - A How To Guide. 1999, Research Triangle Institute.
20.
go back to reference Patrick DL, et al. Content validity—establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 2—assessing respondent understanding. Value Health. 2011;14(8):978–88.CrossRef Patrick DL, et al. Content validity—establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 2—assessing respondent understanding. Value Health. 2011;14(8):978–88.CrossRef
21.
go back to reference Kamper SJ, Maher CG, Mackay G. Global rating of change scales: a review of strengths and weaknesses and considerations for design. J Man Manip Ther. 2009;17(3):163–70.CrossRef Kamper SJ, Maher CG, Mackay G. Global rating of change scales: a review of strengths and weaknesses and considerations for design. J Man Manip Ther. 2009;17(3):163–70.CrossRef
23.
go back to reference NIHR, UK clinical research network : portfolio database: primary care outcomes study. 2013. NIHR, UK clinical research network : portfolio database: primary care outcomes study. 2013.
24.
go back to reference Pawlikowska TR, et al. Patient involvement in assessing consultation quality: a quantitative study of the patient enablement instrument in Poland. Health Expect. 2010;13(1):13–23.CrossRef Pawlikowska TR, et al. Patient involvement in assessing consultation quality: a quantitative study of the patient enablement instrument in Poland. Health Expect. 2010;13(1):13–23.CrossRef
25.
go back to reference Lam CL, et al. A pilot study on the validity and reliability of the patient enablement instrument (PEI) in a Chinese population. Fam Pract. 2010;27(4):395–403.CrossRef Lam CL, et al. A pilot study on the validity and reliability of the patient enablement instrument (PEI) in a Chinese population. Fam Pract. 2010;27(4):395–403.CrossRef
26.
go back to reference Small N, et al. Patient empowerment in long-term conditions: development and preliminary testing of a new measure. BMC Health Serv Res. 2013;13:263.CrossRef Small N, et al. Patient empowerment in long-term conditions: development and preliminary testing of a new measure. BMC Health Serv Res. 2013;13:263.CrossRef
27.
go back to reference Mead N, Bower P, Roland M. Factors associated with enablement in general practice: cross-sectional study using routinely-collected data. Br J Gen Pract. 2008;58(550):346–52.CrossRef Mead N, Bower P, Roland M. Factors associated with enablement in general practice: cross-sectional study using routinely-collected data. Br J Gen Pract. 2008;58(550):346–52.CrossRef
28.
go back to reference Howie JG, et al. A comparison of a patient enablement instrument (PEI) against two established satisfaction scales as an outcome measure of primary care consultations. Fam Pract. 1998;15(2):165–71.CrossRef Howie JG, et al. A comparison of a patient enablement instrument (PEI) against two established satisfaction scales as an outcome measure of primary care consultations. Fam Pract. 1998;15(2):165–71.CrossRef
29.
go back to reference Dowell J, et al. A randomised controlled trial of delayed antibiotic prescribing as a strategy for managing uncomplicated respiratory tract infection in primary care. Br J Gen Pract. 2001;51(464):200–5.PubMedPubMedCentral Dowell J, et al. A randomised controlled trial of delayed antibiotic prescribing as a strategy for managing uncomplicated respiratory tract infection in primary care. Br J Gen Pract. 2001;51(464):200–5.PubMedPubMedCentral
30.
go back to reference Ruta DA, et al. A new approach to the measurement of quality-of-life - the patient-generated index. Med Care. 1994;32(11):1109–26.CrossRef Ruta DA, et al. A new approach to the measurement of quality-of-life - the patient-generated index. Med Care. 1994;32(11):1109–26.CrossRef
31.
go back to reference Bowling A. Measuring Health: A review of quality of life measurement scales, vol. 1. 3rd ed. Maidenhead, Berkshire: Open University Press; 2004. Bowling A. Measuring Health: A review of quality of life measurement scales, vol. 1. 3rd ed. Maidenhead, Berkshire: Open University Press; 2004.
32.
go back to reference MacDuff C, Russell EM. The problem of measuring change in individual health-related quality of life by postal questionnaire: use of the patient-generated index in a disabled population. Qual Life Res. 1998;7(8):761–9.CrossRef MacDuff C, Russell EM. The problem of measuring change in individual health-related quality of life by postal questionnaire: use of the patient-generated index in a disabled population. Qual Life Res. 1998;7(8):761–9.CrossRef
33.
go back to reference Patel KK, Veenstra DL, Patrick DL. A review of selected patient-generated outcome measures and their application in clinical trials. Value Health. 2003;6(5):595–603.CrossRef Patel KK, Veenstra DL, Patrick DL. A review of selected patient-generated outcome measures and their application in clinical trials. Value Health. 2003;6(5):595–603.CrossRef
34.
go back to reference Jenkinson C. MYMOP, a patient generated measure of outcomes. Research into outcomes has moved away from symptom based assessments. Br Med J. 1996;313(7057):626 author reply 627.CrossRef Jenkinson C. MYMOP, a patient generated measure of outcomes. Research into outcomes has moved away from symptom based assessments. Br Med J. 1996;313(7057):626 author reply 627.CrossRef
35.
go back to reference Ruta D, Garratt A. MYMOP, a patient generated measure of outcomes. Reliability of such instruments needs to be proved. Br Med J. 1996;313(7057):626–7.CrossRef Ruta D, Garratt A. MYMOP, a patient generated measure of outcomes. Reliability of such instruments needs to be proved. Br Med J. 1996;313(7057):626–7.CrossRef
36.
go back to reference McClean S, Brilleman S, Wye L. What is the perceived impact of Alexander technique lessons on health status, costs and pain management in the real life setting of an English hospital? The results of a mixed methods evaluation of an Alexander technique service for those with chronic back pain. BMC Health Serv Res. 2015;15:293.CrossRef McClean S, Brilleman S, Wye L. What is the perceived impact of Alexander technique lessons on health status, costs and pain management in the real life setting of an English hospital? The results of a mixed methods evaluation of an Alexander technique service for those with chronic back pain. BMC Health Serv Res. 2015;15:293.CrossRef
37.
go back to reference Thompson E, Viksveen P, Barron S. A patient reported outcome measure in homeopathic clinical practice for long-term conditions. Homeopathy. 2016;105(4):309–17.CrossRef Thompson E, Viksveen P, Barron S. A patient reported outcome measure in homeopathic clinical practice for long-term conditions. Homeopathy. 2016;105(4):309–17.CrossRef
38.
go back to reference Krug K, et al. Complementary and alternative medicine (CAM) as part of primary health care in Germany-comparison of patients consulting general practitioners and CAM practitioners: a cross-sectional study. BMC Complement Altern Med. 2016;16(1):409.CrossRef Krug K, et al. Complementary and alternative medicine (CAM) as part of primary health care in Germany-comparison of patients consulting general practitioners and CAM practitioners: a cross-sectional study. BMC Complement Altern Med. 2016;16(1):409.CrossRef
39.
go back to reference Salisbury C, et al. Effectiveness of PhysioDirect telephone assessment and advice services for patients with musculoskeletal problems: pragmatic randomised controlled trial. Br Med J. 2013;346(jan29 3):f43.CrossRef Salisbury C, et al. Effectiveness of PhysioDirect telephone assessment and advice services for patients with musculoskeletal problems: pragmatic randomised controlled trial. Br Med J. 2013;346(jan29 3):f43.CrossRef
40.
go back to reference Flower A, Lewith GT, Little P. A feasibility study exploring the role of Chinese herbal medicine in the treatment of endometriosis. J Altern Complement Med. 2011;17(8):691–9.CrossRef Flower A, Lewith GT, Little P. A feasibility study exploring the role of Chinese herbal medicine in the treatment of endometriosis. J Altern Complement Med. 2011;17(8):691–9.CrossRef
42.
go back to reference Beatty PC, Willis GB. Research synthesis: the practice of cognitive interviewing. Public Opinion Quarterly. 2007;71(2):287–311.CrossRef Beatty PC, Willis GB. Research synthesis: the practice of cognitive interviewing. Public Opinion Quarterly. 2007;71(2):287–311.CrossRef
43.
go back to reference Horwood J, et al. Listening to patients: using verbal data in the validation of the Aberdeen measures of impairment, activity limitation and participation restriction (ab-IAP). BMC Musculoskelet Disord. 2010;11:182.CrossRef Horwood J, et al. Listening to patients: using verbal data in the validation of the Aberdeen measures of impairment, activity limitation and participation restriction (ab-IAP). BMC Musculoskelet Disord. 2010;11:182.CrossRef
45.
go back to reference Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57.CrossRef Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57.CrossRef
46.
go back to reference Fitzpatrick R, et al. Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess. 1998;2(14): p. i-iv):1–74.PubMed Fitzpatrick R, et al. Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess. 1998;2(14): p. i-iv):1–74.PubMed
47.
go back to reference Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. New York: Oxford University Press; 2008.CrossRef Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. New York: Oxford University Press; 2008.CrossRef
48.
go back to reference Haggerty JL. Are measures of patient satisfaction hopelessly flawed? Br Med J. 2010;341:c4783.CrossRef Haggerty JL. Are measures of patient satisfaction hopelessly flawed? Br Med J. 2010;341:c4783.CrossRef
49.
go back to reference Osborne RH, Hawkins M, Sprangers MA. Change of perspective: a measurable and desired outcome of chronic disease self-management intervention programs that violates the premise of preintervention/postintervention assessment. Arthritis & Rheumatology. 2006;55(3):458–65.CrossRef Osborne RH, Hawkins M, Sprangers MA. Change of perspective: a measurable and desired outcome of chronic disease self-management intervention programs that violates the premise of preintervention/postintervention assessment. Arthritis & Rheumatology. 2006;55(3):458–65.CrossRef
50.
go back to reference Herrmann D. Reporting current, past, and changed health status. What we know about distortion. Med Care. 1995;33(4 Suppl):AS89–94.PubMed Herrmann D. Reporting current, past, and changed health status. What we know about distortion. Med Care. 1995;33(4 Suppl):AS89–94.PubMed
51.
go back to reference Haughney J, et al. The use of a modification of the patient enablement instrument in asthma. Prim Care Respir J. 2007;16(2):89–92.CrossRef Haughney J, et al. The use of a modification of the patient enablement instrument in asthma. Prim Care Respir J. 2007;16(2):89–92.CrossRef
52.
go back to reference Reade S, et al. Cloudy with a chance of pain: engagement and subsequent attrition of daily data entry in a smartphone pilot study tracking weather, disease severity, and physical activity in patients with rheumatoid arthritis. JMIR Mhealth Uhealth. 2017;5(3):e37.CrossRef Reade S, et al. Cloudy with a chance of pain: engagement and subsequent attrition of daily data entry in a smartphone pilot study tracking weather, disease severity, and physical activity in patients with rheumatoid arthritis. JMIR Mhealth Uhealth. 2017;5(3):e37.CrossRef
53.
go back to reference Veer, S.V.D., et al., FRI0175 Using smartphones to improve remote monitoring of rheumatoid arthritis: completeness of patients' symptom reports, in Annals of the Rheumatic Diseases 2017. p. 547.1–54547. Veer, S.V.D., et al., FRI0175 Using smartphones to improve remote monitoring of rheumatoid arthritis: completeness of patients' symptom reports, in Annals of the Rheumatic Diseases 2017. p. 547.1–54547.
54.
go back to reference Paterson C. Measuring changes in self-concept: a qualitative evaluation of outcome questionnaires in people having acupuncture for their chronic health problems. BMC Complement Altern Med. 2006;6:7.CrossRef Paterson C. Measuring changes in self-concept: a qualitative evaluation of outcome questionnaires in people having acupuncture for their chronic health problems. BMC Complement Altern Med. 2006;6:7.CrossRef
55.
go back to reference Mallinson S. Listening to respondents: a qualitative assessment of the short-form 36 health status questionnaire. Soc Sci Med. 2002;54(1):11–21.CrossRef Mallinson S. Listening to respondents: a qualitative assessment of the short-form 36 health status questionnaire. Soc Sci Med. 2002;54(1):11–21.CrossRef
56.
go back to reference de Jong M, et al. The quality of working life questionnaire for Cancer survivors (QWLQ-CS): a pre-test study. BMC Health Serv Res. 2016;16:194.CrossRef de Jong M, et al. The quality of working life questionnaire for Cancer survivors (QWLQ-CS): a pre-test study. BMC Health Serv Res. 2016;16:194.CrossRef
57.
go back to reference Mercer SW, et al. Patient enablement requires physician empathy: a cross-sectional study of general practice consultations in areas of high and low socioeconomic deprivation in Scotland. BMC Fam Pract. 2012;13:6.CrossRef Mercer SW, et al. Patient enablement requires physician empathy: a cross-sectional study of general practice consultations in areas of high and low socioeconomic deprivation in Scotland. BMC Fam Pract. 2012;13:6.CrossRef
58.
go back to reference Brusse CJ, Yen LE. Preferences, predictions and patient enablement: a preliminary study. BMC Fam Pract. 2013;14:116.CrossRef Brusse CJ, Yen LE. Preferences, predictions and patient enablement: a preliminary study. BMC Fam Pract. 2013;14:116.CrossRef
59.
go back to reference Wensing M, et al. The patients assessment chronic illness care (PACIC) questionnaire in the Netherlands: a validation study in rural general practice. BMC Health Serv Res. 2008;8:182.CrossRef Wensing M, et al. The patients assessment chronic illness care (PACIC) questionnaire in the Netherlands: a validation study in rural general practice. BMC Health Serv Res. 2008;8:182.CrossRef
60.
go back to reference O'Boyle CA, et al. Individual quality of life in patients undergoing hip replacement. Lancet. 1992;339(8801):1088–91.CrossRef O'Boyle CA, et al. Individual quality of life in patients undergoing hip replacement. Lancet. 1992;339(8801):1088–91.CrossRef
61.
go back to reference Fortin M, et al. Prevalence of multimorbidity among adults seen in family practice. Ann Fam Med. 2005;3(3):223–8.CrossRef Fortin M, et al. Prevalence of multimorbidity among adults seen in family practice. Ann Fam Med. 2005;3(3):223–8.CrossRef
62.
go back to reference Barnett K, et al. Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. Lancet. 2012;380(9836):37–43.CrossRef Barnett K, et al. Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. Lancet. 2012;380(9836):37–43.CrossRef
63.
go back to reference Peters M, et al. Pilot study of patient reported outcome measures (PROMs) in primary care: report to the Department of Health. Oxford: University of Oxford, Department of Public Health; 2013. Peters M, et al. Pilot study of patient reported outcome measures (PROMs) in primary care: report to the Department of Health. Oxford: University of Oxford, Department of Public Health; 2013.
64.
go back to reference Paterson, C. University of Bristol, CAPC Wesite: MYMOP. 2012 [cited 2014 05/01/2014]. Paterson, C. University of Bristol, CAPC Wesite: MYMOP. 2012 [cited 2014 05/01/2014].
Metadata
Title
Patient understanding of two commonly used patient reported outcome measures for primary care: a cognitive interview study
Authors
Mairead Murphy
Sandra Hollinghurst
Chris Salisbury
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Primary Care / Issue 1/2018
Electronic ISSN: 2731-4553
DOI
https://doi.org/10.1186/s12875-018-0850-2

Other articles of this Issue 1/2018

BMC Primary Care 1/2018 Go to the issue