Skip to main content
Top
Published in: BMC Cancer 1/2024

Open Access 01-12-2024 | Research

Development and validation of a patient reported experience measure for experimental cancer medicines (PREM-ECM) and their carers (PREM-ECM-Carer)

Authors: Chelsea S. Sawyer, Sally Taylor, Louise Carter, Melissa Stanworth, Michelle Davies, Fiona Thistlethwaite, Jo Taylor, Charlotte Eastwood, Janelle Yorke

Published in: BMC Cancer | Issue 1/2024

Login to get access

Abstract

Background

Our aim was to develop a validated Patient Reported Experience Measure (PREM) to capture patient and carer experience during participation in experimental cancer medicine trials (ECM): called PREM-ECM.

Methods

Mixed method design, consisting of four stages. Questionnaire items were produced for both patients and carers using interviews, focus groups, and cognitive interviews with patients and carers separately. For both patient and carer PREMs, a cross-sectional questionnaire study was conducted to identify final items for inclusion using hierarchical item reduction and Rasch analysis. Questionnaire validity and reliability were assessed, including administration feasibility.

Results

Initial interview participants suggested the need for three PREMs, two specific to patients: (i) a ‘prior’ questionnaire that captured experiences of trial introduction, screening, consenting, and early trial experience (< 6 weeks post consent); and (ii) ‘on-trial’ that captured experiences of ongoing consent and trial participation; and (iii) a PREM specific for carers. The draft 25-item ‘prior’ questionnaire was completed by 162 patients and 162 patients completed the draft 35-item ‘on-trial’ questionnaire. Hierarchical and Rasch analysis produced a 14-item ‘prior’ list and a 15-item list for ‘on-trial’. Both patient PREM’s demonstrated a good fit to the Rasch model following Bonferroni correction (X2p = 0.008). The carer 34-draft item questionnaire was completed by 102 participants. Hierarchical and Rasch analysis produced a 13-item list for PREM-ECM-Carer, with good fit to the Rasch model ( X2p = 0.62). The pilot testing demonstrated the feasibility of all the PREMs in capturing patient and caregiver experiences in routine clinical settings.

Conclusions

The three PREM-ECM questionnaires will be the first validated experience measures for ECM trial patients and their carers. These questionnaires may be used to assess patients’ and their carers’ experiences of ECM and enable robust comparisons across cancer trial units highlighting areas for service improvement.
Appendix
Available only for authorised users
Literature
1.
go back to reference Unger JM, Cook E, Tai E, Bleyer A. The role of clinical trial participation in cancer research: barriers, evidence, and strategies. Am Soc Clin Oncol Educational Book. 2016;36:185–98.CrossRef Unger JM, Cook E, Tai E, Bleyer A. The role of clinical trial participation in cancer research: barriers, evidence, and strategies. Am Soc Clin Oncol Educational Book. 2016;36:185–98.CrossRef
2.
go back to reference Friedman LM, Furberg CD, DeMets DL, Reboussin DM, Granger CB. Introduction to clinical trials. Fundamentals of clinical trials: Springer; 2015. pp. 1–23. Friedman LM, Furberg CD, DeMets DL, Reboussin DM, Granger CB. Introduction to clinical trials. Fundamentals of clinical trials: Springer; 2015. pp. 1–23.
3.
go back to reference Mahipal A, Nguyen D. Risks and benefits of phase 1 clinical trial participation. Cancer Control. 2014;21(3):193–9.CrossRefPubMed Mahipal A, Nguyen D. Risks and benefits of phase 1 clinical trial participation. Cancer Control. 2014;21(3):193–9.CrossRefPubMed
4.
go back to reference Cox K. Researching research: patients’ experiences of participation in phase I and II anti-cancer drug trials. Eur J Oncol Nurs. 1999;3(3):143–52.CrossRef Cox K. Researching research: patients’ experiences of participation in phase I and II anti-cancer drug trials. Eur J Oncol Nurs. 1999;3(3):143–52.CrossRef
5.
go back to reference Cox K, Moghaddam N, Bird L, Elkan R. Feedback of trial results to participants: a survey of clinicians’ and patients’ attitudes and experiences. Eur J Oncol Nurs. 2011;15(2):124–9.CrossRefPubMedPubMedCentral Cox K, Moghaddam N, Bird L, Elkan R. Feedback of trial results to participants: a survey of clinicians’ and patients’ attitudes and experiences. Eur J Oncol Nurs. 2011;15(2):124–9.CrossRefPubMedPubMedCentral
6.
go back to reference Sawyer C, Preston L, Taylor S, Davies M, Carter L, Krebs M et al. Oncology patients’ experiences in experimental medicine cancer trials: a qualitative study. 2021. Sawyer C, Preston L, Taylor S, Davies M, Carter L, Krebs M et al. Oncology patients’ experiences in experimental medicine cancer trials: a qualitative study. 2021.
7.
go back to reference Adashek JJ, LoRusso PM, Hong DS, Kurzrock R. Phase I trials as valid therapeutic options for patients with cancer. Nat Reviews Clin Oncol. 2019;16(12):773–8.CrossRef Adashek JJ, LoRusso PM, Hong DS, Kurzrock R. Phase I trials as valid therapeutic options for patients with cancer. Nat Reviews Clin Oncol. 2019;16(12):773–8.CrossRef
8.
go back to reference Kessler ER, Moss A, Eckhardt SG, Laudenslager ML, Kilbourn K, Mauss IB, et al. Distress among caregivers of phase I trial participants: a cross-sectional study. Support Care Cancer. 2014;22:3331–40.CrossRefPubMedPubMedCentral Kessler ER, Moss A, Eckhardt SG, Laudenslager ML, Kilbourn K, Mauss IB, et al. Distress among caregivers of phase I trial participants: a cross-sectional study. Support Care Cancer. 2014;22:3331–40.CrossRefPubMedPubMedCentral
9.
go back to reference Rossi Ferrario S, Zotti AM, Massara G, Nuvolone G. A comparative assessment of psychological and psychosocial characteristics of cancer patients and their caregivers. Psycho-Oncology: J Psychol Social Behav Dimensions Cancer. 2003;12(1):1–7.CrossRef Rossi Ferrario S, Zotti AM, Massara G, Nuvolone G. A comparative assessment of psychological and psychosocial characteristics of cancer patients and their caregivers. Psycho-Oncology: J Psychol Social Behav Dimensions Cancer. 2003;12(1):1–7.CrossRef
10.
go back to reference Woźniak K, Iżycki D. Cancer: a family at risk. Menopause Review/Przegląd Menopauzalny. 2014;13(4):253–61.PubMed Woźniak K, Iżycki D. Cancer: a family at risk. Menopause Review/Przegląd Menopauzalny. 2014;13(4):253–61.PubMed
11.
go back to reference Lee HJ, Park E-C, Seung Ju K, Lee SG. Quality of life of family members living with cancer patients. 2015. Lee HJ, Park E-C, Seung Ju K, Lee SG. Quality of life of family members living with cancer patients. 2015.
12.
go back to reference Northouse LL, Katapodi MC, Schafenacker AM, Weiss D, editors. The impact of caregiving on the psychological well-being of family caregivers and cancer patients. Seminars in oncology nursing. Elsevier; 2012. Northouse LL, Katapodi MC, Schafenacker AM, Weiss D, editors. The impact of caregiving on the psychological well-being of family caregivers and cancer patients. Seminars in oncology nursing. Elsevier; 2012.
14.
go back to reference Whelan PJ, Reddy L, Andrews T. Patient satisfaction rating scales v. patient-related outcome and experience measures. Psychiatrist. 2011;35(1):32–3.CrossRef Whelan PJ, Reddy L, Andrews T. Patient satisfaction rating scales v. patient-related outcome and experience measures. Psychiatrist. 2011;35(1):32–3.CrossRef
16.
go back to reference Weldring T, Smith SM. Article commentary: patient-reported outcomes (pros) and patient-reported outcome measures (PROMs). Health Serv Insights. 2013;6:HSI. Weldring T, Smith SM. Article commentary: patient-reported outcomes (pros) and patient-reported outcome measures (PROMs). Health Serv Insights. 2013;6:HSI.
17.
go back to reference Harrison R, Raman M, Walpola RL, Chauhan A, Sansom-Daly UM. Preparing for partnerships in cancer care: an explorative analysis of the role of family-based caregivers. BMC Health Serv Res. 2021;21:1–10.CrossRef Harrison R, Raman M, Walpola RL, Chauhan A, Sansom-Daly UM. Preparing for partnerships in cancer care: an explorative analysis of the role of family-based caregivers. BMC Health Serv Res. 2021;21:1–10.CrossRef
18.
go back to reference Paidipati CP, Foxwell AM, Mooney-Doyle K, Tiller D, Pinto-Martin J, Ulrich CM. Caregiver perspectives on the benefits, burdens, and moral distress of participation in cancer clinical trials. J Fam Nurs. 2023;29(1):89–98.CrossRefPubMed Paidipati CP, Foxwell AM, Mooney-Doyle K, Tiller D, Pinto-Martin J, Ulrich CM. Caregiver perspectives on the benefits, burdens, and moral distress of participation in cancer clinical trials. J Fam Nurs. 2023;29(1):89–98.CrossRefPubMed
19.
go back to reference Steine S, Finset A, Laerum E. A new, brief questionnaire (PEQ) developed in primary health care for measuring patients’ experience of interaction, emotion and consultation outcome. Fam Pract. 2001;18(4):410–8.CrossRefPubMed Steine S, Finset A, Laerum E. A new, brief questionnaire (PEQ) developed in primary health care for measuring patients’ experience of interaction, emotion and consultation outcome. Fam Pract. 2001;18(4):410–8.CrossRefPubMed
20.
go back to reference Zeh S, Christalle E, Hahlweg P, Härter M, Scholl I. Assessing the relevance and implementation of patient-centredness from the patients’ perspective in Germany: results of a Delphi study. BMJ open. 2019;9(12):e031741.CrossRefPubMedPubMedCentral Zeh S, Christalle E, Hahlweg P, Härter M, Scholl I. Assessing the relevance and implementation of patient-centredness from the patients’ perspective in Germany: results of a Delphi study. BMJ open. 2019;9(12):e031741.CrossRefPubMedPubMedCentral
21.
go back to reference Walker S, Andrew S, Hodson M, Roberts CM. Stage 1 development of a patient-reported experience measure (PREM) for chronic obstructive pulmonary disease (COPD). NPJ Prim Care Respiratory Med. 2017;27(1):1–9. Walker S, Andrew S, Hodson M, Roberts CM. Stage 1 development of a patient-reported experience measure (PREM) for chronic obstructive pulmonary disease (COPD). NPJ Prim Care Respiratory Med. 2017;27(1):1–9.
22.
go back to reference Patel S, Ghimire P, Lavrador JP, Jung J, Gullan R, Ashkan K, et al. Patient-reported experience measures in patients undergoing navigated transcranial magnetic stimulation (nTMS): the introduction of nTMS-PREMs. Acta Neurochir. 2020;162(7):1673–81.CrossRefPubMed Patel S, Ghimire P, Lavrador JP, Jung J, Gullan R, Ashkan K, et al. Patient-reported experience measures in patients undergoing navigated transcranial magnetic stimulation (nTMS): the introduction of nTMS-PREMs. Acta Neurochir. 2020;162(7):1673–81.CrossRefPubMed
23.
go back to reference Hodson M, Roberts CM, Andrew S, Graham L, Jones PW, Yorke J. Development and first validation of a patient-reported experience measure in chronic obstructive pulmonary disease (PREM-C9). Thorax. 2019;74(6):600–3.CrossRefPubMed Hodson M, Roberts CM, Andrew S, Graham L, Jones PW, Yorke J. Development and first validation of a patient-reported experience measure in chronic obstructive pulmonary disease (PREM-C9). Thorax. 2019;74(6):600–3.CrossRefPubMed
24.
go back to reference Farrell C, Foy S, May A, Lee R, Gaskell C, Yorke J. Developing a patient reported experience measure (PREM) in secondary breast cancer (SBC). Ann Oncol. 2018;29:viii692–viii3.CrossRef Farrell C, Foy S, May A, Lee R, Gaskell C, Yorke J. Developing a patient reported experience measure (PREM) in secondary breast cancer (SBC). Ann Oncol. 2018;29:viii692–viii3.CrossRef
25.
go back to reference Burns K, Harle AS, Blackhall F, Fenemore J, Yorke J. 196TiP: PREM-LC: development and pilot testing of a patient reported experience measure in lung cancer. J Thorac Oncol. 2016;11(4):142.CrossRef Burns K, Harle AS, Blackhall F, Fenemore J, Yorke J. 196TiP: PREM-LC: development and pilot testing of a patient reported experience measure in lung cancer. J Thorac Oncol. 2016;11(4):142.CrossRef
26.
go back to reference Willis GB, Artino AR Jr. What do our respondents think we’re asking? Using cognitive interviewing to improve medical education surveys. J Graduate Med Educ. 2013;5(3):353–6.CrossRef Willis GB, Artino AR Jr. What do our respondents think we’re asking? Using cognitive interviewing to improve medical education surveys. J Graduate Med Educ. 2013;5(3):353–6.CrossRef
27.
28.
go back to reference Brédart A, Anota A, Young T, Tomaszewski K, Arraras JI, Moura De Albuquerque Melo H, et al. Phase III study of the European organisation for research and treatment of cancer satisfaction with cancer care core questionnaire (EORTC PATSAT-C33) and specific complementary outpatient module (EORTC OUT‐PATSAT7). Eur J Cancer Care. 2018;27(1):e12786.CrossRef Brédart A, Anota A, Young T, Tomaszewski K, Arraras JI, Moura De Albuquerque Melo H, et al. Phase III study of the European organisation for research and treatment of cancer satisfaction with cancer care core questionnaire (EORTC PATSAT-C33) and specific complementary outpatient module (EORTC OUT‐PATSAT7). Eur J Cancer Care. 2018;27(1):e12786.CrossRef
29.
go back to reference Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatrica Scandinavica. 1983;67(6):361–70.CrossRefPubMed Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatrica Scandinavica. 1983;67(6):361–70.CrossRefPubMed
30.
go back to reference Aldridge VK, Dovey TM, Wade A. Assessing test-retest reliability of psychological measures. Eur Psychol. 2017. Aldridge VK, Dovey TM, Wade A. Assessing test-retest reliability of psychological measures. Eur Psychol. 2017.
31.
go back to reference Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Res Psychol. 2006;3(2):77–101.CrossRef Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Res Psychol. 2006;3(2):77–101.CrossRef
32.
go back to reference Rasch G. Probabilistic models for some intelligence and attainment tests. Chicago: University of Chicago; 1960. Rasch G. Probabilistic models for some intelligence and attainment tests. Chicago: University of Chicago; 1960.
33.
go back to reference Maćkiewicz A, Ratajczak W. Principal components analysis (PCA). Comput Geosci. 1993;19(3):303–42.CrossRef Maćkiewicz A, Ratajczak W. Principal components analysis (PCA). Comput Geosci. 1993;19(3):303–42.CrossRef
34.
go back to reference Bartko JJ. The intraclass correlation coefficient as a measure of reliability. Psychol Rep. 1966;19(1):3–11.CrossRefPubMed Bartko JJ. The intraclass correlation coefficient as a measure of reliability. Psychol Rep. 1966;19(1):3–11.CrossRefPubMed
35.
go back to reference Doyle C, Lennox L, Bell D. A systematic review of evidence on the links between patient experience and clinical safety and effectiveness. BMJ open. 2013;3(1):e001570.CrossRefPubMedPubMedCentral Doyle C, Lennox L, Bell D. A systematic review of evidence on the links between patient experience and clinical safety and effectiveness. BMJ open. 2013;3(1):e001570.CrossRefPubMedPubMedCentral
36.
go back to reference Black N, Varaganum M, Hutchings A. Relationship between patient reported experience (PREMs) and patient reported outcomes (PROMs) in elective surgery. BMJ Qual Saf. 2014;23(7):534–42.CrossRefPubMed Black N, Varaganum M, Hutchings A. Relationship between patient reported experience (PREMs) and patient reported outcomes (PROMs) in elective surgery. BMJ Qual Saf. 2014;23(7):534–42.CrossRefPubMed
37.
go back to reference Greaves F, Jha AK. Quality and the curate’s egg. BMJ Publishing Group Ltd; 2014. pp. 525–7. Greaves F, Jha AK. Quality and the curate’s egg. BMJ Publishing Group Ltd; 2014. pp. 525–7.
38.
go back to reference Department of Health. Liberating the NHS: transparency in outcomes-a framework for the NHS. A Consultation on Proposals: Department of Health; 2010. Department of Health. Liberating the NHS: transparency in outcomes-a framework for the NHS. A Consultation on Proposals: Department of Health; 2010.
39.
go back to reference Kavalnienė R, Deksnyte A, Kasiulevičius V, Šapoka V, Aranauskas R, Aranauskas L. Patient satisfaction with primary healthcare services: are there any links with patients’ symptoms of anxiety and depression? BMC Fam Pract. 2018;19(1):1–9.CrossRef Kavalnienė R, Deksnyte A, Kasiulevičius V, Šapoka V, Aranauskas R, Aranauskas L. Patient satisfaction with primary healthcare services: are there any links with patients’ symptoms of anxiety and depression? BMC Fam Pract. 2018;19(1):1–9.CrossRef
40.
go back to reference Edwards B, Clarke V. The psychological impact of a cancer diagnosis on families: the influence of family functioning and patients’ illness characteristics on depression and anxiety. Psycho-Oncology: J Psychol Social Behav Dimensions Cancer. 2004;13(8):562–76.CrossRef Edwards B, Clarke V. The psychological impact of a cancer diagnosis on families: the influence of family functioning and patients’ illness characteristics on depression and anxiety. Psycho-Oncology: J Psychol Social Behav Dimensions Cancer. 2004;13(8):562–76.CrossRef
41.
go back to reference Park B, Kim SY, Shin J-Y, Sanson-Fisher RW, Shin DW, Cho J, et al. Prevalence and predictors of anxiety and depression among family caregivers of cancer patients: a nationwide survey of patient–family caregiver dyads in Korea. Support Care Cancer. 2013;21:2799–807.CrossRefPubMed Park B, Kim SY, Shin J-Y, Sanson-Fisher RW, Shin DW, Cho J, et al. Prevalence and predictors of anxiety and depression among family caregivers of cancer patients: a nationwide survey of patient–family caregiver dyads in Korea. Support Care Cancer. 2013;21:2799–807.CrossRefPubMed
42.
go back to reference Chang H-Y, Chiou C-J, Chen N-S. Impact of mental health and caregiver burden on family caregivers’ physical health. Arch Gerontol Geriatr. 2010;50(3):267–71.CrossRefPubMed Chang H-Y, Chiou C-J, Chen N-S. Impact of mental health and caregiver burden on family caregivers’ physical health. Arch Gerontol Geriatr. 2010;50(3):267–71.CrossRefPubMed
43.
go back to reference Ochoa CY, Lunsford NB, Smith JL. Impact of informal cancer caregiving across the cancer experience: a systematic literature review of quality of life. Palliat Support Care. 2020;18(2):220–40.CrossRefPubMedPubMedCentral Ochoa CY, Lunsford NB, Smith JL. Impact of informal cancer caregiving across the cancer experience: a systematic literature review of quality of life. Palliat Support Care. 2020;18(2):220–40.CrossRefPubMedPubMedCentral
44.
go back to reference Given BA, Given CW, Sherwood P, editors. The challenge of quality cancer care for family caregivers. Seminars in oncology nursing. Elsevier; 2012. Given BA, Given CW, Sherwood P, editors. The challenge of quality cancer care for family caregivers. Seminars in oncology nursing. Elsevier; 2012.
45.
go back to reference Shunmuga Sundaram C, Campbell R, Ju A, King MT, Rutherford C. Patient and healthcare provider perceptions on using patient-reported experience measures (PREMs) in routine clinical care: a systematic review of qualitative studies. J Patient-Reported Outcomes. 2022;6(1):1–16.CrossRef Shunmuga Sundaram C, Campbell R, Ju A, King MT, Rutherford C. Patient and healthcare provider perceptions on using patient-reported experience measures (PREMs) in routine clinical care: a systematic review of qualitative studies. J Patient-Reported Outcomes. 2022;6(1):1–16.CrossRef
46.
go back to reference Miller FG, Joffe S. Phase 1 oncology trials and informed consent. J Med Ethics. 2013;39(12):761–4.CrossRefPubMed Miller FG, Joffe S. Phase 1 oncology trials and informed consent. J Med Ethics. 2013;39(12):761–4.CrossRefPubMed
47.
go back to reference Jenkins V, Solis-Trapala I, Langridge C, Catt S, Talbot DC, Fallowfield LJ. What oncologists believe they said and what patients believe they heard: an analysis of phase I trial discussions. J Clin Oncol. 2011;29(1):61–8.CrossRefPubMed Jenkins V, Solis-Trapala I, Langridge C, Catt S, Talbot DC, Fallowfield LJ. What oncologists believe they said and what patients believe they heard: an analysis of phase I trial discussions. J Clin Oncol. 2011;29(1):61–8.CrossRefPubMed
48.
go back to reference Gregersen TA, Birkelund R, Wolderslund M, Steffensen KD, Ammentorp J. When life gives you no choice: context of decision-making when offered an oncology clinical trial. Scand J Caring Sci. 2022;36(1):81–9.CrossRefPubMed Gregersen TA, Birkelund R, Wolderslund M, Steffensen KD, Ammentorp J. When life gives you no choice: context of decision-making when offered an oncology clinical trial. Scand J Caring Sci. 2022;36(1):81–9.CrossRefPubMed
Metadata
Title
Development and validation of a patient reported experience measure for experimental cancer medicines (PREM-ECM) and their carers (PREM-ECM-Carer)
Authors
Chelsea S. Sawyer
Sally Taylor
Louise Carter
Melissa Stanworth
Michelle Davies
Fiona Thistlethwaite
Jo Taylor
Charlotte Eastwood
Janelle Yorke
Publication date
01-12-2024
Publisher
BioMed Central
Published in
BMC Cancer / Issue 1/2024
Electronic ISSN: 1471-2407
DOI
https://doi.org/10.1186/s12885-024-11963-x

Other articles of this Issue 1/2024

BMC Cancer 1/2024 Go to the issue
Webinar | 19-02-2024 | 17:30 (CET)

Keynote webinar | Spotlight on antibody–drug conjugates in cancer

Antibody–drug conjugates (ADCs) are novel agents that have shown promise across multiple tumor types. Explore the current landscape of ADCs in breast and lung cancer with our experts, and gain insights into the mechanism of action, key clinical trials data, existing challenges, and future directions.

Dr. Véronique Diéras
Prof. Fabrice Barlesi
Developed by: Springer Medicine