Skip to main content
Top
Published in: Trials 1/2009

Open Access 01-12-2009 | Research

Performance-based readability testing of participant information for a Phase 3 IVF trial

Authors: Peter Knapp, DK Raynor, Jonathan Silcock, Brian Parkinson

Published in: Trials | Issue 1/2009

Login to get access

Abstract

Background

Studies suggest that the process of patient consent to clinical trials is sub-optimal. Participant information sheets are important but can be technical and lengthy documents. Performance-based readability testing is an established means of assessing patient information, and this study aimed to test its application to participant information for a Phase 3 trial.

Methods

An independent groups design was used to study the User Testing performance of the participant information sheet from the Phase 3 'Poor Responders' trial of In Vitro Fertilisation (IVF). 20 members of the public were asked to read it, then find and demonstrate understanding of 21 key aspects of the trial. The participant information sheet was then re-written and re-designed, and tested on 20 members of the public, using the same 21 item questionnaire.

Results

The original participant information sheet performed well in some places. Participants could not find some answers and some of the found information was not understood. In total there were 30 instances of information being not found or not understood. Answers to three questions were found but not understood by many of the participants, these related to aspects of the drug timing, Follicle Stimulating Hormone and compensation. Only two of the 20 participants could find and show understanding of all question items when using the original sheet. The revised sheet performed generally better, with 17 instances of information being not found or not understood, although the number of 'not found' items increased. Half of the 20 participants could find and show understanding of all question items when using the revised sheet. When asked to compare the versions of the sheet, almost all participants preferred the revised version.

Conclusion

The original participant information sheet may not have enabled patients fully to give valid consent. Participants seeing the revised sheet were better able to understand the trial. Those who write information for trial participants should take account of good practice in information design. Performance-based User Testing may be a useful method to indicate strengths and weaknesses in trial information.
Appendix
Available only for authorised users
Literature
1.
go back to reference Griffin JM, Struve JK, Collins D, Liu A, Nelson DB, Bloomfield HE: Long term clinical trials: how much information do participants retain from the informed consent process?. Contemporary Clinical Trials. 2006, 27 (5): 441-8. 10.1016/j.cct.2006.04.006.CrossRefPubMed Griffin JM, Struve JK, Collins D, Liu A, Nelson DB, Bloomfield HE: Long term clinical trials: how much information do participants retain from the informed consent process?. Contemporary Clinical Trials. 2006, 27 (5): 441-8. 10.1016/j.cct.2006.04.006.CrossRefPubMed
2.
go back to reference Kaewpoonsri N, Okanurak K, Kitayaporn D, Kaewkungwal J, Vijaykadga S, Thamaree S: Factors related to volunteer comprehension of informed consent for a clinical trail. Southeast Asian Journal of Tropical Medicine and Public Health. 2006, 37 (5): 996-1004.PubMed Kaewpoonsri N, Okanurak K, Kitayaporn D, Kaewkungwal J, Vijaykadga S, Thamaree S: Factors related to volunteer comprehension of informed consent for a clinical trail. Southeast Asian Journal of Tropical Medicine and Public Health. 2006, 37 (5): 996-1004.PubMed
3.
go back to reference Lynoe N, Saundland M, Dahqvist G, Jacobsson L: Informed consent: study of quality of information given to participants in a clinical trial. British Medical Journal. 1991, 303: 610-13. 10.1136/bmj.303.6803.610.CrossRefPubMedPubMedCentral Lynoe N, Saundland M, Dahqvist G, Jacobsson L: Informed consent: study of quality of information given to participants in a clinical trial. British Medical Journal. 1991, 303: 610-13. 10.1136/bmj.303.6803.610.CrossRefPubMedPubMedCentral
4.
go back to reference Fortun P, West J, Chalkley L, Shonde A, Hawkey C: Recall of informed consent information by healthy volunteers in clinical trials. Quarterly Journal of Medicine. 2008, 101: 625-9.CrossRef Fortun P, West J, Chalkley L, Shonde A, Hawkey C: Recall of informed consent information by healthy volunteers in clinical trials. Quarterly Journal of Medicine. 2008, 101: 625-9.CrossRef
5.
go back to reference Cox AC, Fallowfield LJ, Jenkins VA: Communication and informed consent in phase 1 trials: a review of the literature. Support Care Cancer. 2006, 14 (4): 303-9. 10.1007/s00520-005-0916-2.CrossRefPubMed Cox AC, Fallowfield LJ, Jenkins VA: Communication and informed consent in phase 1 trials: a review of the literature. Support Care Cancer. 2006, 14 (4): 303-9. 10.1007/s00520-005-0916-2.CrossRefPubMed
6.
go back to reference Royal Statistical Society: Report of the Working Party on Statistical Issues in First-in-Man studies. 2007, Royal Statistical Society: London Royal Statistical Society: Report of the Working Party on Statistical Issues in First-in-Man studies. 2007, Royal Statistical Society: London
7.
go back to reference Jenkins VA, Fallowfield LJ, Souhami A, Sawtell M: How do doctors explain randomised clinical trials to their patients?. European Journal of Cancer. 1999, 35 (8): 1187-93. 10.1016/S0959-8049(99)00116-1.CrossRefPubMed Jenkins VA, Fallowfield LJ, Souhami A, Sawtell M: How do doctors explain randomised clinical trials to their patients?. European Journal of Cancer. 1999, 35 (8): 1187-93. 10.1016/S0959-8049(99)00116-1.CrossRefPubMed
8.
go back to reference Sugarman J, McCrory DC, Hubal RC: Getting meaningful informed consent from older adults: a structured literature review of empirical research. Journal of the American Geriatric Society. 1998, 46 (4): 517-24.CrossRef Sugarman J, McCrory DC, Hubal RC: Getting meaningful informed consent from older adults: a structured literature review of empirical research. Journal of the American Geriatric Society. 1998, 46 (4): 517-24.CrossRef
9.
go back to reference Stryker JE, Wray RJ, Emmons KM, Winer E, Demetri G: Understanding the decisions of cancer clinical trial participants to enter research studies: Factors associated with informed consent, patient satisfaction, and decisional regret. Patient Education and Counseling. 2006, 63: 104-9. 10.1016/j.pec.2005.09.006.CrossRefPubMed Stryker JE, Wray RJ, Emmons KM, Winer E, Demetri G: Understanding the decisions of cancer clinical trial participants to enter research studies: Factors associated with informed consent, patient satisfaction, and decisional regret. Patient Education and Counseling. 2006, 63: 104-9. 10.1016/j.pec.2005.09.006.CrossRefPubMed
10.
go back to reference Expert Scientific Group on Phase One Clinical Trials: Final Report. 2006, Her Majesty's Stationery Office: London Expert Scientific Group on Phase One Clinical Trials: Final Report. 2006, Her Majesty's Stationery Office: London
11.
go back to reference Flesch R: A new readability yardstick. Journal of Applied Psychology. 1948, 32: 221-33. 10.1037/h0057532.CrossRefPubMed Flesch R: A new readability yardstick. Journal of Applied Psychology. 1948, 32: 221-33. 10.1037/h0057532.CrossRefPubMed
12.
go back to reference Kincaid JP, Fishburne RP, Rogers RL, Chissom BS: Derivation of new readability formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy enlisted personnel. 1975, Research Branch Report 8-75, Millington, TN: Naval Technical training, US Naval Air Station, Memphis, TN Kincaid JP, Fishburne RP, Rogers RL, Chissom BS: Derivation of new readability formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy enlisted personnel. 1975, Research Branch Report 8-75, Millington, TN: Naval Technical training, US Naval Air Station, Memphis, TN
13.
go back to reference McLaughlin GH: SMOG Grading - a new readability formula. Journal of Reading. 1969, 12: 639-46. McLaughlin GH: SMOG Grading - a new readability formula. Journal of Reading. 1969, 12: 639-46.
14.
go back to reference Paasche-Orlow MK, Taylor HA, Brancati FL: Readability standards for informed-consent forms as compared with actual readability. New England Journal of Medicine. 2003, 348: 721-6. 10.1056/NEJMsa021212.CrossRefPubMed Paasche-Orlow MK, Taylor HA, Brancati FL: Readability standards for informed-consent forms as compared with actual readability. New England Journal of Medicine. 2003, 348: 721-6. 10.1056/NEJMsa021212.CrossRefPubMed
15.
go back to reference Burman W, Breese P, Weis S: The effects of local review on informed consent documents from a multicenter clinical trials consortium. Controlled Clinical Trials. 2003, 24: 245-55. 10.1016/S0197-2456(03)00003-5.CrossRefPubMed Burman W, Breese P, Weis S: The effects of local review on informed consent documents from a multicenter clinical trials consortium. Controlled Clinical Trials. 2003, 24: 245-55. 10.1016/S0197-2456(03)00003-5.CrossRefPubMed
16.
go back to reference Mayo DJ: Readability of Informed-Consent forms. New England Journal of Medicine. 2003, 348: 2262-3. 10.1056/NEJMc030704.CrossRefPubMed Mayo DJ: Readability of Informed-Consent forms. New England Journal of Medicine. 2003, 348: 2262-3. 10.1056/NEJMc030704.CrossRefPubMed
17.
go back to reference Ancker J: Assessing patient comprehension of informed consent forms. Controlled Clinical Trials. 2004, 25: 72-4. 10.1016/j.cct.2003.10.003.CrossRefPubMed Ancker J: Assessing patient comprehension of informed consent forms. Controlled Clinical Trials. 2004, 25: 72-4. 10.1016/j.cct.2003.10.003.CrossRefPubMed
18.
go back to reference Knapp P, Raynor DK, Silcock J, Parkinson B: Performance-based readability testing of participant materials for a Phase 1 trial: TGN1412. Journal of Medical Ethics. 2009, 35: 573-8. 10.1136/jme.2008.026708.CrossRefPubMed Knapp P, Raynor DK, Silcock J, Parkinson B: Performance-based readability testing of participant materials for a Phase 1 trial: TGN1412. Journal of Medical Ethics. 2009, 35: 573-8. 10.1136/jme.2008.026708.CrossRefPubMed
19.
go back to reference Sless D, Wiseman R: Writing about medicines for people. 1997, Canberra: Department of Health and Human Sciences Sless D, Wiseman R: Writing about medicines for people. 1997, Canberra: Department of Health and Human Sciences
21.
go back to reference Medicines and Healthcare products Regulatory Agency: Always read the leaflet: Getting the best information with every medicine. 2005, Stationery Office: London Medicines and Healthcare products Regulatory Agency: Always read the leaflet: Getting the best information with every medicine. 2005, Stationery Office: London
22.
go back to reference Raynor DK, Svarstad B, Knapp P, Aslani P, Rogers MB, Koo M, Krass I, Silcock J: Consumer Medicines Information in the United States, Europe and Australia - a comparative evaluation. Journal of the American Pharmacists Association. 2007, 47: 717-24. 10.1331/JAPhA.2007.06141.CrossRefPubMed Raynor DK, Svarstad B, Knapp P, Aslani P, Rogers MB, Koo M, Krass I, Silcock J: Consumer Medicines Information in the United States, Europe and Australia - a comparative evaluation. Journal of the American Pharmacists Association. 2007, 47: 717-24. 10.1331/JAPhA.2007.06141.CrossRefPubMed
23.
go back to reference Dresden GM, Levitt MA: Modifying a standard industry clinical trial consent form improves patient information retention as part of the informed consent process. Academic Emergency Medicine. 2001, 8: 246-252. 10.1111/j.1553-2712.2001.tb01300.x.CrossRefPubMed Dresden GM, Levitt MA: Modifying a standard industry clinical trial consent form improves patient information retention as part of the informed consent process. Academic Emergency Medicine. 2001, 8: 246-252. 10.1111/j.1553-2712.2001.tb01300.x.CrossRefPubMed
24.
go back to reference Coyne CA, Xu R, Raich P, Plomer K, Dignan M, Wenzel LB, Fairclough D, Habermann T, Schnell L, Quella S, Cella D, Eastern Cooperative Oncology Group: Randomized, controlled trial of an easy-to-read informed consent statement for clinical trial participation: a study of the Eastern Cooperative Oncology Group. Journal of Clinical Oncology. 2003, 21: 836-42. 10.1200/JCO.2003.07.022.CrossRefPubMed Coyne CA, Xu R, Raich P, Plomer K, Dignan M, Wenzel LB, Fairclough D, Habermann T, Schnell L, Quella S, Cella D, Eastern Cooperative Oncology Group: Randomized, controlled trial of an easy-to-read informed consent statement for clinical trial participation: a study of the Eastern Cooperative Oncology Group. Journal of Clinical Oncology. 2003, 21: 836-42. 10.1200/JCO.2003.07.022.CrossRefPubMed
25.
go back to reference Robinson EJ, Stevens AJ, Lilford RJ, Braunholtz DA, Edwards SJ, Beck SR, Rowley MG: Lay public's understanding of equipoise and randomisation in randomised controlled trials. Health Technology Assessment. 2005, 9 (8): Robinson EJ, Stevens AJ, Lilford RJ, Braunholtz DA, Edwards SJ, Beck SR, Rowley MG: Lay public's understanding of equipoise and randomisation in randomised controlled trials. Health Technology Assessment. 2005, 9 (8):
26.
go back to reference Sunkara SK, Coomarasamy A, Khalaf Y, Braude P: A three-arm randomised controlled trial comparing Gonadotrophin Releasing Hormone (GnRH) agonist long regimen versus GnRH agonist short regimen versus GnRH antagonist regimen in women with a history of poor ovarian response undergoing in vitro fertilisation treatment: Poor responders intervention trial (PRINT). Reproductive Health Journal. 2007, 4: 12-10.1186/1742-4755-4-12. doi:10.1186/1742-4755-4-12CrossRef Sunkara SK, Coomarasamy A, Khalaf Y, Braude P: A three-arm randomised controlled trial comparing Gonadotrophin Releasing Hormone (GnRH) agonist long regimen versus GnRH agonist short regimen versus GnRH antagonist regimen in women with a history of poor ovarian response undergoing in vitro fertilisation treatment: Poor responders intervention trial (PRINT). Reproductive Health Journal. 2007, 4: 12-10.1186/1742-4755-4-12. doi:10.1186/1742-4755-4-12CrossRef
27.
go back to reference Raynor DK, Dickinson D: Key principles to guide development of consumer medicines information - content analysis of information design texts. Annals of Pharmacotherapy. 2009, 43: 700-6. 10.1345/aph.1L522.CrossRefPubMed Raynor DK, Dickinson D: Key principles to guide development of consumer medicines information - content analysis of information design texts. Annals of Pharmacotherapy. 2009, 43: 700-6. 10.1345/aph.1L522.CrossRefPubMed
28.
go back to reference Lentz L, De Jong M: The evaluation of text quality: expert-focused and reader-focused methods compared. IEEE Transactions on Professional Communication. 1997, 40: 224-33. 10.1109/47.649557.CrossRef Lentz L, De Jong M: The evaluation of text quality: expert-focused and reader-focused methods compared. IEEE Transactions on Professional Communication. 1997, 40: 224-33. 10.1109/47.649557.CrossRef
29.
go back to reference Ley P: Communication in the clinical setting. British Journal of Orthodontics. 1973, 1: 173-7.CrossRef Ley P: Communication in the clinical setting. British Journal of Orthodontics. 1973, 1: 173-7.CrossRef
30.
go back to reference Wilson M, Robinson EJ, Blenkinsopp A, Panton R: Customers' recall of information given in community pharmacies. International Journal of Pharmacy Practice. 1992, 1: 52-9.CrossRef Wilson M, Robinson EJ, Blenkinsopp A, Panton R: Customers' recall of information given in community pharmacies. International Journal of Pharmacy Practice. 1992, 1: 52-9.CrossRef
31.
go back to reference Raynor DK, Blenkinsopp A, Knapp P, Grime J, Nicolson DJ, Pollock K, Dorer G, Gilbody SM, Dickinson D, Maule AJ, Spoor PA: A systematic review of quantitative and qualitative research on the role and effectiveness of written information available to patients about individual medicines. Health Technology Assessment. 2007, 11 (5): Raynor DK, Blenkinsopp A, Knapp P, Grime J, Nicolson DJ, Pollock K, Dorer G, Gilbody SM, Dickinson D, Maule AJ, Spoor PA: A systematic review of quantitative and qualitative research on the role and effectiveness of written information available to patients about individual medicines. Health Technology Assessment. 2007, 11 (5):
32.
go back to reference Koops L, Lindley RI: Thrombolysis for acute ischaemic stroke: consumer involvement in design of new randomised controlled trial. British Medical Journal. 2002, 325: 415-10.1136/bmj.325.7361.415.CrossRefPubMedPubMedCentral Koops L, Lindley RI: Thrombolysis for acute ischaemic stroke: consumer involvement in design of new randomised controlled trial. British Medical Journal. 2002, 325: 415-10.1136/bmj.325.7361.415.CrossRefPubMedPubMedCentral
Metadata
Title
Performance-based readability testing of participant information for a Phase 3 IVF trial
Authors
Peter Knapp
DK Raynor
Jonathan Silcock
Brian Parkinson
Publication date
01-12-2009
Publisher
BioMed Central
Published in
Trials / Issue 1/2009
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-10-79

Other articles of this Issue 1/2009

Trials 1/2009 Go to the issue