Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Trials
Published in: Trials 1/2013

Open Access 01-12-2013 | Methodology

A process for Decision-making after Pilot and feasibility Trials (ADePT): development following a feasibility study of a complex intervention for pelvic organ prolapse

Authors: Carol Bugge, Brian Williams, Suzanne Hagen, Janet Logan, Cathryn Glazener, Stewart Pringle, Lesley Sinclair

Published in: Trials | Issue 1/2013

Login to get access

Abstract

Background

Current Medical Research Council (MRC) guidance on complex interventions advocates pilot trials and feasibility studies as part of a phased approach to the development, testing, and evaluation of healthcare interventions. In this paper we discuss the results of a recent feasibility study and pilot trial for a randomized controlled trial (RCT) of pelvic floor muscle training for prolapse (ClinicalTrials.gov: NCT01136889). The ways in which researchers decide to respond to the results of feasibility work may have significant repercussions for both the nature and degree of tension between internal and external validity in a definitive trial.

Methods

We used methodological issues to classify and analyze the problems that arose in the feasibility study. Four centers participated with the aim of randomizing 50 women. Women were eligible if they had prolapse of any type, of stage I to IV, and had a pessary successfully fitted. Postal questionnaires were administered at baseline, 6 months, and 7 months post-randomization. After identifying problems arising within the pilot study we then sought to locate potential solutions that might minimize the trade-off between a subsequent explanatory versus pragmatic trial.

Results

The feasibility study pointed to significant potential problems in relation to participant recruitment, features of the intervention, acceptability of the intervention to participants, and outcome measurement. Finding minimal evidence to support our decision-making regarding the transition from feasibility work to a trial, we developed a systematic process (A process for Decision-making after Pilot and feasibility Trials (ADePT)) which we subsequently used as a guide. The process sought to: 1) encourage the systematic identification and appraisal of problems and potential solutions; 2) improve the transparency of decision-making processes; and 3) reveal the tensions that exist between pragmatic and explanatory choices.

Conclusions

We have developed a process that may aid researchers in their attempt to identify the most appropriate solutions to problems identified within future pilot and feasibility RCTs. The process includes three key steps: a decision about the type of problem, the identification of all solutions (whether addressed within the intervention, trial design or clinical context), and a systematic appraisal of these solutions.
Appendix
Available only for authorised users
Literature
1.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: the new medical research council guidance. BMJ. 2008, 337: a1655-10.1136/bmj.a1655.CrossRefPubMedPubMedCentral
2.
Medical Research Council (MRC): Developing and Evaluating Complex Interventions: New Guidance. 2008, London: MRC
3.
Øvretveit J: Evaluating complex social interventions. Eurohealth. 2004, 10 (2): 37-40.
4.
5.
Cooksey D: A Review of UK Health Research Funding. 2006, London: The Stationery Office
6.
Murray ETS, Pope C, MacFarlane A, Ballini L, Dowrick C, Finch T, Kennedy A, Mair F, O'Donnell C, Ong BN, Rapley T, Rogers A, May C: Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med. 2010, 8: 63-10.1186/1741-7015-8-63.CrossRefPubMedPubMedCentral
7.
Green LW, Glasgow RE: Evaluating the relevance, generalisation and applicability of research: issues in external validation and translation methodology. Eval Health Prof. 2006, 29 (1): 126-153. 10.1177/0163278705284445.CrossRefPubMed
8.
Glasgow RE, Mckay HG, Piette JD, Reynolds KD: The RE-AIM framework for evaluating interventions: what can it tell us about approaches to chronic illness management?. Patient Educ Couns. 2001, 44: 119-127. 10.1016/S0738-3991(00)00186-5.CrossRefPubMed
9.
Arain M, Campbell MJ, Cooper CL, Lancaster GA: What is a pilot or feasibility study? A review of current practice and editorial policy. BMC Med Res Methodol. 2010, 10: 67-10.1186/1471-2288-10-67.CrossRefPubMedPubMedCentral
10.
11.
12.
Godwin M, Ruhland L, Casson I, MacDonald S, Delva D, Birtwhistle R, Lam M, Seguin R: Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity. BMC Med Res Methodol. 2003, 3: 28-10.1186/1471-2288-3-28.CrossRefPubMedPubMedCentral
13.
Schwartz D, Lellouch J: Explanatory and pragmatic attitudes in therapeutic trials. J Chronic Dis. 1967, 20: 637-648. 10.1016/0021-9681(67)90041-0.CrossRefPubMed
14.
MacPherson H, Thorpe L, Thomas K: Beyond needling - therapeutic processes in acupuncture care: a qualitative study nested within a low-back pain trial. J Altern Complement Med. 2006, 12: 873-880. 10.1089/acm.2006.12.873.CrossRefPubMed
15.
Shanyinde M, Pickering RM, Weatherall M: Questions asked and answered in pilot and feasibity randomised controlled trials. BMC Med Res Methodol. 2011, 11 (117): 1471-2288.
16.
Lancaster GA, Dodd S, Williamson PR: Design and analysis of pilot studies: recommendations for good practice. J Eval Clin Pract. 2004, 10 (2): 307-312. 10.1111/j..2002.384.doc.x.CrossRefPubMed
17.
Moore CG, Carter RE, Nietert PJ, Stewart PW: Recommendations for planning pilot studies in clinical and translational research. Clin Trans Sci. 2011, 4: 332-337. 10.1111/j.1752-8062.2011.00347.x.CrossRef
18.
Hagen S, Stark D, Cattermole D: A United Kingdom-wide survey of physiotherapy practice in the treatment of pelvic organ prolapse. Physiotherapy. 2004, 90 (1): 19-26. 10.1016/S0031-9406(03)00003-8.CrossRef
19.
Gorti M, Hundelist G, Simons A: Evaluation of vaginal pessary management: A UK-based survey. J Obstet Gynaecol. 2009, 29 (2): 129-131. 10.1080/01443610902719813.CrossRefPubMed
20.
Hagen S, Stark D, Glazener C, Sinclair L, Wilson D, Norrie J, Dickson S, McPherson G, Logan J, Frawley H, Moore K, Walker A: A Multicentre Randomised Controlled Trial of a Pelvic Floor Muscle Training Intervention for Women with Pelvic Organ Prolapse. 2011, Glasgow: Proceedings of the 41st Annual Meeting of the International Continence Society
21.
Braekken IH, Majida M, Engh ME, Bø K: Can pelvic floor muscle training reverse pelvic organ prolapse and reduce prolapse symptoms? An assessor-blinded, randomized, controlled trial. Am J Obstet Gynecol. 2010, 203 (2): 170-CrossRefPubMed
22.
Handa VL, Jones M: Do pessaries prevent the progress of pelvic organ prolapse. Int Urogynecol J Pelvic Floor Dysfunct. 2002, 13 (6): 349-351. 10.1007/s001920200078.CrossRefPubMed
23.
Hanson LM, Schultz J, Flood CG, Cooley B, Tam F: Vaginal pessaries in managing women with pelvic organ prolapse and urinary incontinence: patient characteristics and factors contributing to success. Int Urogynecol J Pelvic Floor Dysfunct. 2006, 17: 155-159. 10.1007/s00192-005-1362-x.CrossRefPubMed
24.
Lone F, Thakar R, Sultan AH, Karamalis G: A 5-year prospective study of vaginal pessary use for pelvic organ prolapse. Int J Gynaecol Obstet. 2011, 114 (1): 56-59. 10.1016/j.ijgo.2011.02.006.CrossRefPubMed
25.
Manchana T, Bunyavejchevin S: Impact on quality of life after ring pessary use for pelvic organ prolapse. Int Urogynecol J. 2012, 23 (7): 873-877. 10.1007/s00192-011-1634-6.CrossRefPubMed
26.
Hagen S, Glazener C, Sinclair L, Stark D, Bugge C: Psychometric properties of the pelvic organ prolapse symptom score. BJOG. 2009, 116 (1): 25-31. 10.1111/j.1471-0528.2008.01903.x.CrossRefPubMed
27.
Bump RC, Mattiasson A, Bø K, Brubaker LP, DeLancey JO, Klarskov P, Shull BL, Smith AR: The standardisation of terminology of female pelvic organ prolapse and pelvic floor dysfunction. Am J Obstet Gynecol. 1996, 175: 10-17. 10.1016/S0002-9378(96)70243-0.CrossRefPubMed
28.
Hagen S, Glazener C, Cook J, Herbison P, Toozs-Hobson P: Further Properties of the Pelvic Organ Prolapse Symptom Score: Minimally Important Change and Test-retest Reliability. 2010, Toronto: Proceedings of the 40th Annual Meeting of the International Continence Society
29.
Hagen S, Stark D, Glazener C, Dickson S, Barry S, Elders A, Frawley H, Galea M, Logan J, McDonald A, McPherson G, Moore KH, Norrie J, Walker A, Wilson D: Individualised pelvic floor muscle training in women with pelvic organ prolapse: a multicentre randomised controlled trial. The Lancet. accepted 19/9/13
30.
Hagen S, Stark D, Glazener C, Sinclair L, Ramsay I: A randomised controlled trial of pelvic floor muscle training for stage I and II pelvic organ prolapse. Int Urogynecol J. 2009, 20: 45-51.CrossRef
31.
Glazener C, Elders A, MacArthur C, Lancashire R, Herbison P, Hagen S, Dean N, Bain C, Toozs-Hobson P, Richardson K, McDonald A, McPherson G, Wilson D: Childbirth and prolapse: long-term associations with the symptoms and objective measurement of pelvic organ prolapse. BJOG. 2013, 120: 161-168. 10.1111/1471-0528.12075.CrossRefPubMed
32.
Cundiff GW, Weidner AC, Visco AG, Bump RC, Addison WA: A survey of pessary use by members of the American urogynaecologic society. Obstet Gynecol. 2000, 95: 931-935. 10.1016/S0029-7844(00)00788-2.PubMed
33.
Pott-Grinstein E, Newcomer JR: Gynecologists’ patterns of prescribing pessaries. J Reprod Med. 2001, 46: 205-208.PubMed
34.
Marteau TM, Ashcroft RE: Using financial incentives to achieve healthy behaviour. Br Med J. 2009, 338: 983-985. 10.1136/bmj.b983.CrossRef
35.
Wilkinson E: Can you pay people to be healthy?. Lancet. 2008, 371 (9621): 1325-1326. 10.1016/S0140-6736(08)60578-4.CrossRefPubMed
36.
Cahill K, Perera R: Competitions and incentives for smoking cessation. Cochrane Database Syst Rev. 2011, 4: CD004307-PubMed
37.
Jochelson K: Paying the Patient. 2007, London: Kings Fund
38.
McMahon AD: Study control, violators, inclusion criteria and defining explanatory and pragmatic trials. Stat Med. 2002, 21: 1365-1376. 10.1002/sim.1120.CrossRefPubMed
39.
Thorpe K, Zwarenstein M, Oxman A, Treweek S, Furburg C, Altman D, Tunis S, Bergel E, Harvey I, Magid DJ, Chalkidou K: A pragmatic–explanatory continuum indicator summary (PRECIS): a tool to help trial designers. CMAJ. 2009, 180 (10): E47-E57. 10.1503/cmaj.090523.CrossRefPubMedPubMedCentral
40.
41.
Brady MC, Stott DJ, Norrie J, Chalmers C, St George B, Sweeney PM: Developing and evaluating the implementation of a complex intervention: using mixed methods to inform the design of a randomised controlled trial of an oral healthcare intervention after stroke. Trials. 2011, 12: 168-10.1186/1745-6215-12-168.CrossRefPubMedPubMedCentral
42.
Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. BMJ. 2000, 321: 694-696. 10.1136/bmj.321.7262.694.CrossRefPubMedPubMedCentral
43.
Medical Research Council (MRC): A Framework for Development and Evaluation of RCTs for Complex Interventions to Improve Health. 2000, London: MRC
44.
Tunis SR, Stryer DB, Clancy CM: Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. JAMA. 2003, 24 (290): 1624-1632.
45.
Wells M, Williams B, Treweek S, Coyle J, Taylor J: Intervention description is not enough: evidence from an in-depth multiple case study on the untold role and impact of context in randomised controlled trials of seven complex interventions. Trials. 2012, 13: 95-10.1186/1745-6215-13-95.CrossRefPubMedPubMedCentral
46.
Wakefield A: Evidence-based physiotherapy: The case for pragmatic randomised controlled trials. Physiotherapy. 2000, 86 (8): 394-396. 10.1016/S0031-9406(05)60827-9.CrossRef
47.
Oxman AD, Lombard C, Treweek S, Gagnier JJ, Maclure M, Zwarenstein M: A pragmatic resolution. J Clin Epidemiol. 2009, 62 (5): 495-498. 10.1016/j.jclinepi.2008.08.014.CrossRefPubMed
48.
Oxman AD, Treweek S, Gagnier JJ, Maclure M, Zwarenstein M: Why we will remain pragmatists: four problems with the impractical mechanistic framework and a better solution. J Clin Epidemiol. 2009, 62: 485-488. 10.1016/j.jclinepi.2008.08.015.CrossRefPubMed
49.
Black N, Murphy M, Lamping D, Mckee M, Sanderson C, Askham J, Marteau T: Consensus development methods for creating clinical guidelines. Health Services Research Methods: A Guide to Best Practice. Edited by: Black N, Brazier J, Fitzpatrick R, Reeves B. 1998, London: BMJ Books
50.
Bugge C, Hagen S, Thakar R: Vaginal pessaries for pelvic organ prolapse and urinary incontinence: a multiprofessional survey of practice. Int Urogynecol J. 2013, 24 (6): 1017-1024. 10.1007/s00192-012-1985-7.CrossRefPubMed
51.
Garber CE, Blissmer B, Deschenes MR, Franklin BA, Lamonte MJ, Lee IM, Nieman DC, Swain DP, American College of Sports Medicine: Quantity and quality of exercise for developing and maintaining cardiorespiratory, musculoskeletal, and neuromotor fitness in apparently healthy adults: guidance for the prescription of exercise. Med Sci Sports Exerc. 2011, 43 (7): 1334-1359. 10.1249/MSS.0b013e318213fefb.CrossRefPubMed
52.
Cole-Lewis H, Kershaw T: Text messaging as a tool for behaviour change in disease prevention and management. Epidemiol Rev. 2010, 32 (1): 56-69. 10.1093/epirev/mxq004.CrossRefPubMedPubMedCentral
53.
Fjeldsoe BS, Marshall AL, Miller YD: Behaviour change interventions delivered by mobile telephone short-message service. Am J Prev Med. 2009, 36 (2): 165-173. 10.1016/j.amepre.2008.09.040.CrossRefPubMed
54.
Whittaker R, Borland R, Bullen C, Lin RB, McRobbie H, Rodgers A: Mobile phone-based interventions for smoking cessation. Cochrane Database Syst Rev. 2009, 4: CD006611-PubMed
55.
Hay-Smith EJC, Herderschee R, Dumoulin C, Herbison P: Comparisons of approaches to pelvic floor muscle training for urinary incontinence in women. Cochrane Database Syst Rev. 2011, 12: CD009508-PubMed
56.
Jackson CJ, Dixon-Woods M, Eborall H, Kenyon S, Toozs-Hobson P, Tincello DG: Women’s views and experiences of a patient preference trial in surgery: a qualitative study of the CARPET1 trial. Clin Trials. 2010, 7 (6): 696-704. 10.1177/1740774510381286.CrossRefPubMed
57.
Thorstensson CA, Lohmander LS, Frobell RB, Roos EM, Gooberman-Hill R: Choosing surgery: patients’ preferences within a trial of treatments for anterior cruciate ligament injury: A qualitative study. BMC Musculoskelet Disord. 2009, 10: 100-10.1186/1471-2474-10-100.CrossRefPubMedPubMedCentral
58.
Mihaylov S, Stark C, McColl E, Steen N, Vanoli A, Rubin G, Curless R, Barton R, Bond J: Stepped treatment of older adults on laxatives: the stool trial. Health Technol Assess. 2008, 12 (13): iii–iv-ix–139.CrossRefPubMed
59.
Li JS, Colan SD, Sleeper LA, Newburger JW, Pemberton VL, Atz AM, Cohen MS, Golding F, Klein GL, Lacro RV, Radojewski E, Richmond ME, Minich LL: Lessons learned from a pediatric clinical trial: the pediatric heart network angiotensin-converting enzyme inhibition in mitral regurgitation study. Am Heart J. 2011, 161 (2): 233-240. 10.1016/j.ahj.2010.10.030.CrossRefPubMedPubMedCentral
60.
Eurich DT, Tsuyuki RT, Majumdar SR, McAlister FA, Lewanczuk R, Shibata MC, Johnson JA: Metformin treatment in diabetes and heart failure: when academic equipoise meets clinical reality. Trials. 2009, 10: 12-10.1186/1745-6215-10-12.CrossRefPubMedPubMedCentral
61.
Forsetlund L, Bjorndal A, Rashidian A, Jamtvedt G, O’Brien MA, Wolf F, Davis D, Odgaard-Jensen J, Oxman AD: Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2009, 2: CD003030-PubMed
62.
Duke SAS, Colagiuri S, Colagiuri R: Individual patient education for people with type 2 diabetes mellitus. Cochrane Database Syst Rev. 2009, 1: CD005268-PubMed
63.
Effing T, Monninkhof EM, van der Valk PD, van der Palen J, van Herwaarden CL, Partidge MR, Walters EH, Zielhuis GA: Self-management education for patients with chronic obstructive pulmonary disease. Cochrane Database Syst Rev. 2007, 4: CD002990-PubMed
64.
Stocks N, Allan J, Frank O, Williams S, Ryan P: Improving attendance for cardiovascular risk assessment in Australian general practice: an RCT of a monetary incentive for patients. BMC Fam Pract. 2012, 13: 54-10.1186/1471-2296-13-54.CrossRefPubMedPubMedCentral
65.
Allan C, Radley A, Williams B: Paying the price for an incentive: an exploratory study of smokers’ reasons for failing to complete an incentive based smoking cessation scheme. J Health Serv Res Policy. 2012, 17 (4): 212-218. 10.1258/jhsrp.2012.011084.CrossRefPubMed
66.
Sanada H, Nakagami G, Mizokami Y, Minami Y, Yamamoto A, Oe M, Kaitani T, Iizaka S: Evaluating the effect of the new incentive system for high-risk pressure ulcer patients on wound healing and cost-effectiveness: a cohort study. Int J Nurs Stud. 2010, 47 (3): 279-286. 10.1016/j.ijnurstu.2009.08.001.CrossRefPubMed
67.
Salize HJ, Merkel S, Reinhard I, Twardella D, Mann K, Brenner H: Cost-effective primary care-based strategies to improve smoking cessation: more value for money. Arch Intern Med. 2009, 169 (3): 230-5. 10.1001/archinternmed.2008.556.CrossRefPubMed
68.
An LC, Bluhm JH, Foldes SS, Alesci NL, Klatt CM, Center BA, Nersesian WS, Larson ME, Ahluwalia JS, Manley MW: A randomized trial of a pay-for-performance program targeting clinician referral to a state tobacco quitline. Arch Intern Med. 2008, 168 (18): 1993-1999. 10.1001/archinte.168.18.1993.CrossRefPubMed
69.
Bilardi JE, Fairley CK, Temple-Smith MJ, Pirotta MV, McNamee KM, Bourke S, Gurrin LC, Hellard M, Sanci LA, Wills MJ, Walker J, Chen MY, Hocking JS: Incentive payments to general practitioners aimed at increasing opportunistic testing of young women for chlamydia: a pilot cluster randomised controlled trial. BMC Public Health. 2010, 10: 70-10.1186/1471-2458-10-70.CrossRefPubMedPubMedCentral
Metadata
Title
A process for Decision-making after Pilot and feasibility Trials (ADePT): development following a feasibility study of a complex intervention for pelvic organ prolapse
Authors
Carol Bugge
Brian Williams
Suzanne Hagen
Janet Logan
Cathryn Glazener
Stewart Pringle
Lesley Sinclair
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Trials / Issue 1/2013
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-14-353

Other articles of this Issue 1/2013

Trials 1/2013 Go to the issue

Methodology

Investigating the relationship between predictability and imbalance in minimisation: a simulation study

Study protocol

Effectiveness of occupational therapy in Parkinson’s disease: study protocol for a randomized controlled trial

Methodology

Introduction to a generalized method for adaptive randomization in trials

Study protocol

Piloting a manualised weight management programme (Shape Up-LD) for overweight and obese persons with mild-moderate learning disabilities: study protocol for a pilot randomised controlled trial

Methodology

Meeting the challenges of recruitment to multicentre, community-based, lifestyle-change trials: a case study of the BeWEL trial

Study protocol

Prevention of ICU delirium and delirium-related outcome with haloperidol: a study protocol for a multicenter randomized controlled trial