Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
BMC Health Services Research
Published in: BMC Health Services Research 1/2016

Open Access 01-12-2016 | Research article

Methods used to address fidelity of receipt in health intervention research: a citation analysis and systematic review

Authors: Lorna Rixon, Justine Baron, Nadine McGale, Fabiana Lorencatto, Jill Francis, Anna Davies

Published in: BMC Health Services Research | Issue 1/2016

Login to get access

Abstract

Background

The American Behaviour Change Consortium (BCC) framework acknowledges patients as active participants and supports the need to investigate the fidelity with which they receive interventions, i.e. receipt. According to this framework, addressing receipt consists in using strategies to assess or enhance participants’ understanding and/or performance of intervention skills. This systematic review aims to establish the frequency with which receipt is addressed as defined in the BCC framework in health research, and to describe the methods used in papers informed by the BCC framework and in the wider literature.

Methods

A forward citation search on papers presenting the BCC framework was performed to determine the frequency with which receipt as defined in this framework was addressed. A second electronic database search, including search terms pertaining to fidelity, receipt, health and process evaluations was performed to identify papers reporting on receipt in the wider literature and irrespective of the framework used. These results were combined with forward citation search results to review methods to assess receipt. Eligibility criteria and data extraction forms were developed and applied to papers. Results are described in a narrative synthesis.

Results

19.6% of 33 studies identified from the forward citation search to report on fidelity were found to address receipt. In 60.6% of these, receipt was assessed in relation to understanding and in 42.4% in relation to performance of skill. Strategies to enhance these were present in 12.1% and 21.1% of studies, respectively. Fifty-five studies were included in the review of the wider literature. Several frameworks and operationalisations of receipt were reported, but the latter were not always consistent with the guiding framework. Receipt was most frequently operationalised in relation to intervention content (16.4%), satisfaction (14.5%), engagement (14.5%), and attendance (14.5%). The majority of studies (90.0%) included subjective assessments of receipt. These relied on quantitative (76.0%) rather than qualitative (42.0%) methods and studies collected data on intervention recipients (50.0%), intervention deliverers (28.0%), or both (22.0%). Few studies (26.0%) reported on the reliability or validity of methods used.

Conclusions

Receipt is infrequently addressed in health research and improvements to methods of assessment and reporting are required.
Appendix
Available only for authorised users
Literature
1.
Michie S, Abraham C, Whittington C, McAteer J, Gupta S. Effective techniques in healthy eating and physical activity interventions: A meta-regression. Health Psychol. 2009;28(6):690–701. doi:10.​1037/​a0016136.CrossRefPubMed
2.
3.
4.
5.
6.
7.
8.
9.
Bellg AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, et al. Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. Health Psychol. 2004;23:443–51. doi:10.​1037/​0278-6133.​23.​5.​443.CrossRefPubMed
10.
Borrelli B, Sepinwall D, Ernst D, Bellg AJ, Czajkowski S, Breger R, et al. A new tool to assess treatment fidelity and evaluation of treatment fidelity across 10 years of health behavior research. J Consult Clin Psychol. 2005;73(5):852–60. doi:10.​1037/​0022-006x.​73.​5.​852.CrossRefPubMed
11.
Dobson D. Avoiding type III error in program evaluation: Results from a field experiment. Eval Program Plann. 1980;3:269–76.CrossRef
12.
13.
14.
Garbacz LL, Brown DM, Spee GA, Polo AJ, Budd KS. Establishing treatment fidelity in evidence-based parent training programs for externalising disorders in children and adolescents. Clin Child Fam Psychol Rev. 2014;17(3):230–47. doi:10.​1007/​s10567-014-0166-2.CrossRefPubMed
15.
Johnson-Kozlow M, Hovell MF, Rovniak LS, Sirikulvadhana L, Wahlgren DR, Zakarian JM. Fidelity issues in secondhand smoking interventions for children. Nicotine Tob Res. 2008;10(12):1677–90.CrossRefPubMedPubMedCentral
16.
17.
18.
Newman S, Steed E, Mulligan K. Chronic Physical Illness: Self Management and Behavioural Interventions. 1st ed. Berkshire: Open University Press; 2008.
19.
20.
21.
22.
Linnan L, Steckler A. Process Evaluation for Public Health Interventions and Research: An Overview. In: Process Evaluation for Public Health Interventions and Research. 1st ed. San Fransisco: Jossey-Bass; 2002. p. 1–23.
23.
24.
25.
26.
Branscum P, Sharma M, Wang LL, Wilson B, Rojas-Guyler L. A process evaluation of a social cognitive theory-based childhood obesity prevention intervention: the Comics for Health program. Health Promot Pract. 2013;14:189–98. doi:10.​1177/​1524839912437790​.CrossRefPubMed
27.
28.
Chee YK, Gitlin LN, Dennis MP, Hauck WW. Predictors of adherence to a skill-building intervention in dementia caregivers. J Gerontol A Biol Sci Med Sci. 2007;62:673–8.CrossRefPubMed
29.
Ford S, Meghea C, Estes T, Hamade H, Lockett M, Williams KP. Assessing the fidelity of the Kin KeeperSM prevention intervention in African American, Latina and Arab women. Health Educ Res. 2014;29:158–65. doi:10.​1093/​her/​cyt100.CrossRefPubMed
30.
31.
Kilanowski JF, Lin L: Summer migrant students learn healthy choices through videography. J Sch Nurs 2014, 30: 272–280. doi: 10.59840513506999.
32.
33.
34.
Resnick B, Inguito P, Orwig D, Yahiro JY, Hawkes W, Werner M, et al. Treatment fidelity in behavior change research: a case example. Nurs Res. 2005;54:139–43.CrossRefPubMed
35.
36.
37.
Resnick B, Galik E, Gruber-Baldini A, Zimmerman S. Understanding dissemination and implementation of a new intervention in assisted living settings: the case of function-focused care. J Appl Gerontol. 2013;32:280–301. doi:10.​1177/​0733464811419285​.CrossRefPubMed
38.
Skara S, Rohrbach LA, Sun P, Sussman S. An evaluation of the fidelity of implementation of a school-based drug abuse prevention program: project toward no drug abuse (TND). J Drug Educ. 2005;35:305–29.CrossRefPubMed
39.
Stevens AB, Strasser DC, Uomoto J, Bowen SE, Falconer JA. Utility of Treatment Implementation methods in clinical trial with rehabilitation teams. J Rehabil Res Dev. 2007;44:537–46.CrossRefPubMed
40.
Teel CS, Leenerts MH. Developing and testing a self-care intervention for older adults in caregiving roles. Nurs Res. 2005;54:193–201.CrossRefPubMed
41.
Weinstein P, Milgrom P, Riedy CA, Mancl LA, Garson G, Huebner CE, et al. Treatment fidelity of brief motivational interviewing and health education in a randomised clinical trial to promote dental attendance of low-income mothers and children: Community-Based Intergenerational Oral Health Study “Baby Smiles”. BMC Oral Health. 2014;14:15. doi:10.​1186/​1472-6831-14-15.CrossRefPubMedPubMedCentral
42.
43.
Yates BC, Schumacher KL, Norman JE, Krogstrand KS, Meza J, Shurmur S. Intervention fidelity in a translational study: lessons learned. Res Theory Nurs Pract. 2013;27:131–48.CrossRefPubMed
44.
45.
46.
Broekhuizen K, Jelsma JG, Van Poppel MN, Koppes LL, Brug J, Van MW. Is the process of delivery of an individually tailored lifestyle intervention associated with improvements in LDL cholesterol and multiple lifestyle behaviours in people with familial hypercholesterolemia? BMC Public Health. 2012;12:348. doi:10.​1186/​1471-2458-12-348.CrossRefPubMedPubMedCentral
47.
Bruckenthal P, Broderick JE. Assessing treatment fidelity in pilot studies assist in designing clinical trials: an illustration from a nurse practitioner community-based intervention for pain. ANS Adv Nurs Sci. 2007;30:E72–84.CrossRefPubMed
48.
Carpenter JS, Burns DS, Wu J, Yu M, Ryker K, Tallman E, et al. Strategies used and data obtained during treatment fidelity monitoring. Nurs Res. 2013;62:59–65.CrossRefPubMedPubMedCentral
49.
50.
Dyas JV, Togher F, Siriwardena AN. Intervention fidelity in primary care complex intervention trials: qualitative study using telephone interviews of patients and practitioners. Qual Prim Care. 2014;22:25–34.PubMed
51.
52.
Jonkers C, Lamers F, Bosma H, Metsemakers J, Kempen G, Van EJ. Process evaluation of a minimal psychological intervention to reduce depression in chronically ill elderly persons. Patient Educ Couns. 2007;68:252–7.CrossRefPubMed
53.
54.
55.
Nakkash R, Kobeissi L, Ghantous Z, Saad MA, Khoury B, Yassin N. Process evaluation of a psychosocial intervention addressing women in a disadvantaged setting. Glob J Health Sci. 2012;4:22–32. doi:10.​5539/​gjhs.​v4n1p22.PubMedCentral
56.
57.
Robb SL, Burns DS, Docherty SL, Haase JE. Ensuring treatment fidelity in a multi-site behavioral intervention study: implementing NIH Behavior Change Consortium recommendations in the SMART trial. Psychooncology. 2011;20:1193–201. doi:10.​1002/​pon.​1845.CrossRefPubMedPubMedCentral
58.
Smith SM, Paul G, Kelly A, Whitford DL, O’Shea E, O’Dowd T. Peer support for patients with type 2 diabetes: cluster randomised controlled trial. BMJ. 2011;342:d715.CrossRefPubMedPubMedCentral
59.
Bjelland M, Bergh IH, Grydeland M, Klepp KI, Andersen LF, Anderssen SA, et al. Changes in adolescents’ intake of sugar-sweetened beverages and sedentary behaviour: results at 8 month mid-way assessment of the HEIA study--a comprehensive, multi-component school-based randomised trial. Int J Behav Nutr Phys Act. 2011;8:63. doi:10.​1186/​1479-5868-8-63.CrossRefPubMedPubMedCentral
60.
61.
Delaney C, Fortinsky R, Mills D, Doonan L, Grimes R, Rosenberg S, et al. Pilot Study of a Statewide Initiative to Enhance Depression Care Among Older Home Care Patients. Home Health Care Management Practice. 2012;25:45–53.CrossRef
62.
Fagan AA, Hanson K, Hawkins JD, Arthur M. Translational Research in Action: Implementation of the Communities That Care Prevention System in 12 Communities. J Community Psychol. 2009;37:809–29.CrossRefPubMedPubMedCentral
63.
64.
65.
66.
Blaakman S, Tremblay PJ, Halterman JS, Fagnano M, Borrelli B. Implementation of a community-based secondhand smoke reduction intervention for caregivers of urban children with asthma: process evaluation, successes and challenges. Health Educ Res. 2013;28:141–52. doi:10.​1093/​her/​cys070.CrossRefPubMed
67.
68.
Arends I, Bultmann U, Nielsen K, Van RW, De Boer MR, Van der Klink JJ. Process evaluation of a problem solving intervention to prevent recurrent sickness absence in workers with common mental disorders. Soc Sci Med. 2014;100:123–32.CrossRefPubMed
69.
70.
71.
72.
Pbert L, Fletcher KE, Flint AJ, Young MH, Druker S, DiFranza J. Smoking prevention and cessation intervention delivery by pediatric providers, as assessed with patient exit interviews. Pediatrics. 2006;118:e810–24.CrossRefPubMed
73.
74.
Coffeng JK, Hendriksen IJ, Van MW, Boot CR. Process evaluation of a worksite social and physical environmental intervention. J Occup Environ Med. 2013;55:1409–20.CrossRefPubMed
75.
Culloty T, Milne DL, Sheikh AI. Evaluating the training of clinical supervisors: a pilot study using the fidelity framework. Cogn Behav Ther. 2010;3:132–44.
76.
Lisha NE, Sun P, Rohrbach LA, Spruijt-Metz D, Unger JB, Sussman S. An evaluation of immediate outcomes and fidelity of a drug abuse prevention program in continuation high schools: project towards no drug abuse (TND). J Drug Educ. 2012;42:33–57.CrossRefPubMed
77.
Millear PM, Liossis P, Shochet IM, Biggs HC, Donald M. Being on PAR: outcomes of a pilot trial to improve mental health and wellbeing in the workplace with the Promoting Adult Resilience (PAR) Program. Behav Chang. 2008;25:215–28.CrossRef
78.
79.
Glasgow RE, McKay HG, Piette JD, Reynolds KD. The RE-AIM framework for evaluating interventions: what can it tell us about approaches to chronic illness management? Patient Educ Couns. 2001;44:119–27.CrossRefPubMed
80.
Dane AV, Schneider BH. Program integrity in primary and early secondary prevention: are implementation effects out of control? Clin Psychol Rev. 1998;18:23–45.CrossRefPubMed
81.
Dusenbury L, Brannigan R, Falco M, Hansen WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18:237–56.CrossRefPubMed
82.
Dusenbury L, Brannigan R, Hansen WB, Walsh J, Falco M. Quality of implementation: developing measures crucial to understanding the diffusion of preventive interventions. Health Educ Res. 2005;20:308–13.CrossRefPubMed
83.
Baranowski T, Stables G. Process evaluations of the 5-a-day projects. Health Educ Behav. 2000;27:157–66.CrossRefPubMed
84.
Naven LM, Macpherson LMD. Process evaluation of a Scottish pre-fives toothpaste distribution programme. Int J Health Promot Educ. 2006;44:71–7.CrossRef
85.
Reiser RP, Milne DL. A Systematic Review and Reformulation of Outcome Evaluation inClinical Supervision: Applying the Fidelity Framework. Training Educ Prof Psychol. 2014;8:149–57.CrossRef
86.
Prowse P-TD, Nagel T, Meadows GN, Enticott JC. Treatment Fidelity over the Last Decade in Psychosocial Clinical Trials Outcome Studies: A Systematic Review. J Psychiatry. 2015;18.
87.
Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.CrossRefPubMed
88.
89.
90.
91.
92.
93.
94.
Prowse P-T, Nagel T. A Meta-Evaluation: The Role of Treatment Fidelity within Psychosocial Interventions during the Last Decade. J Psychiatry. 2015;18:251.CrossRef
95.
Field B, Booth A, Ilott I, Gerrish K. Using the Knowledge to Action Framework in practice: a citation analysis and systematic review. Implement Sci. 2014;9:172.CrossRefPubMedPubMedCentral
96.
Kuper H, Nicholson A, Hemingway H. Searching for observational studies: what does citation tracking add to PubMed? A case study in depression and coronary heart disease. BMC Med Res Methodol. 2006;6:4.CrossRefPubMedPubMedCentral
97.
Wright K, Golder S, Rodriguez-Lopez R. Citation searching: a systematic review case study of multiple risk behaviour interventions. BMC Med Res Methodol. 2014;14:73.CrossRefPubMedPubMedCentral
98.
99.
100.
101.
102.
Metadata
Title
Methods used to address fidelity of receipt in health intervention research: a citation analysis and systematic review
Authors
Lorna Rixon
Justine Baron
Nadine McGale
Fabiana Lorencatto
Jill Francis
Anna Davies
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2016
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-016-1904-6

Other articles of this Issue 1/2016

BMC Health Services Research 1/2016 Go to the issue

Research article

Regional differences in recommended cancer treatment for the elderly

Research article

Is real world evidence influencing practice? A systematic review of CPRD research in NICE guidances

Research article

Childhood fever in well-child clinics: a focus group study among doctors and nurses

Research article

Health care providers’ perceived barriers to and need for the implementation of a national integrated health care standard on childhood obesity in the Netherlands – a mixed methods approach

Research article

Budget impact of secondary hyperparathyroidism treatment in chronic kidney disease in an Ecuadorian social security hospital

Research article

Improving the user experience of patient versions of clinical guidelines: user testing of a Scottish Intercollegiate Guideline Network (SIGN) patient version