Skip to main content
Top
Published in: BMC Health Services Research 1/2013

Open Access 01-12-2013 | Research article

The Prevention and Reactivation Care Program: intervention fidelity matters

Authors: Annemarie JBM de Vos, Ton JEM Bakker, Paul L de Vreede, Jeroen DH van Wijngaarden, Ewout W Steyerberg, Johan P Mackenbach, Anna P Nieboer

Published in: BMC Health Services Research | Issue 1/2013

Login to get access

Abstract

Background

The Prevention and Reactivation Care Program (PReCaP) entails an innovative multidisciplinary, integrated and goal oriented approach aimed at reducing hospital related functional decline among elderly patients. Despite calls for process evaluation as an essential component of clinical trials in the geriatric care field, studies assessing fidelity lag behind the number of effect studies. The threefold purpose of this study was (1) to systematically assess intervention fidelity of the hospital phase of the PReCaP in the first year of the intervention delivery; (2) to improve our understanding of the moderating factors and modifications affecting intervention fidelity; and (3) to explore the feasibility of the PReCaP fidelity assessment in view of the modifications.

Methods

Based on the PReCaP description we developed a fidelity instrument incorporating nineteen (n=19) intervention components. A combination of data collection methods was utilized, i.e. data collection from patient records and individual Goal Attainment Scaling care plans, in-depth interviews with stakeholders, and non-participant observations. Descriptive analysis was performed to obtain levels of fidelity of each of the nineteen PReCaP components. Moderating factors were identified by using the Conceptual Framework for Implementation Fidelity.

Results

Ten of the nineteen intervention components were always or often delivered to the group of twenty elderly patients. Moderating factors, such as facilitating strategies and context were useful in explaining the non- or low-adherence of particular intervention components.

Conclusions

Fidelity assessment was carried out to evaluate the adherence to the PReCaP in the Vlietland Ziekenhuis in the Netherlands. Given that the fidelity was assessed in the first year of PReCaP implementation it was commendable that ten of the nineteen intervention components were performed always or often. The adequate delivery of the intervention components strongly depended on various moderating factors. Since the intervention is still developing and undergoing continuous modifications, it has been concluded that the fidelity criteria should evolve with the modified intervention. Furthermore, repeated intervention fidelity assessments will be necessary to ensure a valid and reliable fidelity assessment of the PReCaP.

Trial registration

The Netherlands National Trial Register: NTR2317
Literature
1.
go back to reference Santacroce SJ, Maccarelli LM, Grey M: Intervention fidelity. Nurs Res. 2004, 53 (1): 63-66. 10.1097/00006199-200401000-00010.CrossRefPubMed Santacroce SJ, Maccarelli LM, Grey M: Intervention fidelity. Nurs Res. 2004, 53 (1): 63-66. 10.1097/00006199-200401000-00010.CrossRefPubMed
2.
go back to reference Dusenbury L, Brannigan R, Falco M, Hansen WB: A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003, 18 (2): 237-256. 10.1093/her/18.2.237.CrossRefPubMed Dusenbury L, Brannigan R, Falco M, Hansen WB: A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003, 18 (2): 237-256. 10.1093/her/18.2.237.CrossRefPubMed
3.
go back to reference Mills SC, Ragan TJ: A tool for analyzing implementation fidelity of an integrated learning system. ETR&D-Educ Tech Res Dev. 2000, 48 (4): 21-41. 10.1007/BF02300498.CrossRef Mills SC, Ragan TJ: A tool for analyzing implementation fidelity of an integrated learning system. ETR&D-Educ Tech Res Dev. 2000, 48 (4): 21-41. 10.1007/BF02300498.CrossRef
4.
go back to reference Mowbray CT, Holter MC, Teague GB, Bybee D: Fidelity criteria: development, measurement, and validation. Am J Eval. 2003, 24 (3): 315-340.CrossRef Mowbray CT, Holter MC, Teague GB, Bybee D: Fidelity criteria: development, measurement, and validation. Am J Eval. 2003, 24 (3): 315-340.CrossRef
5.
go back to reference Dane AV, Schneider BH: Program integrity in primary and early secondary prevention: are implementation effects out of control?. Clin Psychol Rev. 1998, 18 (1): 23-45. 10.1016/S0272-7358(97)00043-3.CrossRefPubMed Dane AV, Schneider BH: Program integrity in primary and early secondary prevention: are implementation effects out of control?. Clin Psychol Rev. 1998, 18 (1): 23-45. 10.1016/S0272-7358(97)00043-3.CrossRefPubMed
6.
go back to reference Horner S, Rew L, Torres R: Enhancing intervention fidelity: a means of strengthening study impact. J Spec Pediatr Nurs. 2006, 11 (2): 80-89. 10.1111/j.1744-6155.2006.00050.x.CrossRefPubMedPubMedCentral Horner S, Rew L, Torres R: Enhancing intervention fidelity: a means of strengthening study impact. J Spec Pediatr Nurs. 2006, 11 (2): 80-89. 10.1111/j.1744-6155.2006.00050.x.CrossRefPubMedPubMedCentral
7.
go back to reference Hasson H, Blomberg S, Dunér A: Fidelity and moderating factors in complex interventions: a case study of a continuum of care program for frail elderly people in health and social care. Implement Sci. 2012, 7 (23): 1-11. Hasson H, Blomberg S, Dunér A: Fidelity and moderating factors in complex interventions: a case study of a continuum of care program for frail elderly people in health and social care. Implement Sci. 2012, 7 (23): 1-11.
8.
go back to reference Dumas JE, Lynch AM, Laughlin JE, Phillips Smith E, Prinz RJ: Promoting intervention fidelity: conceptual issues, methods, and preliminary results from the EARLY ALLIANCE prevention trial. Am J Prev Med. 2001, 20 (1, Supplement 1): 38-47. 10.1016/S0749-3797(00)00272-5.CrossRefPubMed Dumas JE, Lynch AM, Laughlin JE, Phillips Smith E, Prinz RJ: Promoting intervention fidelity: conceptual issues, methods, and preliminary results from the EARLY ALLIANCE prevention trial. Am J Prev Med. 2001, 20 (1, Supplement 1): 38-47. 10.1016/S0749-3797(00)00272-5.CrossRefPubMed
10.
go back to reference Vermilyea BBB: The importance of assessing treatment integrity: an example in the anxiety disorders. J Behav Assess. 1984, 6 (1): 1-11. 10.1007/BF01321456.CrossRef Vermilyea BBB: The importance of assessing treatment integrity: an example in the anxiety disorders. J Behav Assess. 1984, 6 (1): 1-11. 10.1007/BF01321456.CrossRef
11.
go back to reference Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S: A conceptual framework for implementation fidelity. Implement Sci. 2007, 2 (1): 40-10.1186/1748-5908-2-40.CrossRefPubMedPubMedCentral Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S: A conceptual framework for implementation fidelity. Implement Sci. 2007, 2 (1): 40-10.1186/1748-5908-2-40.CrossRefPubMedPubMedCentral
12.
go back to reference Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82 (4): 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82 (4): 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral
13.
go back to reference Leeuw M, Goossens MEJB, de Vet HCW, Vlaeyen JWS: The fidelity of treatment delivery can be assessed in treatment outcome studies: a successful illustration from behavioral medicine. J Clin Epidemiol. 2009, 62 (1): 81-90. 10.1016/j.jclinepi.2008.03.008.CrossRefPubMed Leeuw M, Goossens MEJB, de Vet HCW, Vlaeyen JWS: The fidelity of treatment delivery can be assessed in treatment outcome studies: a successful illustration from behavioral medicine. J Clin Epidemiol. 2009, 62 (1): 81-90. 10.1016/j.jclinepi.2008.03.008.CrossRefPubMed
14.
go back to reference Hasson H: Systematic evaluation of implementation fidelity of complex interventions in health and social care. Implement Sci. 2010, 5 (1): 67-10.1186/1748-5908-5-67.CrossRefPubMedPubMedCentral Hasson H: Systematic evaluation of implementation fidelity of complex interventions in health and social care. Implement Sci. 2010, 5 (1): 67-10.1186/1748-5908-5-67.CrossRefPubMedPubMedCentral
15.
go back to reference Ellis G, Whitehead MA, Robinson D, O’Neill D, Langhorne P: Comprehensive geriatric assessment for older adults admitted to hospital: meta-analysis of randomised controlled trials. BMJ. 2011, 343 (d6553): 1-10. Ellis G, Whitehead MA, Robinson D, O’Neill D, Langhorne P: Comprehensive geriatric assessment for older adults admitted to hospital: meta-analysis of randomised controlled trials. BMJ. 2011, 343 (d6553): 1-10.
16.
go back to reference Carroll KM, Nich C, Sifry RL, Nuro KF, Frankforter TL, Ball SA, Fenton L, Rounsaville BJ: A general system for evaluating therapist adherence and competence in psychotherapy research in the addictions. Drug Alcohol Depend. 2000, 57 (3): 225-238. 10.1016/S0376-8716(99)00049-6.CrossRefPubMed Carroll KM, Nich C, Sifry RL, Nuro KF, Frankforter TL, Ball SA, Fenton L, Rounsaville BJ: A general system for evaluating therapist adherence and competence in psychotherapy research in the addictions. Drug Alcohol Depend. 2000, 57 (3): 225-238. 10.1016/S0376-8716(99)00049-6.CrossRefPubMed
17.
go back to reference Song M, Happ MB, Sandelowski M: Development of a tool to assess fidelity to a psycho-educational intervention. J Adv Nurs. 2010, 66 (3): 673-682. 10.1111/j.1365-2648.2009.05216.x.CrossRefPubMedPubMedCentral Song M, Happ MB, Sandelowski M: Development of a tool to assess fidelity to a psycho-educational intervention. J Adv Nurs. 2010, 66 (3): 673-682. 10.1111/j.1365-2648.2009.05216.x.CrossRefPubMedPubMedCentral
19.
go back to reference Allen S, Bartlett T, Ventham J, McCubbin C, Williams A: Benefits of an older persons’ assessment and liaison team in acute admissions areas of a general hospital. Pragmatic Observational Res. 2010, 1: 1-6.CrossRef Allen S, Bartlett T, Ventham J, McCubbin C, Williams A: Benefits of an older persons’ assessment and liaison team in acute admissions areas of a general hospital. Pragmatic Observational Res. 2010, 1: 1-6.CrossRef
20.
go back to reference Covinsky KE, Palmer RM, Fortinsky RH, Counsell SR, Stewart AL, Kresevic D, Burant CJ, Landefeld CS: Loss of independence in activities of daily living in older adults hospitalized with medical illnesses: increased vulnerability with age. J Am Geriatr Soc. 2003, 51 (4): 451-458. 10.1046/j.1532-5415.2003.51152.x.CrossRefPubMed Covinsky KE, Palmer RM, Fortinsky RH, Counsell SR, Stewart AL, Kresevic D, Burant CJ, Landefeld CS: Loss of independence in activities of daily living in older adults hospitalized with medical illnesses: increased vulnerability with age. J Am Geriatr Soc. 2003, 51 (4): 451-458. 10.1046/j.1532-5415.2003.51152.x.CrossRefPubMed
21.
go back to reference de Vos A, Asmus-Szepesi K, Bakker T, de Vreede P, van Wijngaarden J, Steyerberg E, Mackenbach J, Nieboer A: Integrated approach to prevent functional decline in hospitalized elderly: the Prevention and Reactivation Care Program (PReCaP). BMC Geriatr. 2012, 12 (1): 7-10.1186/1471-2318-12-7.CrossRefPubMedPubMedCentral de Vos A, Asmus-Szepesi K, Bakker T, de Vreede P, van Wijngaarden J, Steyerberg E, Mackenbach J, Nieboer A: Integrated approach to prevent functional decline in hospitalized elderly: the Prevention and Reactivation Care Program (PReCaP). BMC Geriatr. 2012, 12 (1): 7-10.1186/1471-2318-12-7.CrossRefPubMedPubMedCentral
22.
go back to reference Asmus-Szepesi K, de Vreede P, Nieboer A, van Wijngaarden J, Bakker T, Steyerberg E, Mackenbach J: Evaluation design of a reactivation care program to prevent functional loss in hospitalised elderly: a cohort study including a randomised controlled trial. BMC Geriatr. 2011, 11 (1): 36-10.1186/1471-2318-11-36.CrossRefPubMedPubMedCentral Asmus-Szepesi K, de Vreede P, Nieboer A, van Wijngaarden J, Bakker T, Steyerberg E, Mackenbach J: Evaluation design of a reactivation care program to prevent functional loss in hospitalised elderly: a cohort study including a randomised controlled trial. BMC Geriatr. 2011, 11 (1): 36-10.1186/1471-2318-11-36.CrossRefPubMedPubMedCentral
23.
go back to reference Stein KF, Sargent JT, Rafaels N: Intervention research: establishing fidelity of the independent variable in nursing clinical trials. Nurs Res. 2007, 56 (1): 54-62. 10.1097/00006199-200701000-00007.CrossRefPubMed Stein KF, Sargent JT, Rafaels N: Intervention research: establishing fidelity of the independent variable in nursing clinical trials. Nurs Res. 2007, 56 (1): 54-62. 10.1097/00006199-200701000-00007.CrossRefPubMed
24.
go back to reference Teague GB, Bond GR, Drake RE: Program fidelity and assertive community treatment; development and use of a measure. Am J Orthopsychiatry. 1998, 68 (2): 216-233.CrossRefPubMed Teague GB, Bond GR, Drake RE: Program fidelity and assertive community treatment; development and use of a measure. Am J Orthopsychiatry. 1998, 68 (2): 216-233.CrossRefPubMed
25.
go back to reference Perera R, Heneghan C, Yudkin P: A graphical method for depicting randomised trials of complex interventions. BMJ. 2007, 334 (7585): 127-129. 10.1136/bmj.39045.396817.68.CrossRefPubMedPubMedCentral Perera R, Heneghan C, Yudkin P: A graphical method for depicting randomised trials of complex interventions. BMJ. 2007, 334 (7585): 127-129. 10.1136/bmj.39045.396817.68.CrossRefPubMedPubMedCentral
26.
go back to reference Kelly J, Heckman TS, Stevenson LY, Williams P, Ertl T, Hays R, Leonard N, O’Donnell L, Terry M, Sogolow E, Neumann M: Transfer of research-based HIV prevention interventions to community service providers: fidelity and adaptation. AIDS Educ Prev. 2000, 12 (5 Supplement): 87-98.PubMed Kelly J, Heckman TS, Stevenson LY, Williams P, Ertl T, Hays R, Leonard N, O’Donnell L, Terry M, Sogolow E, Neumann M: Transfer of research-based HIV prevention interventions to community service providers: fidelity and adaptation. AIDS Educ Prev. 2000, 12 (5 Supplement): 87-98.PubMed
27.
go back to reference Zwarenstein M, Treweek S, Gagnier J, Altman D, Tunis S, Haynes B, Oxman A, Moher D: Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ. 2008, 337: 1223-1226.CrossRef Zwarenstein M, Treweek S, Gagnier J, Altman D, Tunis S, Haynes B, Oxman A, Moher D: Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ. 2008, 337: 1223-1226.CrossRef
28.
go back to reference Ritchie J, Spencer E: Qualitative data analysis for applied policy research. Analyzing qualitative data. Edited by: Bryman A, Burgess RG. 1994, London: Routledge, 173-194.CrossRef Ritchie J, Spencer E: Qualitative data analysis for applied policy research. Analyzing qualitative data. Edited by: Bryman A, Burgess RG. 1994, London: Routledge, 173-194.CrossRef
30.
go back to reference Bellg AAJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, Ogedegbe G, Orwig D, Ernst D, Czajkowski S: Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the nih behavior change consortium. Health Psychol. 2004, 23 (5): 443-451.CrossRefPubMed Bellg AAJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, Ogedegbe G, Orwig D, Ernst D, Czajkowski S: Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the nih behavior change consortium. Health Psychol. 2004, 23 (5): 443-451.CrossRefPubMed
31.
go back to reference Bakker TJ, Duivenvoorden HJ, van der Lee J, Krulder JW, Driesen JJ, Ribbe MW: Prevalence and prognostic importance of riskfactors for long hospital stay within elderly patients admitted to a hospital; a clinical-empirical study. Tijdschr Gerontol Geriatr. 2010, 41 (4): 177-186.CrossRefPubMed Bakker TJ, Duivenvoorden HJ, van der Lee J, Krulder JW, Driesen JJ, Ribbe MW: Prevalence and prognostic importance of riskfactors for long hospital stay within elderly patients admitted to a hospital; a clinical-empirical study. Tijdschr Gerontol Geriatr. 2010, 41 (4): 177-186.CrossRefPubMed
32.
go back to reference Perepletchikova F, Kazdin AE: Treatment integrity and therapeutic change: issues and research recommendations. Clin Psychol Sci Pract. 2005, 12 (4): 365-383. 10.1093/clipsy.bpi045.CrossRef Perepletchikova F, Kazdin AE: Treatment integrity and therapeutic change: issues and research recommendations. Clin Psychol Sci Pract. 2005, 12 (4): 365-383. 10.1093/clipsy.bpi045.CrossRef
33.
go back to reference Rice RE, Rogers EM: Reinvention in the innovation process. Sci Commun. 1980, 1 (4): 499-514. 10.1177/107554708000100402.CrossRef Rice RE, Rogers EM: Reinvention in the innovation process. Sci Commun. 1980, 1 (4): 499-514. 10.1177/107554708000100402.CrossRef
34.
go back to reference Drake R, Goldman H, Leff H, Lehman A, Dixon L, Mueser K, Torrey W: Implementing evidence-based practices in routine mental health service settings. Psychiatr Serv. 2001, 52 (2): 179-182. 10.1176/appi.ps.52.2.179.CrossRefPubMed Drake R, Goldman H, Leff H, Lehman A, Dixon L, Mueser K, Torrey W: Implementing evidence-based practices in routine mental health service settings. Psychiatr Serv. 2001, 52 (2): 179-182. 10.1176/appi.ps.52.2.179.CrossRefPubMed
35.
go back to reference Mayer JP, Blakely CH, Davidson WS: Social program innovation and dissemination: a study of organizational change processes. Rev Policy Res. 1986, 6 (2): 273-286. 10.1111/j.1541-1338.1986.tb00693.x.CrossRef Mayer JP, Blakely CH, Davidson WS: Social program innovation and dissemination: a study of organizational change processes. Rev Policy Res. 1986, 6 (2): 273-286. 10.1111/j.1541-1338.1986.tb00693.x.CrossRef
36.
go back to reference Szulanski G, Winter S: Getting it right the second time. Harv Bus Rev. 2002, 80 (1): 62-69.PubMed Szulanski G, Winter S: Getting it right the second time. Harv Bus Rev. 2002, 80 (1): 62-69.PubMed
37.
go back to reference Morrison DDM: Replicating an intervention: the tension between fidelity and adaptation. AIDS Educ Prev. 2009, 21 (2): 128-140. 10.1521/aeap.2009.21.2.128.CrossRefPubMedPubMedCentral Morrison DDM: Replicating an intervention: the tension between fidelity and adaptation. AIDS Educ Prev. 2009, 21 (2): 128-140. 10.1521/aeap.2009.21.2.128.CrossRefPubMedPubMedCentral
38.
go back to reference Hohmann A, Shear M: Community-based intervention research: coping with the “Noise” of real life in study design. Am J Psychiatry. 2002, 159 (2): 201-207. 10.1176/appi.ajp.159.2.201.CrossRefPubMed Hohmann A, Shear M: Community-based intervention research: coping with the “Noise” of real life in study design. Am J Psychiatry. 2002, 159 (2): 201-207. 10.1176/appi.ajp.159.2.201.CrossRefPubMed
39.
go back to reference Johnsen M, Samberg L, Calsyn R, Blasinsky M, Landow W, Goldman H: Case management models for persons who are homeless and mentally ill: the ACCESS demonstration project. Community Ment Health J. 1999, 35 (4): 325-346. 10.1023/A:1018761807225.CrossRefPubMed Johnsen M, Samberg L, Calsyn R, Blasinsky M, Landow W, Goldman H: Case management models for persons who are homeless and mentally ill: the ACCESS demonstration project. Community Ment Health J. 1999, 35 (4): 325-346. 10.1023/A:1018761807225.CrossRefPubMed
40.
go back to reference Price RH, Friedland DS, Choi JN, Caplan RD: Job-loss and work transitions in a time of global economic change. Addressing community problems: Psychological research and interventions. 1998, Thousand Oaks, CA, US: Sage Publications, Inc, 195-222. Price RH, Friedland DS, Choi JN, Caplan RD: Job-loss and work transitions in a time of global economic change. Addressing community problems: Psychological research and interventions. 1998, Thousand Oaks, CA, US: Sage Publications, Inc, 195-222.
41.
go back to reference Glisson C, Hemmelgarn A: The effects of organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse Negl. 1998, 22: 401-421. 10.1016/S0145-2134(98)00005-2.CrossRefPubMed Glisson C, Hemmelgarn A: The effects of organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse Negl. 1998, 22: 401-421. 10.1016/S0145-2134(98)00005-2.CrossRefPubMed
42.
go back to reference Monroe-DeVita M, Morse G, Bond G: Program fidelity and beyond: multiple strategies and criteria for ensuring quality of assertive community treatment. Psychiatr Serv. 2012, 63 (8): 743-750. 10.1176/appi.ps.201100015.CrossRefPubMed Monroe-DeVita M, Morse G, Bond G: Program fidelity and beyond: multiple strategies and criteria for ensuring quality of assertive community treatment. Psychiatr Serv. 2012, 63 (8): 743-750. 10.1176/appi.ps.201100015.CrossRefPubMed
43.
go back to reference Holter MC, Mowbray CT, Bellamy CD, MacFarlane P, Dukarski J: Critical ingredients of consumer run services: results of a national survey. Community Ment Health J. 2004, 40 (1): 47-63.CrossRefPubMed Holter MC, Mowbray CT, Bellamy CD, MacFarlane P, Dukarski J: Critical ingredients of consumer run services: results of a national survey. Community Ment Health J. 2004, 40 (1): 47-63.CrossRefPubMed
45.
go back to reference Ovretveit J: Evaluating health interventions. 1998, Buckingham: Open Univerity Press Ovretveit J: Evaluating health interventions. 1998, Buckingham: Open Univerity Press
Metadata
Title
The Prevention and Reactivation Care Program: intervention fidelity matters
Authors
Annemarie JBM de Vos
Ton JEM Bakker
Paul L de Vreede
Jeroen DH van Wijngaarden
Ewout W Steyerberg
Johan P Mackenbach
Anna P Nieboer
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2013
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-13-29

Other articles of this Issue 1/2013

BMC Health Services Research 1/2013 Go to the issue