Skip to main content
Top
Published in: Translational Behavioral Medicine 3/2017

01-09-2017 | Original Research

A multilevel modeling approach to examining the implementation-effectiveness relationship of a behavior change intervention for health care professional trainees

Authors: Jennifer R. Tomasone, PhD, Shane N. Sweet, PhD, Stuart McReynolds, BA, OCT, Kathleen A. Martin Ginis, PhD

Published in: Translational Behavioral Medicine | Issue 3/2017

Login to get access

Abstract

Changing Minds, Changing Lives, a seminar-mediated behavior change intervention, aims to enhance health care professionals’ (HCPs’) social cognitions for discussing leisure-time physical activity (LTPA) with patients with physical disabilities. This study examines which seminar implementation variables (presenter characteristics, delivery components) predict effectiveness using multilevel modeling. HCP trainees (n = 564) attended 24 seminars and completed Theory of Planned Behavior-based measures for discussing LTPA at pre-, post-, 1-month post-, and 6-months post-seminar. Implementation variables were extracted from presenter-completed questionnaires/checklists. Seminars presented by a HCP predicted positive changes in all cognitions pre-post but negative changes in attitudes and perceived behavioral control (PBC) over follow-up (ps < .05). The number of seminars the presenter had delivered predicted negative changes in attitudes and PBC during follow-up (ps < .001). Inclusion of audiovisual components predicted positive changes in attitudes pre-post (p < .001). Presenter characteristics may be “key ingredients” to educational interventions for HCPs; however, future studies should examine additional implementation variables.
Appendix
Available only for authorised users
Literature
1.
go back to reference Glasgow RE, Eakin EG, Fisher EB, Bacak SJ, Brownson RC. Physician advice and support for physical activity: results from a national survey. Am J Prev Med. 2001;21(3):189–96.CrossRefPubMed Glasgow RE, Eakin EG, Fisher EB, Bacak SJ, Brownson RC. Physician advice and support for physical activity: results from a national survey. Am J Prev Med. 2001;21(3):189–96.CrossRefPubMed
2.
go back to reference Andersen R, Blair S, Cheskin L, Barlett S. Encouraging patients to become more physically active: the physician’s role. Ann Intern Med. 1997;127(5):395–400.CrossRefPubMed Andersen R, Blair S, Cheskin L, Barlett S. Encouraging patients to become more physically active: the physician’s role. Ann Intern Med. 1997;127(5):395–400.CrossRefPubMed
3.
go back to reference Douglas F, Torrance N, van Teijlingen E, Meloni S, Kerr A. Primary care staff’s views and experiences related to routinely advising patients about physical activity: a questionnaire survey. BMC Public Health. 2006;6:138.CrossRefPubMedPubMedCentral Douglas F, Torrance N, van Teijlingen E, Meloni S, Kerr A. Primary care staff’s views and experiences related to routinely advising patients about physical activity: a questionnaire survey. BMC Public Health. 2006;6:138.CrossRefPubMedPubMedCentral
4.
go back to reference O’Brien MW, Shields CA, Oh PI, Fowles JR. Health care provider confidence and exercise prescription practices of exercise is medicine Canada workshop attendees. Appl Physiol Nutr Metab. 2016;1–7. O’Brien MW, Shields CA, Oh PI, Fowles JR. Health care provider confidence and exercise prescription practices of exercise is medicine Canada workshop attendees. Appl Physiol Nutr Metab. 2016;1–7.
5.
go back to reference Rimmer JH, Riley B, Wang E, Rauworth A, Jurkowski J. Physical activity participation among persons with disabilities: barriers and facilitators. Am J Prev Med. 2004;26(5):419–25.CrossRefPubMed Rimmer JH, Riley B, Wang E, Rauworth A, Jurkowski J. Physical activity participation among persons with disabilities: barriers and facilitators. Am J Prev Med. 2004;26(5):419–25.CrossRefPubMed
6.
go back to reference Statistics Canada. Participation and activity limitation survey 2001. Ottawa, Ontario 2001. Statistics Canada. Participation and activity limitation survey 2001. Ottawa, Ontario 2001.
7.
go back to reference Faulkner G, Gorczynski P, Arbour KP, Letts L, Wolfe DL, Martin Ginis KA. Messengers and methods of disseminating health information among individuals with spinal cord injury. In: Berkovsky TC, ed. Handbook of spinal cord injuries. New York: Nova Science Publishers, Inc.; 2010:329–74. Faulkner G, Gorczynski P, Arbour KP, Letts L, Wolfe DL, Martin Ginis KA. Messengers and methods of disseminating health information among individuals with spinal cord injury. In: Berkovsky TC, ed. Handbook of spinal cord injuries. New York: Nova Science Publishers, Inc.; 2010:329–74.
8.
go back to reference Letts L, Martin Ginis KA, Faulkner G, Colquhoun H, Levac D, Gorczynski P. Preferred methods and messengers for delivering physical activity information to people with spinal cord injury: a focus group study. Rehabil Psychol. 2011;56(2):128–37.CrossRefPubMed Letts L, Martin Ginis KA, Faulkner G, Colquhoun H, Levac D, Gorczynski P. Preferred methods and messengers for delivering physical activity information to people with spinal cord injury: a focus group study. Rehabil Psychol. 2011;56(2):128–37.CrossRefPubMed
9.
go back to reference Stancic N, Mullen PD, Prokhorov AV, Frankowski RF, McAlister AL. Continuing medical education: what delivery format do physicians prefer? J Contin Educ Heal Prof. 2003;23(3):162–7.CrossRef Stancic N, Mullen PD, Prokhorov AV, Frankowski RF, McAlister AL. Continuing medical education: what delivery format do physicians prefer? J Contin Educ Heal Prof. 2003;23(3):162–7.CrossRef
10.
go back to reference Forsetlund L, Bjornal A, Rashidian A, et al. Continuing education meetings and workshops: effects on professional practice and health care outcomes (Review). Cochrane Database Syst Rev. 2009;2(Art. No.: CD003030). Forsetlund L, Bjornal A, Rashidian A, et al. Continuing education meetings and workshops: effects on professional practice and health care outcomes (Review). Cochrane Database Syst Rev. 2009;2(Art. No.: CD003030).
11.
go back to reference Grimshaw JM, Eccles MP, Walker AE, Thomas RE. Changing physicians’s behavior: what works and thoughts on getting more things to work. J Contin Educ Heal Prof. 2002;22(4):237–43.CrossRef Grimshaw JM, Eccles MP, Walker AE, Thomas RE. Changing physicians’s behavior: what works and thoughts on getting more things to work. J Contin Educ Heal Prof. 2002;22(4):237–43.CrossRef
12.
go back to reference Cripps DG, Tomasone JR, Staples KL. Canadian initiatives in disability sport and recreation: an overview of the moving to inclusion and changing minds, changing lives programs. In: Brittain I, ed. Disability sport: A vehicle for social change? Champaign: Common Ground Publishing; 2013:22–8. Cripps DG, Tomasone JR, Staples KL. Canadian initiatives in disability sport and recreation: an overview of the moving to inclusion and changing minds, changing lives programs. In: Brittain I, ed. Disability sport: A vehicle for social change? Champaign: Common Ground Publishing; 2013:22–8.
13.
go back to reference Tomasone JR, Martin Ginis KA, Estabrooks PA, Domenicucci L. Changing Minds, Changing Lives from the top down: An investigation of the dissemination and adoption of a Canadawide educational intervention to enhance health care professionals’ intentions to prescribe physical activity. Int J Behav Med. 2015;22(5):336–344. https://doi.org/10.1007/s12529-014-9414-6. Tomasone JR, Martin Ginis KA, Estabrooks PA, Domenicucci L. Changing Minds, Changing Lives from the top down: An investigation of the dissemination and adoption of a Canadawide educational intervention to enhance health care professionals’ intentions to prescribe physical activity. Int J Behav Med. 2015;22(5):336–344. https://​doi.​org/​10.​1007/​s12529-014-9414-6.
14.
go back to reference Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process. 1991;50(2):179–211.CrossRef Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process. 1991;50(2):179–211.CrossRef
15.
go back to reference Eccles M, Grimshaw J, Walker A, Johnson M, Pitts N. Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. J Clin Epidemiol. 2005;58:107–12.CrossRefPubMed Eccles M, Grimshaw J, Walker A, Johnson M, Pitts N. Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. J Clin Epidemiol. 2005;58:107–12.CrossRefPubMed
17.
go back to reference Godin G, Belanger-Gravel A, Eccles M, Grimshaw J. Healthcare professionals’ intentions and behaviors: a systematic review of studies based on social cognitive theories. Implement Sci. 2008;3:36.CrossRefPubMedPubMedCentral Godin G, Belanger-Gravel A, Eccles M, Grimshaw J. Healthcare professionals’ intentions and behaviors: a systematic review of studies based on social cognitive theories. Implement Sci. 2008;3:36.CrossRefPubMedPubMedCentral
18.
go back to reference Tomasone JR, Martin Ginis KA, Estabrooks PA, Domenicucci L. “Changing Minds”: Determining the effectiveness and key ingredients of an educational intervention to enhance health care professionals’ intentions to prescribe physical activity to patients with a physical disability. Implement Sci. 2014;9:30. https://doi.org/10.1186/1748-5908-9-30. Tomasone JR, Martin Ginis KA, Estabrooks PA, Domenicucci L. “Changing Minds”: Determining the effectiveness and key ingredients of an educational intervention to enhance health care professionals’ intentions to prescribe physical activity to patients with a physical disability. Implement Sci. 2014;9:30. https://​doi.​org/​10.​1186/​1748-5908-9-30.
20.
go back to reference Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41:327–50.CrossRefPubMed Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41:327–50.CrossRefPubMed
21.
go back to reference Berkel C, Mauricio AM, Schoenfelder E, Sandler IN. Putting the pieces together: an integrated model of program implementation. Prev Sci. 2011;12(1):23–33.CrossRefPubMedPubMedCentral Berkel C, Mauricio AM, Schoenfelder E, Sandler IN. Putting the pieces together: an integrated model of program implementation. Prev Sci. 2011;12(1):23–33.CrossRefPubMedPubMedCentral
22.
go back to reference Allen JDLL, Emmons KM. Fidelity and its relationship to implementation effectiveness, adaptation, and dissemination. In: Dissemination and implementation research in health: translating science to practice: Oxford University Press; 2012:281–304. Allen JDLL, Emmons KM. Fidelity and its relationship to implementation effectiveness, adaptation, and dissemination. In: Dissemination and implementation research in health: translating science to practice: Oxford University Press; 2012:281–304.
23.
go back to reference Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50.CrossRefPubMedPubMedCentral Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50.CrossRefPubMedPubMedCentral
24.
go back to reference Rogers E. Diffusion of Innovations. 5th ed. New York: Free Press; 2003. Rogers E. Diffusion of Innovations. 5th ed. New York: Free Press; 2003.
26.
go back to reference Moore GF, Audrey S, Barker M, et al. Process evaluation of complex interventions: Medical Research Council guidance. Br Med J. 2015;350. Moore GF, Audrey S, Barker M, et al. Process evaluation of complex interventions: Medical Research Council guidance. Br Med J. 2015;350.
27.
go back to reference Dusenbury L, Brannigan R, Hansen WB, Walsh J, Falco M. Quality of implementation: developing measures crucial to understanding the diffusion of preventive interventions. Health Educ Res. 2005;20(3):308–13.CrossRefPubMed Dusenbury L, Brannigan R, Hansen WB, Walsh J, Falco M. Quality of implementation: developing measures crucial to understanding the diffusion of preventive interventions. Health Educ Res. 2005;20(3):308–13.CrossRefPubMed
28.
go back to reference Tomasone JR, Arbour-Nicitopoulos KP, Latimer-Cheung AE, Martin Ginis KA. The relationship between the implementation and effectiveness of a nationwide physical activity telephone counseling service for adults with spinal cord injury. Disabil Rehabil. 2016;1–11. Tomasone JR, Arbour-Nicitopoulos KP, Latimer-Cheung AE, Martin Ginis KA. The relationship between the implementation and effectiveness of a nationwide physical activity telephone counseling service for adults with spinal cord injury. Disabil Rehabil. 2016;1–11.
29.
go back to reference Hox J. Multilevel analysis: techniques and applications. New York: Lawrence Erlbaum Associates; 2002. Hox J. Multilevel analysis: techniques and applications. New York: Lawrence Erlbaum Associates; 2002.
31.
go back to reference Rhodes RE, Courneya KS. Differentiating motivation and control in the theory of planned behavior. Psychol Health Med. 2004;9(2):205–15.CrossRef Rhodes RE, Courneya KS. Differentiating motivation and control in the theory of planned behavior. Psychol Health Med. 2004;9(2):205–15.CrossRef
32.
go back to reference Tabachnick BG, Fidell LS. Using multivariate statistics. 5th ed. Boston: Allyn & Bacon; 2007. Tabachnick BG, Fidell LS. Using multivariate statistics. 5th ed. Boston: Allyn & Bacon; 2007.
33.
go back to reference HLM 6: Hierarchical linear and nonlinear modeling [computer program]. Lincolnwood, Illinois: Scientific Softwarre International, Inc.; 2004. HLM 6: Hierarchical linear and nonlinear modeling [computer program]. Lincolnwood, Illinois: Scientific Softwarre International, Inc.; 2004.
34.
go back to reference Seltzer M, Svartberg M. The use of piecewise growth models in evaluations of interventions: CSE technical report 477. Los Angeles: Center for Study of Evaluation; 1998.CrossRef Seltzer M, Svartberg M. The use of piecewise growth models in evaluations of interventions: CSE technical report 477. Los Angeles: Center for Study of Evaluation; 1998.CrossRef
35.
go back to reference Singer JD, Willet JB. Applied longitudinal data analysis: modeling change and event occurence. New York: Oxford University Press, Inc.; 2003.CrossRef Singer JD, Willet JB. Applied longitudinal data analysis: modeling change and event occurence. New York: Oxford University Press, Inc.; 2003.CrossRef
36.
go back to reference Raudenbush SW, et al. Optimal Design Software for Multi-level and Longitudinal Research (Version 3.01) [Software]. 2011. Raudenbush SW, et al. Optimal Design Software for Multi-level and Longitudinal Research (Version 3.01) [Software]. 2011.
37.
go back to reference Young MS, Robinson S, Alberts P. Students pay attention! Combating the vigilance decrement to improve learning during lectures. Act Learn High Educ. 2009;10(1):41–55.CrossRef Young MS, Robinson S, Alberts P. Students pay attention! Combating the vigilance decrement to improve learning during lectures. Act Learn High Educ. 2009;10(1):41–55.CrossRef
38.
go back to reference Mason J, Freemantle N, Nazareth I, Eccles M, Haines A, Drummond M. When is it cost-effective to change the behavior of health professionals? J Am Med Assoc. 2001;286(3):2988–92.CrossRef Mason J, Freemantle N, Nazareth I, Eccles M, Haines A, Drummond M. When is it cost-effective to change the behavior of health professionals? J Am Med Assoc. 2001;286(3):2988–92.CrossRef
39.
go back to reference Miller K, Zhou X. Learning from classroom video: what makes it compelling and what makes it hard? In: Goldman R, Pea R, Barron B, Derry SJ, eds. Video research in the learning sciences. New York: Routledge; 2007. Miller K, Zhou X. Learning from classroom video: what makes it compelling and what makes it hard? In: Goldman R, Pea R, Barron B, Derry SJ, eds. Video research in the learning sciences. New York: Routledge; 2007.
40.
go back to reference Cervero RM, Gaines JK. The impact of CME on physician performance and patient health outcomes: an updated synthesis of systematic reviews. J Contin Educ Heal Prof. 2015;35(2):131–8.CrossRef Cervero RM, Gaines JK. The impact of CME on physician performance and patient health outcomes: an updated synthesis of systematic reviews. J Contin Educ Heal Prof. 2015;35(2):131–8.CrossRef
41.
go back to reference Copeland HL, Hewson MG, Stoller JK, Longworth DL. Making the continuing medical education lecture effective. J Contin Educ Heal Prof. 1998;18(4):227–34.CrossRef Copeland HL, Hewson MG, Stoller JK, Longworth DL. Making the continuing medical education lecture effective. J Contin Educ Heal Prof. 1998;18(4):227–34.CrossRef
42.
go back to reference Durlak JA. The importance of doing well in whatever you do: a commentary on the special section, "implementation research in early childhood education". Early Child Res Q. 2010;25:348–57.CrossRef Durlak JA. The importance of doing well in whatever you do: a commentary on the special section, "implementation research in early childhood education". Early Child Res Q. 2010;25:348–57.CrossRef
43.
go back to reference Chaudoir SR, Dugan AG, Barr CH. Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures. Implement Sci. 2013;8(1):22.CrossRefPubMedPubMedCentral Chaudoir SR, Dugan AG, Barr CH. Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures. Implement Sci. 2013;8(1):22.CrossRefPubMedPubMedCentral
Metadata
Title
A multilevel modeling approach to examining the implementation-effectiveness relationship of a behavior change intervention for health care professional trainees
Authors
Jennifer R. Tomasone, PhD
Shane N. Sweet, PhD
Stuart McReynolds, BA, OCT
Kathleen A. Martin Ginis, PhD
Publication date
01-09-2017
Publisher
Springer US
Published in
Translational Behavioral Medicine / Issue 3/2017
Print ISSN: 1869-6716
Electronic ISSN: 1613-9860
DOI
https://doi.org/10.1007/s13142-017-0526-9

Other articles of this Issue 3/2017

Translational Behavioral Medicine 3/2017 Go to the issue