Skip to main content
Top
Published in: Implementation Science 1/2014

Open Access 01-12-2014 | Research

Measuring determinants of implementation behavior: psychometric properties of a questionnaire based on the theoretical domains framework

Authors: Johanna M Huijg, Winifred A Gebhardt, Elise Dusseldorp, Marieke W Verheijden, Nicolette van der Zouwe, Barend JC Middelkoop, Mathilde R Crone

Published in: Implementation Science | Issue 1/2014

Login to get access

Abstract

Background

To be able to design effective strategies to improve healthcare professionals’ implementation behaviors, a valid and reliable questionnaire is needed to assess potential implementation determinants. The present study describes the development of the Determinants of Implementation Behavior Questionnaire (DIBQ) and investigates the reliability and validity of this Theoretical Domains Framework (TDF)-based questionnaire.

Methods

The DIBQ was developed to measure the potential behavioral determinants of the 12-domain version of the TDF (Michie et al., 2005). We identified existing questionnaires including items assessing constructs within TDF domains and developed new items where needed. Confirmatory factor analysis was used to examine whether the predefined structure of the TDF-based questionnaire was supported by the data. Cronbach’s alpha was calculated to assess internal consistency reliability of the questionnaire, and domains’ discriminant validity was investigated.

Results

We developed an initial questionnaire containing 100 items assessing 12 domains. Results obtained from confirmatory factor analysis and Cronbach’s alpha resulted in the final questionnaire consisting of 93 items assessing 18 domains, explaining 63.3% of the variance, and internal consistency reliability values ranging from .68 to .93. Domains demonstrated good discriminant validity, although the domains ‘Knowledge’ and ‘Skills’ and the domains ‘Skills’ and ‘Social/professional role and identity’ were highly correlated.

Conclusions

We have developed a valid and reliable questionnaire that can be used to assess potential determinants of healthcare professional implementation behavior following the theoretical domains of the TDF. The DIBQ can be used by researchers and practitioners who are interested in identifying determinants of implementation behaviors in order to be able to develop effective strategies to improve healthcare professionals’ implementation behaviors. Furthermore, the findings provide a novel validation of the TDF and indicate that the domain ‘Environmental context and resources’ might be divided into several environment-related domains.
Appendix
Available only for authorised users
Literature
1.
2.
go back to reference Glasgow RE, Lichtenstein E, Marcus AC: Why don’t we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003, 93: 1261-1267. 10.2105/AJPH.93.8.1261.CrossRefPubMedPubMedCentral Glasgow RE, Lichtenstein E, Marcus AC: Why don’t we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003, 93: 1261-1267. 10.2105/AJPH.93.8.1261.CrossRefPubMedPubMedCentral
3.
go back to reference Haines A, Kuruvilla S, Borchert M: Policy and practice bridging the implementation gap between knowledge and action for health. Bull World Health Organ. 2004, 82: 724-732.PubMedPubMedCentral Haines A, Kuruvilla S, Borchert M: Policy and practice bridging the implementation gap between knowledge and action for health. Bull World Health Organ. 2004, 82: 724-732.PubMedPubMedCentral
4.
go back to reference Glasgow R, Klesges L, Dzewaltowski DA, Bull SS, Estabrooks PA: The future of physical activity behavior change research: what is needed to improve translation of research into health promotion practice?. Ann Behav Med. 2004, 27: 3-12. 10.1207/s15324796abm2701_2.CrossRefPubMed Glasgow R, Klesges L, Dzewaltowski DA, Bull SS, Estabrooks PA: The future of physical activity behavior change research: what is needed to improve translation of research into health promotion practice?. Ann Behav Med. 2004, 27: 3-12. 10.1207/s15324796abm2701_2.CrossRefPubMed
5.
go back to reference Eccles MP, Armstrong D, Baker R, Cleary K, Davies H, Davies S, Glasziou P, Ilott I, Kinmonth A-L, Leng G, Logan S, Marteau T, Michie S, Rogers H, Rycroft-Malone J, Sibbald B: An implementation research agenda. Implement Sci. 2009, 4: 18-10.1186/1748-5908-4-18.CrossRefPubMedPubMedCentral Eccles MP, Armstrong D, Baker R, Cleary K, Davies H, Davies S, Glasziou P, Ilott I, Kinmonth A-L, Leng G, Logan S, Marteau T, Michie S, Rogers H, Rycroft-Malone J, Sibbald B: An implementation research agenda. Implement Sci. 2009, 4: 18-10.1186/1748-5908-4-18.CrossRefPubMedPubMedCentral
6.
go back to reference Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003, 362: 1225-1230. 10.1016/S0140-6736(03)14546-1.CrossRefPubMed Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003, 362: 1225-1230. 10.1016/S0140-6736(03)14546-1.CrossRefPubMed
7.
go back to reference Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S: A conceptual framework for implementation fidelity. Implement Sci. 2007, 2: 40-10.1186/1748-5908-2-40.CrossRefPubMedPubMedCentral Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S: A conceptual framework for implementation fidelity. Implement Sci. 2007, 2: 40-10.1186/1748-5908-2-40.CrossRefPubMedPubMedCentral
8.
go back to reference Fleuren M, Wiefferink K, Paulussen T: Determinants of innovation within health care organizations: literature review and Delphi study. Int J Qual Health Care. 2004, 16: 107-123. 10.1093/intqhc/mzh030.CrossRefPubMed Fleuren M, Wiefferink K, Paulussen T: Determinants of innovation within health care organizations: literature review and Delphi study. Int J Qual Health Care. 2004, 16: 107-123. 10.1093/intqhc/mzh030.CrossRefPubMed
9.
go back to reference Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral
10.
go back to reference Grol R, Wensing M, Eccles M: Improving Patient Care: The Implementation of Change in Clinical Practice. 2005, Oxford: Elsevier Grol R, Wensing M, Eccles M: Improving Patient Care: The Implementation of Change in Clinical Practice. 2005, Oxford: Elsevier
11.
go back to reference Rogers EM: Diffusion of Innovations. 1983, New York: The Free Press Rogers EM: Diffusion of Innovations. 1983, New York: The Free Press
12.
go back to reference Chaudoir SR, Dugan AG, Barr CHI: Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level. Implement Sci. 2013, 8: 22-10.1186/1748-5908-8-22.CrossRefPubMedPubMedCentral Chaudoir SR, Dugan AG, Barr CHI: Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level. Implement Sci. 2013, 8: 22-10.1186/1748-5908-8-22.CrossRefPubMedPubMedCentral
13.
go back to reference Huijg JM, Crone MR, Verheijden MW, van der Zouwe N, Middelkoop BJC, Gebhardt WA: Factors influencing the adoption, implementation, and continuation of physical activity interventions in primary health care: a Delphi study. BMC Fam Pract. 2013, 14: 142-10.1186/1471-2296-14-142.CrossRefPubMedPubMedCentral Huijg JM, Crone MR, Verheijden MW, van der Zouwe N, Middelkoop BJC, Gebhardt WA: Factors influencing the adoption, implementation, and continuation of physical activity interventions in primary health care: a Delphi study. BMC Fam Pract. 2013, 14: 142-10.1186/1471-2296-14-142.CrossRefPubMedPubMedCentral
14.
go back to reference Eccles M, Grimshaw J, Walker A, Johnston M, Pitts N: Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. J Clin Epidemiol. 2005, 58: 107-112. 10.1016/j.jclinepi.2004.09.002.CrossRefPubMed Eccles M, Grimshaw J, Walker A, Johnston M, Pitts N: Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. J Clin Epidemiol. 2005, 58: 107-112. 10.1016/j.jclinepi.2004.09.002.CrossRefPubMed
15.
go back to reference Foy R, Eccles M, Grimshaw J: Why does primary care need more implementation 5esearch?. Fam Pract. 2001, 18: 353-355. 10.1093/fampra/18.4.353.CrossRefPubMed Foy R, Eccles M, Grimshaw J: Why does primary care need more implementation 5esearch?. Fam Pract. 2001, 18: 353-355. 10.1093/fampra/18.4.353.CrossRefPubMed
16.
go back to reference French SD, Green SE, O’Connor DA, McKenzie JE, Francis JJ, Michie S, Buchbinder R, Schattner P, Spike N, Grimshaw JM: Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the theoretical domains framework. Implement Sci. 2012, 7: 38-10.1186/1748-5908-7-38.CrossRefPubMedPubMedCentral French SD, Green SE, O’Connor DA, McKenzie JE, Francis JJ, Michie S, Buchbinder R, Schattner P, Spike N, Grimshaw JM: Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the theoretical domains framework. Implement Sci. 2012, 7: 38-10.1186/1748-5908-7-38.CrossRefPubMedPubMedCentral
17.
go back to reference Michie S, Johnston M, Francis J, Hardeman W, Eccles M: From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008, 57: 660-680. 10.1111/j.1464-0597.2008.00341.x.CrossRef Michie S, Johnston M, Francis J, Hardeman W, Eccles M: From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008, 57: 660-680. 10.1111/j.1464-0597.2008.00341.x.CrossRef
18.
go back to reference Presseau J, Johnston M, Francis J, Hrisos S, Stamp E, Steen N, Hawthorne G, Grimshaw J, Elovainio M, Hunter M, Eccles M: Theory-based predictors of multiple clinician behaviors in the management of diabetes. J Behav Med. 2013, epub ahead of print Presseau J, Johnston M, Francis J, Hrisos S, Stamp E, Steen N, Hawthorne G, Grimshaw J, Elovainio M, Hunter M, Eccles M: Theory-based predictors of multiple clinician behaviors in the management of diabetes. J Behav Med. 2013, epub ahead of print
19.
go back to reference Flottorp SA, Oxman AD, Krause J, Musila NR, Wensing M, Godycki-Cwirko M, Baker R, Eccles MP: A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci. 2013, 8: 35-10.1186/1748-5908-8-35.CrossRefPubMedPubMedCentral Flottorp SA, Oxman AD, Krause J, Musila NR, Wensing M, Godycki-Cwirko M, Baker R, Eccles MP: A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci. 2013, 8: 35-10.1186/1748-5908-8-35.CrossRefPubMedPubMedCentral
20.
go back to reference Grimshaw JM, Shirran L, Thomas R, Mowatt G, Fraser C, Bero L, Grilli R, Harvey E, Oxman A, O’Brien MA: Changing provider behavior: an overview of systematic reviews of interventions. Med Care. 2001, 39: II2-II45.CrossRefPubMed Grimshaw JM, Shirran L, Thomas R, Mowatt G, Fraser C, Bero L, Grilli R, Harvey E, Oxman A, O’Brien MA: Changing provider behavior: an overview of systematic reviews of interventions. Med Care. 2001, 39: II2-II45.CrossRefPubMed
21.
go back to reference Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8: 6-CrossRef Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8: 6-CrossRef
22.
go back to reference Davies P, Walker AE, Grimshaw JM: A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010, 5: 14-10.1186/1748-5908-5-14.CrossRefPubMedPubMedCentral Davies P, Walker AE, Grimshaw JM: A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010, 5: 14-10.1186/1748-5908-5-14.CrossRefPubMedPubMedCentral
23.
go back to reference The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG): Designing theoretically-informed implementation interventions. Implement Sci. 2006, 1: 4-CrossRef The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG): Designing theoretically-informed implementation interventions. Implement Sci. 2006, 1: 4-CrossRef
24.
go back to reference Francis JJ, Tinmouth A, Stanworth SJ, Grimshaw JM, Johnston M, Hyde C, Stockton C, Brehaut JC, Fergusson D, Eccles MP: Using theories of behaviour to understand transfusion prescribing in three clinical contexts in two countries: development work for an implementation trial. Implement Sci. 2009, 4: 70-10.1186/1748-5908-4-70.CrossRefPubMedPubMedCentral Francis JJ, Tinmouth A, Stanworth SJ, Grimshaw JM, Johnston M, Hyde C, Stockton C, Brehaut JC, Fergusson D, Eccles MP: Using theories of behaviour to understand transfusion prescribing in three clinical contexts in two countries: development work for an implementation trial. Implement Sci. 2009, 4: 70-10.1186/1748-5908-4-70.CrossRefPubMedPubMedCentral
25.
go back to reference Grol RPTM, Bosch MC, Hulscher MEJL, Eccles MP, Wensing M: Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q. 2007, 85: 93-138. 10.1111/j.1468-0009.2007.00478.x.CrossRefPubMedPubMedCentral Grol RPTM, Bosch MC, Hulscher MEJL, Eccles MP, Wensing M: Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q. 2007, 85: 93-138. 10.1111/j.1468-0009.2007.00478.x.CrossRefPubMedPubMedCentral
26.
go back to reference Rothman AJ: “Is there nothing more practical than a good theory?”: why innovations and advances in health behavior change will arise if interventions are used to test and refine theory. Int J Behav Nutr Phys. 2004, 1: 11-10.1186/1479-5868-1-11.CrossRef Rothman AJ: “Is there nothing more practical than a good theory?”: why innovations and advances in health behavior change will arise if interventions are used to test and refine theory. Int J Behav Nutr Phys. 2004, 1: 11-10.1186/1479-5868-1-11.CrossRef
27.
go back to reference Francis JJ, Stockton C, Eccles MP, Johnston M, Cuthbertson BH, Grimshaw JM, Hyde C, Tinmouth A, Stanworth SJ: Evidence-based selection of theories for designing behaviour change interventions: using methods based on theoretical construct domains to understand clinicians’ blood transfusion behaviour. Br J Health Psychol. 2009, 14: 625-646. 10.1348/135910708X397025.CrossRefPubMed Francis JJ, Stockton C, Eccles MP, Johnston M, Cuthbertson BH, Grimshaw JM, Hyde C, Tinmouth A, Stanworth SJ: Evidence-based selection of theories for designing behaviour change interventions: using methods based on theoretical construct domains to understand clinicians’ blood transfusion behaviour. Br J Health Psychol. 2009, 14: 625-646. 10.1348/135910708X397025.CrossRefPubMed
28.
go back to reference Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A: Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005, 14: 26-33. 10.1136/qshc.2004.011155.CrossRefPubMedPubMedCentral Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A: Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005, 14: 26-33. 10.1136/qshc.2004.011155.CrossRefPubMedPubMedCentral
29.
go back to reference Cane J, O’Connor D, Michie S: Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012, 7: 37-10.1186/1748-5908-7-37.CrossRefPubMedPubMedCentral Cane J, O’Connor D, Michie S: Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012, 7: 37-10.1186/1748-5908-7-37.CrossRefPubMedPubMedCentral
30.
go back to reference McSherry LA, Dombrowski SU, Francis JJ, Murphy J, Martin CM, O’Leary JJ, Sharp L, ATHENS Group: ‘It’s a can of worms’: understanding primary care practitioners' behaviours in relation to HPV using the theoretical domains framework. Implement Sci. 2012, 7: 73-10.1186/1748-5908-7-73.CrossRefPubMedPubMedCentral McSherry LA, Dombrowski SU, Francis JJ, Murphy J, Martin CM, O’Leary JJ, Sharp L, ATHENS Group: ‘It’s a can of worms’: understanding primary care practitioners' behaviours in relation to HPV using the theoretical domains framework. Implement Sci. 2012, 7: 73-10.1186/1748-5908-7-73.CrossRefPubMedPubMedCentral
31.
go back to reference Patey AM, Islam R, Francis JJ, Bryson GL, Grimshaw JM: Anesthesiologists’ and surgeons’ perceptions about routine pre-operative testing in low-risk patients: application of the Theoretical Domains Framework (TDF) to identify factors that influence physicians’ decisions to order pre-operative tests. Implement Sci. 2012, 7: 52-10.1186/1748-5908-7-52.CrossRefPubMedPubMedCentral Patey AM, Islam R, Francis JJ, Bryson GL, Grimshaw JM: Anesthesiologists’ and surgeons’ perceptions about routine pre-operative testing in low-risk patients: application of the Theoretical Domains Framework (TDF) to identify factors that influence physicians’ decisions to order pre-operative tests. Implement Sci. 2012, 7: 52-10.1186/1748-5908-7-52.CrossRefPubMedPubMedCentral
32.
go back to reference Islam R, Tinmouth AT, Francis JJ, Brehaut JC, Born J, Stockton C, Stanworth SJ, Eccles MP, Cuthbertson BH, Hyde C, Grimshaw JM: A cross-country comparison of intensive care physicians’ beliefs about their transfusion behaviour: a qualitative study using the theoretical domains framework. Implement Sci. 2012, 7: 93-10.1186/1748-5908-7-93.CrossRefPubMedPubMedCentral Islam R, Tinmouth AT, Francis JJ, Brehaut JC, Born J, Stockton C, Stanworth SJ, Eccles MP, Cuthbertson BH, Hyde C, Grimshaw JM: A cross-country comparison of intensive care physicians’ beliefs about their transfusion behaviour: a qualitative study using the theoretical domains framework. Implement Sci. 2012, 7: 93-10.1186/1748-5908-7-93.CrossRefPubMedPubMedCentral
33.
go back to reference Curran JA, Brehaut J, Patey AM, Osmond M, Stiell I, Grimshaw JM: Understanding the Canadian adult CT head rule trial: use of the theoretical domains framework for process evaluation. Implement Sci. 2013, 8: 25-10.1186/1748-5908-8-25.CrossRefPubMedPubMedCentral Curran JA, Brehaut J, Patey AM, Osmond M, Stiell I, Grimshaw JM: Understanding the Canadian adult CT head rule trial: use of the theoretical domains framework for process evaluation. Implement Sci. 2013, 8: 25-10.1186/1748-5908-8-25.CrossRefPubMedPubMedCentral
34.
go back to reference Dyson J, Lawton R, Jackson C, Cheater F: Does the use of a theoretical approach tell us more about hand hygiene behaviour? The barriers and levers to hand hygiene. J Infect Prev. 2011, 12: 17-24. 10.1177/1757177410384300.CrossRef Dyson J, Lawton R, Jackson C, Cheater F: Does the use of a theoretical approach tell us more about hand hygiene behaviour? The barriers and levers to hand hygiene. J Infect Prev. 2011, 12: 17-24. 10.1177/1757177410384300.CrossRef
35.
go back to reference Mazza D, Chapman A, Michie S: Barriers to the implementation of preconception care guidelines as perceived by general practitioners: a qualitative study. BMC Health Serv Res. 2013, 13: 36-10.1186/1472-6963-13-36.CrossRefPubMedPubMedCentral Mazza D, Chapman A, Michie S: Barriers to the implementation of preconception care guidelines as perceived by general practitioners: a qualitative study. BMC Health Serv Res. 2013, 13: 36-10.1186/1472-6963-13-36.CrossRefPubMedPubMedCentral
36.
go back to reference Michie S, Pilling S, Garety P, Whitty P, Eccles M, Johnston M, Simmons J: Difficulties implementing a mental health guideline: an exploratory investigation using psychological theory. Implement Sci. 2007, 2: 8-10.1186/1748-5908-2-8.CrossRefPubMedPubMedCentral Michie S, Pilling S, Garety P, Whitty P, Eccles M, Johnston M, Simmons J: Difficulties implementing a mental health guideline: an exploratory investigation using psychological theory. Implement Sci. 2007, 2: 8-10.1186/1748-5908-2-8.CrossRefPubMedPubMedCentral
37.
go back to reference Amemori M, Michie S, Korhonen T, Murtomaa H, Kinnunen TH: Assessing implementation difficulties in tobacco use prevention and cessation counselling among dental providers. Implement Sci. 2011, 6: 50-10.1186/1748-5908-6-50.CrossRefPubMedPubMedCentral Amemori M, Michie S, Korhonen T, Murtomaa H, Kinnunen TH: Assessing implementation difficulties in tobacco use prevention and cessation counselling among dental providers. Implement Sci. 2011, 6: 50-10.1186/1748-5908-6-50.CrossRefPubMedPubMedCentral
38.
go back to reference Beenstock J, Sniehotta FF, White M, Bell R, Milne EM, Araujo-Soares V: What helps and hinders midwives in engaging with pregnant women about stopping smoking? A cross-sectional survey of perceived implementation difficulties among midwives in the northeast of England. Implement Sci. 2012, 7: 36-10.1186/1748-5908-7-36.CrossRefPubMedPubMedCentral Beenstock J, Sniehotta FF, White M, Bell R, Milne EM, Araujo-Soares V: What helps and hinders midwives in engaging with pregnant women about stopping smoking? A cross-sectional survey of perceived implementation difficulties among midwives in the northeast of England. Implement Sci. 2012, 7: 36-10.1186/1748-5908-7-36.CrossRefPubMedPubMedCentral
39.
go back to reference Taylor N, Parveen S, Robins V, Slater B, Lawton R: Development and initial validation of the influences on patient safety behaviours questionnaire. Implement Sci. 2013, 8: 81-10.1186/1748-5908-8-81.CrossRefPubMedPubMedCentral Taylor N, Parveen S, Robins V, Slater B, Lawton R: Development and initial validation of the influences on patient safety behaviours questionnaire. Implement Sci. 2013, 8: 81-10.1186/1748-5908-8-81.CrossRefPubMedPubMedCentral
40.
go back to reference Huijg JM, Gebhardt WA, Crone MR, Dusseldorp E, Presseau J: Discriminant content validity of a Theoretical Domains Framework questionnaire for use in implementation research. Implement Sci. 2014, 9: 11-10.1186/1748-5908-9-11.CrossRefPubMedPubMedCentral Huijg JM, Gebhardt WA, Crone MR, Dusseldorp E, Presseau J: Discriminant content validity of a Theoretical Domains Framework questionnaire for use in implementation research. Implement Sci. 2014, 9: 11-10.1186/1748-5908-9-11.CrossRefPubMedPubMedCentral
41.
go back to reference Ajzen I: The theory of planned behavior. Organ Behav Hum Decis. 1991, 50: 179-211. 10.1016/0749-5978(91)90020-T.CrossRef Ajzen I: The theory of planned behavior. Organ Behav Hum Decis. 1991, 50: 179-211. 10.1016/0749-5978(91)90020-T.CrossRef
42.
go back to reference Bandura A: Health promotion from the perspective of social cognitive theory. Psychol Health. 1998, 13: 623-649. 10.1080/08870449808407422.CrossRef Bandura A: Health promotion from the perspective of social cognitive theory. Psychol Health. 1998, 13: 623-649. 10.1080/08870449808407422.CrossRef
43.
go back to reference Huijg JM, van der Zouwe N, Gebhardt WA, Crone MR, Verheijden MW, Middelkoop BJC: Introducing physical activity interventions in primary health care: a qualitative study of perceived facilitators and barriers [abstract]. Int J Behav Med. 2012, 19: S1-S341. Huijg JM, van der Zouwe N, Gebhardt WA, Crone MR, Verheijden MW, Middelkoop BJC: Introducing physical activity interventions in primary health care: a qualitative study of perceived facilitators and barriers [abstract]. Int J Behav Med. 2012, 19: S1-S341.
44.
go back to reference van Veldhoven M, Meijman T, Broersen J, Fortuin R: Handleiding VBBA. 2002, Amsterdam: SKB Vragenlijst Services van Veldhoven M, Meijman T, Broersen J, Fortuin R: Handleiding VBBA. 2002, Amsterdam: SKB Vragenlijst Services
45.
go back to reference Frese M: Social support as a moderator of the relationship between work stressors and psychological dysfunctioning: a longitudinal study with objective measures. J Occup Health Psychol. 1999, 4: 179-192.CrossRefPubMed Frese M: Social support as a moderator of the relationship between work stressors and psychological dysfunctioning: a longitudinal study with objective measures. J Occup Health Psychol. 1999, 4: 179-192.CrossRefPubMed
46.
go back to reference Gardner B, Abraham C, Lally P, de Bruijn G-J: Towards parsimony in habit measurement: testing the convergent and predictive validity of an automaticity subscale of the self-report habit index. Int J Behav Nutr Phys. 2012, 9: 102-10.1186/1479-5868-9-102.CrossRef Gardner B, Abraham C, Lally P, de Bruijn G-J: Towards parsimony in habit measurement: testing the convergent and predictive validity of an automaticity subscale of the self-report habit index. Int J Behav Nutr Phys. 2012, 9: 102-10.1186/1479-5868-9-102.CrossRef
47.
go back to reference Sniehotta FF, Schwarzer R, Scholz U, Schüz B: Action planning and coping planning for long-term lifestyle change: theory and assessment. Eur J Soc Psychol. 2005, 35: 565-576. 10.1002/ejsp.258.CrossRef Sniehotta FF, Schwarzer R, Scholz U, Schüz B: Action planning and coping planning for long-term lifestyle change: theory and assessment. Eur J Soc Psychol. 2005, 35: 565-576. 10.1002/ejsp.258.CrossRef
48.
go back to reference Scheier MF, Carver CS, Bridges MW: Distinguishing optimism from neuroticism (and trait anxiety, self-mastery, and self-esteem): a reevaluation of the life orientation test. J Pers Soc Psychol. 1994, 67: 1063-1078.CrossRefPubMed Scheier MF, Carver CS, Bridges MW: Distinguishing optimism from neuroticism (and trait anxiety, self-mastery, and self-esteem): a reevaluation of the life orientation test. J Pers Soc Psychol. 1994, 67: 1063-1078.CrossRefPubMed
49.
go back to reference Cialdini R, Kallgren C, Reno R: A focus theory of normative conduct: a theoretical refinement and reevaluation of the role of norms in human behavior. Adv Exp Soc Psychol. 1991, 24: 202-232. Cialdini R, Kallgren C, Reno R: A focus theory of normative conduct: a theoretical refinement and reevaluation of the role of norms in human behavior. Adv Exp Soc Psychol. 1991, 24: 202-232.
50.
go back to reference Qualtrics: Qualtrics software, version 45433. 2013, Provo, Utah, USA: Qualtrics Qualtrics: Qualtrics software, version 45433. 2013, Provo, Utah, USA: Qualtrics
51.
go back to reference Corp IBM: IBM SPSS Statistics for Windows, Version 19.0. 2010, IBM Corp.: Armonk, NY Corp IBM: IBM SPSS Statistics for Windows, Version 19.0. 2010, IBM Corp.: Armonk, NY
52.
go back to reference Stuive I, Kiers HAL, Timmerman ME, ten Berge JMF: The empirical verification of an assignment of items to subtests: the oblique multiple group method versus the confirmatory common factor method. Educ Psychol Meas. 2008, 68: 923-939. 10.1177/0013164408315264.CrossRef Stuive I, Kiers HAL, Timmerman ME, ten Berge JMF: The empirical verification of an assignment of items to subtests: the oblique multiple group method versus the confirmatory common factor method. Educ Psychol Meas. 2008, 68: 923-939. 10.1177/0013164408315264.CrossRef
53.
go back to reference Holzinger K: A simple method of factor analysis. Psychometrika. 1944, 9: 257-262. 10.1007/BF02288737.CrossRef Holzinger K: A simple method of factor analysis. Psychometrika. 1944, 9: 257-262. 10.1007/BF02288737.CrossRef
54.
go back to reference Stuive I, Kiers HAL, Timmerman ME: Comparison of methods for adjusting incorrect assignments of items to subtests: oblique multiple group method versus confirmatory common factor method. Educ Psychol Meas. 2009, 69: 948-965. 10.1177/0013164409332226.CrossRef Stuive I, Kiers HAL, Timmerman ME: Comparison of methods for adjusting incorrect assignments of items to subtests: oblique multiple group method versus confirmatory common factor method. Educ Psychol Meas. 2009, 69: 948-965. 10.1177/0013164409332226.CrossRef
55.
go back to reference Jöreskog K: A general approach to confirmatory maximum likelihood factor analysis. Psychometrika. 1969, 34: 183-202. 10.1007/BF02289343.CrossRef Jöreskog K: A general approach to confirmatory maximum likelihood factor analysis. Psychometrika. 1969, 34: 183-202. 10.1007/BF02289343.CrossRef
56.
go back to reference Jöreskog K: Testing a simple structure hypothesis in factor analysis. Psychometrika. 1966, 31: 165-178. 10.1007/BF02289505.CrossRefPubMed Jöreskog K: Testing a simple structure hypothesis in factor analysis. Psychometrika. 1966, 31: 165-178. 10.1007/BF02289505.CrossRefPubMed
57.
go back to reference Hotelling H: Analysis of a complex of statitical variables into principal components. J Educ Psychol. 1933, 24: 417-441.CrossRef Hotelling H: Analysis of a complex of statitical variables into principal components. J Educ Psychol. 1933, 24: 417-441.CrossRef
58.
go back to reference Cronbach L: Coefficient alpha and the internal structure of tests. Psychometrika. 1951, 16: 297-333. 10.1007/BF02310555.CrossRef Cronbach L: Coefficient alpha and the internal structure of tests. Psychometrika. 1951, 16: 297-333. 10.1007/BF02310555.CrossRef
59.
go back to reference Campbell D, Fiske D: Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol Bull. 1962, 59: 257-272.CrossRef Campbell D, Fiske D: Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol Bull. 1962, 59: 257-272.CrossRef
60.
go back to reference Anderson JC, Gerbing DW: Structural equation modeling in practice: a review and recommended two-step approach. Psychological Bulletin. 1988, 103: 411-423.CrossRef Anderson JC, Gerbing DW: Structural equation modeling in practice: a review and recommended two-step approach. Psychological Bulletin. 1988, 103: 411-423.CrossRef
61.
go back to reference Spearman C: The proof and measurement of association between two things. Am J Psychol. 1904, 15: 72-101. 10.2307/1412159.CrossRef Spearman C: The proof and measurement of association between two things. Am J Psychol. 1904, 15: 72-101. 10.2307/1412159.CrossRef
62.
go back to reference Timmerman M, Stuive I: Multiple Group Method with Corrections for Selfcorrelation and Test Length. 2007 Timmerman M, Stuive I: Multiple Group Method with Corrections for Selfcorrelation and Test Length. 2007
63.
go back to reference R Development Core Team R: R: a Language and Environment for Statistical Computing. 2012, Vienna, Austria: R Foundation for Statistical Computing R Development Core Team R: R: a Language and Environment for Statistical Computing. 2012, Vienna, Austria: R Foundation for Statistical Computing
64.
go back to reference Falissard B: Psy: Various Procedures Used in Psychometry. 2012, Vienna, Austria: R Foundation for Statistical Computing, R Package Version 1.1 Falissard B: Psy: Various Procedures Used in Psychometry. 2012, Vienna, Austria: R Foundation for Statistical Computing, R Package Version 1.1
65.
go back to reference Cohen J: Statistical Powe Analysis for the Behavioral Sciences. 1988, Hillsdale, New Jersey: Lawrence Erlbaum Cohen J: Statistical Powe Analysis for the Behavioral Sciences. 1988, Hillsdale, New Jersey: Lawrence Erlbaum
66.
go back to reference Wännström I, Peterson U, Asberg M, Nygren A, Gustavsson JP: Psychometric properties of scales in the General Nordic Questionnaire for Psychological and Social Factors at Work (QPS): confirmatory factor analysis and prediction of certified long-term sickness absence. Scand J Psychol. 2009, 50: 231-244. 10.1111/j.1467-9450.2008.00697.x.CrossRefPubMed Wännström I, Peterson U, Asberg M, Nygren A, Gustavsson JP: Psychometric properties of scales in the General Nordic Questionnaire for Psychological and Social Factors at Work (QPS): confirmatory factor analysis and prediction of certified long-term sickness absence. Scand J Psychol. 2009, 50: 231-244. 10.1111/j.1467-9450.2008.00697.x.CrossRefPubMed
67.
go back to reference American Psychological Association (APA): APA Dictionary of Psychology. 2007, Washington, DC: American Psychological Association American Psychological Association (APA): APA Dictionary of Psychology. 2007, Washington, DC: American Psychological Association
68.
go back to reference Taylor N, Lawton R, Conner M: Development and initial validation of the determinants of physical activity questionnaire. Int J Behav Nutr Phys Act. 2013, 10: 74-10.1186/1479-5868-10-74.CrossRefPubMedPubMedCentral Taylor N, Lawton R, Conner M: Development and initial validation of the determinants of physical activity questionnaire. Int J Behav Nutr Phys Act. 2013, 10: 74-10.1186/1479-5868-10-74.CrossRefPubMedPubMedCentral
69.
go back to reference Watson D, Clark LA, Tellegen A: Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol. 1988, 54: 1063-1070.CrossRefPubMed Watson D, Clark LA, Tellegen A: Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol. 1988, 54: 1063-1070.CrossRefPubMed
70.
go back to reference Crawford JR, Henry JD: The positive and negative affect schedule (PANAS): construct validity, measurement properties and normative data in a large non-clinical sample. Br J Clin Psychol. 2004, 43: 245-265. 10.1348/0144665031752934.CrossRefPubMed Crawford JR, Henry JD: The positive and negative affect schedule (PANAS): construct validity, measurement properties and normative data in a large non-clinical sample. Br J Clin Psychol. 2004, 43: 245-265. 10.1348/0144665031752934.CrossRefPubMed
71.
go back to reference Wood W, Neal DT: The habitual consumer. J Consum Psychol. 2009, 19: 579-592. 10.1016/j.jcps.2009.08.003.CrossRef Wood W, Neal DT: The habitual consumer. J Consum Psychol. 2009, 19: 579-592. 10.1016/j.jcps.2009.08.003.CrossRef
72.
go back to reference Deci E, Ryan R: Intrinsic Motivation and Self-Determination in Human Behavior. 1985, New York: Plenum Publishing Co.CrossRef Deci E, Ryan R: Intrinsic Motivation and Self-Determination in Human Behavior. 1985, New York: Plenum Publishing Co.CrossRef
73.
go back to reference Maslach C, Jackson SE: The measurement of experienced burnout. J Organ Behav. 1981, 2: 99-113. 10.1002/job.4030020205.CrossRef Maslach C, Jackson SE: The measurement of experienced burnout. J Organ Behav. 1981, 2: 99-113. 10.1002/job.4030020205.CrossRef
74.
go back to reference Dannapfel P, Peolsson A, Nilsen P: What supports physiotherapists’ use of research in clinical practice? A qualitative study in Sweden. Implement Sci. 2013, 8: 31-10.1186/1748-5908-8-31.CrossRefPubMedPubMedCentral Dannapfel P, Peolsson A, Nilsen P: What supports physiotherapists’ use of research in clinical practice? A qualitative study in Sweden. Implement Sci. 2013, 8: 31-10.1186/1748-5908-8-31.CrossRefPubMedPubMedCentral
75.
go back to reference Forsman H, Rudman A, Gustavsson P, Ehrenberg A, Wallin L: Nurses’ research utilization two years after graduation: a national survey of associated individual, organizational, and educational factors. Implement Sci. 2012, 7: 46-10.1186/1748-5908-7-46.CrossRefPubMedPubMedCentral Forsman H, Rudman A, Gustavsson P, Ehrenberg A, Wallin L: Nurses’ research utilization two years after graduation: a national survey of associated individual, organizational, and educational factors. Implement Sci. 2012, 7: 46-10.1186/1748-5908-7-46.CrossRefPubMedPubMedCentral
76.
go back to reference Shirley D, Van der Ploeg HP, Bauman AE: Physical activity promotion in the physical therapy setting: perspectives from practitioners and students. Phys Ther. 2010, 90: 1311-1322. 10.2522/ptj.20090383.CrossRefPubMed Shirley D, Van der Ploeg HP, Bauman AE: Physical activity promotion in the physical therapy setting: perspectives from practitioners and students. Phys Ther. 2010, 90: 1311-1322. 10.2522/ptj.20090383.CrossRefPubMed
77.
go back to reference van der Wees PJ, Zagers CA, de Die SE, Hendriks EJ, Nijhuis-van der Sanden MW, de Bie RA: Developing a questionnaire to identify perceived barriers for implementing the Dutch physical therapy COPD clinical practice guideline. BMC Health Serv Res. 2013, 13: 159-10.1186/1472-6963-13-159.CrossRefPubMedPubMedCentral van der Wees PJ, Zagers CA, de Die SE, Hendriks EJ, Nijhuis-van der Sanden MW, de Bie RA: Developing a questionnaire to identify perceived barriers for implementing the Dutch physical therapy COPD clinical practice guideline. BMC Health Serv Res. 2013, 13: 159-10.1186/1472-6963-13-159.CrossRefPubMedPubMedCentral
78.
go back to reference Barrett EM, Darker CD, Hussey J: Promotion of physical activity in primary care: knowledge and practice of general practitioners and physiotherapists. J Public Health. 2013, 21: 63-69. 10.1007/s10389-012-0512-0.CrossRef Barrett EM, Darker CD, Hussey J: Promotion of physical activity in primary care: knowledge and practice of general practitioners and physiotherapists. J Public Health. 2013, 21: 63-69. 10.1007/s10389-012-0512-0.CrossRef
79.
go back to reference Stevens J: Applied Multivariate Statistics for the Social Sciences. 1992, Hillsdale, New Jersey: Lawrence Erlbaum Stevens J: Applied Multivariate Statistics for the Social Sciences. 1992, Hillsdale, New Jersey: Lawrence Erlbaum
Metadata
Title
Measuring determinants of implementation behavior: psychometric properties of a questionnaire based on the theoretical domains framework
Authors
Johanna M Huijg
Winifred A Gebhardt
Elise Dusseldorp
Marieke W Verheijden
Nicolette van der Zouwe
Barend JC Middelkoop
Mathilde R Crone
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2014
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-9-33

Other articles of this Issue 1/2014

Implementation Science 1/2014 Go to the issue