Skip to main content
Top
Published in: Implementation Science 1/2014

Open Access 01-12-2014 | Research

Discriminant content validity of a theoretical domains framework questionnaire for use in implementation research

Authors: Johanna M Huijg, Winifred A Gebhardt, Mathilde R Crone, Elise Dusseldorp, Justin Presseau

Published in: Implementation Science | Issue 1/2014

Login to get access

Abstract

Background

To improve the implementation of innovations in healthcare settings, it is important to understand factors influencing healthcare professionals’ behaviors. We aimed to develop a generic questionnaire in English and in Dutch assessing the 14 domains of behavioral determinants from the revised TDF (Cane et al., 2012) that can be tailored to suit different targets, actions, contexts, and times of interest, and to investigate questionnaire items’ discriminant content validity.

Methods

We identified existing questionnaires including items assessing constructs within TDF domains and developed new items where needed. Nineteen judges allocated 79 items to one or more TDF domains. One-sample t-tests were used to examine the discriminant content validity of each item, i.e., whether items measured intended domains or whether items measured a combination of domains.

Results

We identified items judged to discriminately measure 11 out of 14 domains. Items measuring the domains Reinforcement, Goals, and Behavioral regulation were judged to measure a combination of domains.

Conclusions

We have developed a questionnaire in English and in Dutch able to discriminately assess the majority of TDF domains. The results partly support Cane et al.’s (2012) 14-domain validation of the TDF and suggest that Michie et al.’s (2005) 12-domain original version might be more applicable in developing a TDF-based questionnaire. The identified items provide a robust basis for developing a questionnaire to measure TDF-based determinants of healthcare professionals’ implementation behaviors to suit different targets, actions, contexts, and times. Future research should investigate the concurrent and predictive validity and reliability of such a questionnaire in practice.
Appendix
Available only for authorised users
Literature
1.
2.
go back to reference Glasgow RE, Lichtenstein E, Marcus AC: Why don’t we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003, 93: 1261-1267. 10.2105/AJPH.93.8.1261.CrossRefPubMedPubMedCentral Glasgow RE, Lichtenstein E, Marcus AC: Why don’t we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003, 93: 1261-1267. 10.2105/AJPH.93.8.1261.CrossRefPubMedPubMedCentral
3.
go back to reference Haines A, Kuruvilla S, Borchert M: Policy and Practice Bridging the implementation gap between knowledge and action for health. B World Health Organization. 2004, 82: 724-732. Haines A, Kuruvilla S, Borchert M: Policy and Practice Bridging the implementation gap between knowledge and action for health. B World Health Organization. 2004, 82: 724-732.
4.
go back to reference Eakin EG, Glasgow RE, Riley KM: Review of primary care-based physical activity intervention studies. J Fam Practice. 2000, 49: 158-168. Eakin EG, Glasgow RE, Riley KM: Review of primary care-based physical activity intervention studies. J Fam Practice. 2000, 49: 158-168.
5.
go back to reference Petrella RJ, Lattanzio CN: Does counseling help patients get practice? Systematic review of the literature. Can Fam Physician. 2002, 48: 72-80.PubMedPubMedCentral Petrella RJ, Lattanzio CN: Does counseling help patients get practice? Systematic review of the literature. Can Fam Physician. 2002, 48: 72-80.PubMedPubMedCentral
6.
go back to reference Sørensen JB, Skovgaard T, Puggaard L: Exercise on prescription in general practice: a systematic review. Scand J Prim Health. 2006, 24: 69-74. 10.1080/02813430600700027.CrossRef Sørensen JB, Skovgaard T, Puggaard L: Exercise on prescription in general practice: a systematic review. Scand J Prim Health. 2006, 24: 69-74. 10.1080/02813430600700027.CrossRef
7.
go back to reference Orrow G, Kinmonth A-L, Sanderson S, Sutton S: Effectiveness of physical activity promotion based in primary care: systematic review and meta-analysis of randomised controlled trials. BMJ. 2012, 344: e1389-10.1136/bmj.e1389.CrossRefPubMedPubMedCentral Orrow G, Kinmonth A-L, Sanderson S, Sutton S: Effectiveness of physical activity promotion based in primary care: systematic review and meta-analysis of randomised controlled trials. BMJ. 2012, 344: e1389-10.1136/bmj.e1389.CrossRefPubMedPubMedCentral
8.
go back to reference Glasgow RE, Eakin EG, Fisher EB, Bacak SJ, Brownson RC: Physician advice and support for physical activity: results from a national survey. Am J Prev Med. 2001, 21: 189-196. 10.1016/S0749-3797(01)00350-6.CrossRefPubMed Glasgow RE, Eakin EG, Fisher EB, Bacak SJ, Brownson RC: Physician advice and support for physical activity: results from a national survey. Am J Prev Med. 2001, 21: 189-196. 10.1016/S0749-3797(01)00350-6.CrossRefPubMed
9.
go back to reference Fallon EA, Wilcox S, Laken M: Health care provider advice for African American adults not meeting health behavior recommendations. Prev Chron Dis. 2006, 3: 1-12. Fallon EA, Wilcox S, Laken M: Health care provider advice for African American adults not meeting health behavior recommendations. Prev Chron Dis. 2006, 3: 1-12.
10.
go back to reference Helmink JHM, Meis JJM, de Weerdt I, Visser FN, de Vries NK, Kremers SPJ: Development and implementation of a lifestyle intervention to promote physical activity and healthy diet in the Dutch general practice setting: the BeweegKuur programme. Int J Behav Nutr Phy. 2010, 7: 49-10.1186/1479-5868-7-49.CrossRef Helmink JHM, Meis JJM, de Weerdt I, Visser FN, de Vries NK, Kremers SPJ: Development and implementation of a lifestyle intervention to promote physical activity and healthy diet in the Dutch general practice setting: the BeweegKuur programme. Int J Behav Nutr Phy. 2010, 7: 49-10.1186/1479-5868-7-49.CrossRef
11.
go back to reference Verheijden MW, Bakx JC, Delemarre ICG, Wanders AJ, Woudenbergh NM, Bottema BJAM, van Weel C, van Staveren WA: GPs’ assessment of patients’ readiness to change diet, activity and smoking. Brit J Gen Pract. 2005, 55: 452-457. Verheijden MW, Bakx JC, Delemarre ICG, Wanders AJ, Woudenbergh NM, Bottema BJAM, van Weel C, van Staveren WA: GPs’ assessment of patients’ readiness to change diet, activity and smoking. Brit J Gen Pract. 2005, 55: 452-457.
12.
go back to reference Glasgow RE, Bull SS, Gilette C, Klesges LM, Dzewaltowski DA: Behavior change intervention research in healthcare settings: a review of recent reports with emphasis on external validity. Am J Prev Med. 2002, 23: 62-69. 10.1016/S0749-3797(02)00437-3.CrossRefPubMed Glasgow RE, Bull SS, Gilette C, Klesges LM, Dzewaltowski DA: Behavior change intervention research in healthcare settings: a review of recent reports with emphasis on external validity. Am J Prev Med. 2002, 23: 62-69. 10.1016/S0749-3797(02)00437-3.CrossRefPubMed
13.
go back to reference Bartholomew KL, Parcel GS, Kok G, Gottlieb NH, Fernández ME: Planning Health Promotion Programs: An Intervention Mapping Approach. 2011, San Fransisco: Jossey-Bass Bartholomew KL, Parcel GS, Kok G, Gottlieb NH, Fernández ME: Planning Health Promotion Programs: An Intervention Mapping Approach. 2011, San Fransisco: Jossey-Bass
14.
go back to reference Foy R, Eccles M, Grimshaw J: Why does primary care need more implementation research?. Fam Pract. 2001, 18: 353-355. 10.1093/fampra/18.4.353.CrossRefPubMed Foy R, Eccles M, Grimshaw J: Why does primary care need more implementation research?. Fam Pract. 2001, 18: 353-355. 10.1093/fampra/18.4.353.CrossRefPubMed
15.
go back to reference Eccles M, Grimshaw J, Walker A, Johnston M, Pitts N: Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. J Clin Epidemiol. 2005, 58: 107-112. 10.1016/j.jclinepi.2004.09.002.CrossRefPubMed Eccles M, Grimshaw J, Walker A, Johnston M, Pitts N: Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. J Clin Epidemiol. 2005, 58: 107-112. 10.1016/j.jclinepi.2004.09.002.CrossRefPubMed
16.
go back to reference Fleuren M, Wiefferink K, Paulussen T: Determinants of innovation within health care organizations: literature review and Delphi study. Int J Qual Health C. 2004, 16: 107-123. 10.1093/intqhc/mzh030.CrossRef Fleuren M, Wiefferink K, Paulussen T: Determinants of innovation within health care organizations: literature review and Delphi study. Int J Qual Health C. 2004, 16: 107-123. 10.1093/intqhc/mzh030.CrossRef
17.
go back to reference Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral
18.
go back to reference Grol R, Wensing M, Eccles M: Improving Patient Care: The Implementation of Change in Clinical Practice. 2005, Oxford: Elsevier Grol R, Wensing M, Eccles M: Improving Patient Care: The Implementation of Change in Clinical Practice. 2005, Oxford: Elsevier
19.
go back to reference Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003, 362: 1225-1230. 10.1016/S0140-6736(03)14546-1.CrossRefPubMed Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003, 362: 1225-1230. 10.1016/S0140-6736(03)14546-1.CrossRefPubMed
20.
go back to reference Rogers EM: Diffusion of Innovations. 1983, New York: The Free Press Rogers EM: Diffusion of Innovations. 1983, New York: The Free Press
21.
go back to reference Francis JJ, Tinmouth A, Stanworth SJ, Grimshaw JM, Johnston M, Hyde C, Stockton C, Brehaut JC, Fergusson D, Eccles MP: Using theories of behaviour to understand transfusion prescribing in three clinical contexts in two countries: development work for an implementation trial. Implement Sci. 2009, 4: 70-10.1186/1748-5908-4-70.CrossRefPubMedPubMedCentral Francis JJ, Tinmouth A, Stanworth SJ, Grimshaw JM, Johnston M, Hyde C, Stockton C, Brehaut JC, Fergusson D, Eccles MP: Using theories of behaviour to understand transfusion prescribing in three clinical contexts in two countries: development work for an implementation trial. Implement Sci. 2009, 4: 70-10.1186/1748-5908-4-70.CrossRefPubMedPubMedCentral
22.
go back to reference Grol RPTM, Bosch MC, Hulscher MEJL, Eccles MP, Wensing M: Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q. 2007, 85: 93-138. 10.1111/j.1468-0009.2007.00478.x.CrossRefPubMedPubMedCentral Grol RPTM, Bosch MC, Hulscher MEJL, Eccles MP, Wensing M: Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q. 2007, 85: 93-138. 10.1111/j.1468-0009.2007.00478.x.CrossRefPubMedPubMedCentral
23.
go back to reference Michie S, Johnston M, Francis J, Hardeman W, Eccles M: From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008, 57: 660-680. 10.1111/j.1464-0597.2008.00341.x.CrossRef Michie S, Johnston M, Francis J, Hardeman W, Eccles M: From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008, 57: 660-680. 10.1111/j.1464-0597.2008.00341.x.CrossRef
24.
go back to reference Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M: Developing and evaluationg complex interventions: the new medical research council guidance. BMJ. 2008, 337: a1655-10.1136/bmj.a1655.CrossRefPubMedPubMedCentral Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M: Developing and evaluationg complex interventions: the new medical research council guidance. BMJ. 2008, 337: a1655-10.1136/bmj.a1655.CrossRefPubMedPubMedCentral
25.
go back to reference Francis J, Johnston M, Bonetti D: Health psychology research advances theory by addressing problems: illustrations from theory-based studies of health professional behaviour. Eur Health Psychol. 2007, 2: 20-25. Francis J, Johnston M, Bonetti D: Health psychology research advances theory by addressing problems: illustrations from theory-based studies of health professional behaviour. Eur Health Psychol. 2007, 2: 20-25.
26.
go back to reference French SD, Green SE, O’Connor DA, McKenzie JE, Francis JJ, Michie S, Buchbinder R, Schattner P, Spike N, Grimshaw JM: Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the Theoretical Domains Framework. Implement Sci. 2012, 7: 38-10.1186/1748-5908-7-38.CrossRefPubMedPubMedCentral French SD, Green SE, O’Connor DA, McKenzie JE, Francis JJ, Michie S, Buchbinder R, Schattner P, Spike N, Grimshaw JM: Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the Theoretical Domains Framework. Implement Sci. 2012, 7: 38-10.1186/1748-5908-7-38.CrossRefPubMedPubMedCentral
27.
go back to reference Presseau J, Johnston M, Francis J, Hrisos S, Stamp E, Steen N, Hawthorne G, Grimshaw J, Elovainio M, Hunter M, Eccles M: Theory-based predictors of multiple clinician behaviors in the management of diabetes. J Behav Med. 2013, epub ahead of print Presseau J, Johnston M, Francis J, Hrisos S, Stamp E, Steen N, Hawthorne G, Grimshaw J, Elovainio M, Hunter M, Eccles M: Theory-based predictors of multiple clinician behaviors in the management of diabetes. J Behav Med. 2013, epub ahead of print
28.
go back to reference Chaudoir SR, Dugan AG, Barr CHI: Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level. Implement Sci. 2013, 8: 22-10.1186/1748-5908-8-22.CrossRefPubMedPubMedCentral Chaudoir SR, Dugan AG, Barr CHI: Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level. Implement Sci. 2013, 8: 22-10.1186/1748-5908-8-22.CrossRefPubMedPubMedCentral
29.
go back to reference Rothman AJ: 'Is there nothing more practical than a good theory?’: why innovations and advances in health behavior change will arise if interventions are used to test and refine theory. Int J Behav Nutr Phy. 2004, 1: 11-10.1186/1479-5868-1-11.CrossRef Rothman AJ: 'Is there nothing more practical than a good theory?’: why innovations and advances in health behavior change will arise if interventions are used to test and refine theory. Int J Behav Nutr Phy. 2004, 1: 11-10.1186/1479-5868-1-11.CrossRef
30.
go back to reference Francis JJ, Stockton C, Eccles MP, Johnston M, Cuthbertson BH, Grimshaw JM, Hyde C, Tinmouth A, Stanworth SJ: Evidence-based selection of theories for designing behaviour change interventions: using methods based on theoretical construct domains to understand clinicians’ blood transfusion behaviour. Brit J Health Psychol. 2009, 14: 625-646. 10.1348/135910708X397025.CrossRef Francis JJ, Stockton C, Eccles MP, Johnston M, Cuthbertson BH, Grimshaw JM, Hyde C, Tinmouth A, Stanworth SJ: Evidence-based selection of theories for designing behaviour change interventions: using methods based on theoretical construct domains to understand clinicians’ blood transfusion behaviour. Brit J Health Psychol. 2009, 14: 625-646. 10.1348/135910708X397025.CrossRef
31.
go back to reference Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A: Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005, 14: 26-33. 10.1136/qshc.2004.011155.CrossRefPubMedPubMedCentral Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A: Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005, 14: 26-33. 10.1136/qshc.2004.011155.CrossRefPubMedPubMedCentral
32.
go back to reference Patey AM, Islam R, Francis JJ, Bryson GL, Grimshaw JM: Anesthesiologists’ And surgeons’ perceptions about routine pre-operative testing in low-risk patients: application of the theoretical domains framework (TDF) to identify factors that influence physicians’ decisions to order pre-operative tests. Implement Sci. 2012, 7: 52-10.1186/1748-5908-7-52.CrossRefPubMedPubMedCentral Patey AM, Islam R, Francis JJ, Bryson GL, Grimshaw JM: Anesthesiologists’ And surgeons’ perceptions about routine pre-operative testing in low-risk patients: application of the theoretical domains framework (TDF) to identify factors that influence physicians’ decisions to order pre-operative tests. Implement Sci. 2012, 7: 52-10.1186/1748-5908-7-52.CrossRefPubMedPubMedCentral
33.
go back to reference McSherry LA, Dombrowski SU, Francis JJ, Murphy J, Martin CM, O’Leary JJ, Sharp L, ATHENS Group: 'It’s a can of worms’: understanding primary care practitioners’ behaviours in relation to HPV using the theoretical domains framework. Implement Sci. 2012, 7: 73-10.1186/1748-5908-7-73.CrossRefPubMedPubMedCentral McSherry LA, Dombrowski SU, Francis JJ, Murphy J, Martin CM, O’Leary JJ, Sharp L, ATHENS Group: 'It’s a can of worms’: understanding primary care practitioners’ behaviours in relation to HPV using the theoretical domains framework. Implement Sci. 2012, 7: 73-10.1186/1748-5908-7-73.CrossRefPubMedPubMedCentral
34.
go back to reference Amemori M, Michie S, Korhonen T, Murtomaa H, Kinnunen TH: Assessing implementation difficulties in tobacco use prevention and cessation counselling among dental providers. Implement Sci. 2011, 6: 50-10.1186/1748-5908-6-50.CrossRefPubMedPubMedCentral Amemori M, Michie S, Korhonen T, Murtomaa H, Kinnunen TH: Assessing implementation difficulties in tobacco use prevention and cessation counselling among dental providers. Implement Sci. 2011, 6: 50-10.1186/1748-5908-6-50.CrossRefPubMedPubMedCentral
35.
go back to reference Beenstock J, Sniehotta FF, White M, Bell R, Milne EM, Araujo-Soares V: What helps and hinders midwives in engaging with pregnant women about stopping smoking? A cross-sectional survey of perceived implementation difficulties among midwives in the northeast of England. Implement Sci. 2012, 7: 36-10.1186/1748-5908-7-36.CrossRefPubMedPubMedCentral Beenstock J, Sniehotta FF, White M, Bell R, Milne EM, Araujo-Soares V: What helps and hinders midwives in engaging with pregnant women about stopping smoking? A cross-sectional survey of perceived implementation difficulties among midwives in the northeast of England. Implement Sci. 2012, 7: 36-10.1186/1748-5908-7-36.CrossRefPubMedPubMedCentral
36.
go back to reference Taylor N, Parveen S, Robins V, Slater B, Lawton R: Development and initial validation of the Influences on Patient Safety Behaviours Questionnaire. Implement Sci. 2013, 8: 81-10.1186/1748-5908-8-81.CrossRefPubMedPubMedCentral Taylor N, Parveen S, Robins V, Slater B, Lawton R: Development and initial validation of the Influences on Patient Safety Behaviours Questionnaire. Implement Sci. 2013, 8: 81-10.1186/1748-5908-8-81.CrossRefPubMedPubMedCentral
37.
go back to reference Cane J, O’Connor D, Michie S: Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012, 7: 37-10.1186/1748-5908-7-37.CrossRefPubMedPubMedCentral Cane J, O’Connor D, Michie S: Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012, 7: 37-10.1186/1748-5908-7-37.CrossRefPubMedPubMedCentral
38.
go back to reference Fishbein M: Attitude and the Prediction of Behavior. Readings in Atttiude Theory and Measurement. Edited by: Fishbein M. 1967, New York: Wiley, 477-492. Fishbein M: Attitude and the Prediction of Behavior. Readings in Atttiude Theory and Measurement. Edited by: Fishbein M. 1967, New York: Wiley, 477-492.
39.
40.
go back to reference Rubio DM, Berg-Weger M, Tebb SS, Lee ES, Rauch S: Objectifying content validity: conducting a content validity study in social work research. Soc Work Res. 2003, 27: 94-104. 10.1093/swr/27.2.94.CrossRef Rubio DM, Berg-Weger M, Tebb SS, Lee ES, Rauch S: Objectifying content validity: conducting a content validity study in social work research. Soc Work Res. 2003, 27: 94-104. 10.1093/swr/27.2.94.CrossRef
41.
go back to reference Ajzen I: The theory of planned behavior. Organ Behav Hum Dec. 1991, 50: 179-211. 10.1016/0749-5978(91)90020-T.CrossRef Ajzen I: The theory of planned behavior. Organ Behav Hum Dec. 1991, 50: 179-211. 10.1016/0749-5978(91)90020-T.CrossRef
42.
go back to reference Bandura A: Health promotion from the perspective of social cognitive theory. Psychol Health. 1998, 13: 623-649. 10.1080/08870449808407422.CrossRef Bandura A: Health promotion from the perspective of social cognitive theory. Psychol Health. 1998, 13: 623-649. 10.1080/08870449808407422.CrossRef
43.
go back to reference Huijg JM, van der Zouwe N, Gebhardt WA, Crone MR, Verheijden MW, Middelkoop BJC: Introducing physical activity interventions in primary health care: a qualitative study of perceived facilitators and barriers [abstract]. Int J Behav Med. 2012, 19: S1-S341. Huijg JM, van der Zouwe N, Gebhardt WA, Crone MR, Verheijden MW, Middelkoop BJC: Introducing physical activity interventions in primary health care: a qualitative study of perceived facilitators and barriers [abstract]. Int J Behav Med. 2012, 19: S1-S341.
44.
go back to reference Huijg JM, Crone MR, Verheijden MW, van der Zouwe N, Middelkoop BJC, Gebhardt WA: Factors influencing the adoption, implementation, and continuation of physical activity interventions in primary health care: a delphi study. BMC Fam Pract. 2013, 14: 142-10.1186/1471-2296-14-142.CrossRefPubMedPubMedCentral Huijg JM, Crone MR, Verheijden MW, van der Zouwe N, Middelkoop BJC, Gebhardt WA: Factors influencing the adoption, implementation, and continuation of physical activity interventions in primary health care: a delphi study. BMC Fam Pract. 2013, 14: 142-10.1186/1471-2296-14-142.CrossRefPubMedPubMedCentral
45.
go back to reference Maes S, Karoly P, de Gucht V, Ruehlman LS, Heiser W: The self regulation skills battery. 2006, Leiden/Phoenix: Leiden University/Arizona State University Maes S, Karoly P, de Gucht V, Ruehlman LS, Heiser W: The self regulation skills battery. 2006, Leiden/Phoenix: Leiden University/Arizona State University
46.
go back to reference Sniehotta FF, Schwarzer R, Scholz U, Schüz B: Action planning and coping planning for long-term lifestyle change: theory and assessment. Eur J Soc Psycho. 2005, 35: 565-576. 10.1002/ejsp.258.CrossRef Sniehotta FF, Schwarzer R, Scholz U, Schüz B: Action planning and coping planning for long-term lifestyle change: theory and assessment. Eur J Soc Psycho. 2005, 35: 565-576. 10.1002/ejsp.258.CrossRef
47.
go back to reference Gardner B, Abraham C, Lally P, de Bruijn G-J: Towards parsimony in habit measurement: Testing the convergent and predictive validity of an automaticity subscale of the Self-Report Habit Index. Int J Behav Nutr Phys. 2012, 9: 102-10.1186/1479-5868-9-102.CrossRef Gardner B, Abraham C, Lally P, de Bruijn G-J: Towards parsimony in habit measurement: Testing the convergent and predictive validity of an automaticity subscale of the Self-Report Habit Index. Int J Behav Nutr Phys. 2012, 9: 102-10.1186/1479-5868-9-102.CrossRef
48.
go back to reference Goldberg DP, Blackwell B: Psychiatric illness in general practice: a detailed study using a new method of case identification. Brit Med J. 1970, 1: 439-443.CrossRefPubMed Goldberg DP, Blackwell B: Psychiatric illness in general practice: a detailed study using a new method of case identification. Brit Med J. 1970, 1: 439-443.CrossRefPubMed
49.
go back to reference Thompson ER: Development and Validation of an Internationally Reliable Short-Form of the Positive and Negative Affect Schedule (PANAS). J Cross Cult Psychol. 2007, 38: 227-242. 10.1177/0022022106297301.CrossRef Thompson ER: Development and Validation of an Internationally Reliable Short-Form of the Positive and Negative Affect Schedule (PANAS). J Cross Cult Psychol. 2007, 38: 227-242. 10.1177/0022022106297301.CrossRef
50.
go back to reference Frese M: Social support as a moderator of the relationship between work stressors and psychological dysfunctioning: a longitudinal study with objective measures. J Occup Health Psych. 1999, 4: 179-192.CrossRef Frese M: Social support as a moderator of the relationship between work stressors and psychological dysfunctioning: a longitudinal study with objective measures. J Occup Health Psych. 1999, 4: 179-192.CrossRef
51.
go back to reference Derryberry D, Reed MA: Anxiety-related attentional biases and their regulation by attentional control. J Abnorm Psychol. 2002, 111: 225-236.CrossRefPubMed Derryberry D, Reed MA: Anxiety-related attentional biases and their regulation by attentional control. J Abnorm Psychol. 2002, 111: 225-236.CrossRefPubMed
52.
go back to reference Scheier MF, Carver CS, Bridges MW: Distinguishing optimism from neuroticism (and trait anxiety, self-mastery, and self-esteem): a reevaluation of the Life Orientation Test. J Pers Soc Psychol. 1994, 67: 1063-1078.CrossRefPubMed Scheier MF, Carver CS, Bridges MW: Distinguishing optimism from neuroticism (and trait anxiety, self-mastery, and self-esteem): a reevaluation of the Life Orientation Test. J Pers Soc Psychol. 1994, 67: 1063-1078.CrossRefPubMed
53.
go back to reference Cialdini R, Kallgren C, Reno R: A Focus Theory of Normative Conduct: A Theoretical Refinement and Reevaluation of the Role of Norms in Human Behavior. Advances in Experimental Social Psychology. 1991, San Diego: Academic Press, 202-232. Cialdini R, Kallgren C, Reno R: A Focus Theory of Normative Conduct: A Theoretical Refinement and Reevaluation of the Role of Norms in Human Behavior. Advances in Experimental Social Psychology. 1991, San Diego: Academic Press, 202-232.
54.
go back to reference Dixon D, Pollard B, Johnston M: What does the chronic pain grade questionnaire measure?. Pain. 2007, 130: 249-253. 10.1016/j.pain.2006.12.004.CrossRefPubMed Dixon D, Pollard B, Johnston M: What does the chronic pain grade questionnaire measure?. Pain. 2007, 130: 249-253. 10.1016/j.pain.2006.12.004.CrossRefPubMed
55.
go back to reference Dixon D, Johnston M, McQueen M, Court-Brown C: The disabilities of the Arm, shoulder and hand questionnaire (DASH) can measure the impairment, activity limitations and participation restriction constructs from the international classification of functioning, disability and health (ICF). BMC Musculoskel Dis. 2008, 9: 114-10.1186/1471-2474-9-114.CrossRef Dixon D, Johnston M, McQueen M, Court-Brown C: The disabilities of the Arm, shoulder and hand questionnaire (DASH) can measure the impairment, activity limitations and participation restriction constructs from the international classification of functioning, disability and health (ICF). BMC Musculoskel Dis. 2008, 9: 114-10.1186/1471-2474-9-114.CrossRef
56.
go back to reference American Psychological Association (APA): APA Dictionary of Psychology. 2007, Washington: American Psychological Association American Psychological Association (APA): APA Dictionary of Psychology. 2007, Washington: American Psychological Association
57.
go back to reference Benjamini Y, Hochberg Y: Controlling the false discovery rate: a practical and powerful approach to multiple testing. J Roy Stat Soc B Met. 1995, 57: 289-300. Benjamini Y, Hochberg Y: Controlling the false discovery rate: a practical and powerful approach to multiple testing. J Roy Stat Soc B Met. 1995, 57: 289-300.
58.
go back to reference IBM Corp: IBM SPSS statistics for windows, version 19.0. 2010, Armonk, NY: IBM Corp IBM Corp: IBM SPSS statistics for windows, version 19.0. 2010, Armonk, NY: IBM Corp
59.
go back to reference Conger A: Integration and generalization of kappas for multiple raters. Psychol Bull. 1980, 88: 322-328.CrossRef Conger A: Integration and generalization of kappas for multiple raters. Psychol Bull. 1980, 88: 322-328.CrossRef
60.
go back to reference Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.CrossRefPubMed Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.CrossRefPubMed
61.
go back to reference R Development Core Team R: R: a Language and Environment for Statistical Computing. 2012, Vienna, Austria: R Foundation for Statistical Computing R Development Core Team R: R: a Language and Environment for Statistical Computing. 2012, Vienna, Austria: R Foundation for Statistical Computing
62.
go back to reference Falissard B: Psy: Various Procedures Used in Psychometry. 2012, : R Package Version 1.1 Falissard B: Psy: Various Procedures Used in Psychometry. 2012, : R Package Version 1.1
63.
go back to reference Taylor N, Lawton R, Connor M: Development and initial validation of the determinants of physical activity questionnaire. Int J Behav Nutr Phy. 2013, 10: 74-10.1186/1479-5868-10-74.CrossRef Taylor N, Lawton R, Connor M: Development and initial validation of the determinants of physical activity questionnaire. Int J Behav Nutr Phy. 2013, 10: 74-10.1186/1479-5868-10-74.CrossRef
64.
go back to reference Stevens J: Applied Multivariate Statistics for the Social Sciences. 1992, Hillsdale: Lawrence Erlbaum Stevens J: Applied Multivariate Statistics for the Social Sciences. 1992, Hillsdale: Lawrence Erlbaum
65.
go back to reference Taylor N, Lawton R, Slater B, Foy R: The demonstration of a theory-based approach to the design of localized patient safety interventions. Implement Sci. 2013, 8: 123-10.1186/1748-5908-8-123.CrossRefPubMedPubMedCentral Taylor N, Lawton R, Slater B, Foy R: The demonstration of a theory-based approach to the design of localized patient safety interventions. Implement Sci. 2013, 8: 123-10.1186/1748-5908-8-123.CrossRefPubMedPubMedCentral
66.
go back to reference Dyson J, Lawton R, Jackson C, Cheater F: Development of a theory-based instrument to identify barriers and levers to best hand hygiene practice among healthcare practitioners. Implement Sci. 2013, 8: 111-10.1186/1748-5908-8-111.CrossRefPubMedPubMedCentral Dyson J, Lawton R, Jackson C, Cheater F: Development of a theory-based instrument to identify barriers and levers to best hand hygiene practice among healthcare practitioners. Implement Sci. 2013, 8: 111-10.1186/1748-5908-8-111.CrossRefPubMedPubMedCentral
67.
go back to reference Dyson J, Lawton R, Jackson C, Cheater F: Does the use of a theoretical approach tell us more about hand hygiene behavior? The barriers and levers to hand hygiene. J Infect Prev. 2011, 12: 17-24. 10.1177/1757177410384300.CrossRef Dyson J, Lawton R, Jackson C, Cheater F: Does the use of a theoretical approach tell us more about hand hygiene behavior? The barriers and levers to hand hygiene. J Infect Prev. 2011, 12: 17-24. 10.1177/1757177410384300.CrossRef
68.
go back to reference Bonetti D, Johnston M, Clarkson JE, Grimshaw J, Pitts NB, Eccles M, Steen N, Thomas R, Maclennan G, Glidewell L, Walker A: Applying psychologial theories to evidence-based clinical practice: identifying factors predictive of placing preventive fissure sealants. Implement Sci. 2010, 5: 25-10.1186/1748-5908-5-25.CrossRefPubMedPubMedCentral Bonetti D, Johnston M, Clarkson JE, Grimshaw J, Pitts NB, Eccles M, Steen N, Thomas R, Maclennan G, Glidewell L, Walker A: Applying psychologial theories to evidence-based clinical practice: identifying factors predictive of placing preventive fissure sealants. Implement Sci. 2010, 5: 25-10.1186/1748-5908-5-25.CrossRefPubMedPubMedCentral
69.
go back to reference Davies P, Walker AE, Grimshaw JM: A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010, 5: 14-10.1186/1748-5908-5-14.CrossRefPubMedPubMedCentral Davies P, Walker AE, Grimshaw JM: A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010, 5: 14-10.1186/1748-5908-5-14.CrossRefPubMedPubMedCentral
70.
go back to reference Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8: 1-72.CrossRef Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8: 1-72.CrossRef
Metadata
Title
Discriminant content validity of a theoretical domains framework questionnaire for use in implementation research
Authors
Johanna M Huijg
Winifred A Gebhardt
Mathilde R Crone
Elise Dusseldorp
Justin Presseau
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2014
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-9-11

Other articles of this Issue 1/2014

Implementation Science 1/2014 Go to the issue