Top

Published in:

Open Access 01-06-2015 | Original Research

Applying the behaviour change technique (BCT) taxonomy v1: a study of coder training

Authors: Caroline E Wood, PhD, Michelle Richardson, PhD, Marie Johnston, PhD, Charles Abraham, PhD, Jill Francis, PhD, Wendy Hardeman, PhD, Susan Michie, DPhil

Published in: Translational Behavioral Medicine | Issue 2/2015

Abstract

Behaviour Change Technique Taxonomy v1 (BCTTv1) has been used to detect active ingredients of interventions. The purpose of this study was to evaluate effectiveness of user training in improving reliable, valid and confident application of BCTTv1 to code BCTs in intervention descriptions. One hundred sixty-one trainees (109 in workshops and 52 in group tutorials) were trained to code frequent BCTs. The following measures were taken before and after training: (i) inter-coder agreement, (ii) trainee agreement with expert consensus, (iii) confidence ratings and (iv) coding competence. Coding was assessed for 12 BCTs (workshops) and for 17 BCTs (tutorials). Trainees completed a course evaluation. Methods improved agreement with expert consensus (p < .05) but not inter-coder agreement (p = .08, p = .57, respectively) and increased confidence for BCTs assessed (both p < .05). Methods were as effective as one another at improving coding competence (p = .55). Training was evaluated positively. The training improved agreement with expert consensus, confidence for BCTs assessed, coding competence but not inter-coder agreement. This varied according to BCT.

Murray CJL, Richards MA, Newton JN, et al. UK health performance: findings of the global burden of disease study. Lancet. 2010;2013:997-1020.

National Institute for Health and Clinical Excellence. Health systems and health-related behavior change: a review of primary and secondary evidence. London: National Institute for Health and Care Excellence; 2007.

Craig P, Dieppe P, Macintyre S, et al. Developing and evaluating complex interventions: the new medical research council guidance. BMJ. 2008;337:a1655.CrossRefPubMedCentralPubMed

Moher DG, Schulz KF, Altman DG. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. BMC. 2001;1:2.CrossRef

Moher DG, Schulz KF, Altman DG. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Clin Oral Investig. 2003;7:2-7.PubMed

Des Jarlais DC, Lyles C, Crepaz N, et al. Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the trend statement. AJPH. 2004;94:3.

Medical Research Council. A framework for development and evaluation of RCTs for complex interventions to improve health. London: Medical Research Council; 2000.

Campbell M, Fitzpatrick R, Haines A, et al. Framework for design and evaluation of complex interventions to improve health. BMJ. 2000;321:694-696.CrossRefPubMedCentralPubMed

McCleary N, Duncan EM, Stewart F, et al. Active ingredients are reported more often for pharmacologic interventions than non-pharmacologic interventions: an illustrative review of reporting practices in titles and abstracts. Trials. 2013;14:146.CrossRefPubMedCentralPubMed

10.

Michie S, Abraham C, Eccles MP, et al. Strengthening evaluation and implementation by specifying components of behavior change interventions: a study protocol. Impair Sci. 2011;6:10.

11.

Michie S, Johnston M. Theories and techniques of behavior change: developing a cumulative science of behavior change. Health Psychol Rev. 2012;6(1):1-6.CrossRef

12.

Michie S, Richardson M, Abraham C, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Beh Med. 2013.

13.

Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol. 2008;27:3. 379–387.CrossRef

14.

Michie S, Hyder N, Walia A, et al. Development of a taxonomy of behavior change techniques used in individual behavioral support for smoking cessation. Addict Behav. 2011;36:315-319.CrossRefPubMed

15.

Michie S, Ashford A, Sniehotta FF, et al. A refined taxonomy of behavior change techniques to help people change their physical activity and healthy eating behaviors: the calore taxonomy. Psychol Health. 2011;26:1479-1498.CrossRefPubMed

16.

Michie S, Whittington C, Hamoudi Z, et al. Identification of behavior change techniques to reduce excessive alcohol consumption. Addiction. 2012;107:1431-1440.CrossRefPubMed

17.

Dixon D, Johnston M. Health behavior change competency framework: competences to deliver interventions to change lifestyle behaviors that affect health. National Health Service Scotland, 2010.

18.

Abraham C, Good A, Huedo-Medina TB, et al. Reliability and utility of the sharp taxonomy of behavior change techniques. Psychol Health, 2012; sup1: 1–357.

19.

Hak T, Bernts T. Coder training: explicit instruction and implicit socialization? In: Krippendorff K, Bock A, eds. The content analysis reader. Thousand Oaks: Sage; 2009:220-233.

20.

Bernard RM, Abrami PC, Lou Y, et al. How does distance education compare with classroom instruction? A meta-analysis of the empirical literature. Rev Educ Res. 2004;74:379-439.CrossRef

21.

Potter WJ, Levine-Donnerstein D. Rethinking validity and reliability in content analysis. J App Commun Res, 1999: 258–284.

22.

Michie S, Abraham C, Whittington C, et al. Effective techniques in healthy eating and physical activity interventions: a meta-regression. Health Psychol. 2009;28(6):690-701.CrossRefPubMed

23.

Dombrowski SU, Sniehotta FF, Johnston M, et al. Optimizing acceptability and feasibility of an evidence-based behavioral intervention for obese adults with obesity-related co-morbidities or additional risk factors for co-morbidities: an open-pilot intervention study in secondary care. Patient Educ Couns. 2012;87(1):108-119.CrossRefPubMed

24.

Murphy C, Ciszewska-Carr J. Sources of difference in reliability: identifying sources of difference in reliability in content analysis of online asynchronous discussions. Int Rev Res in Online Dist Learn, 2005.

25.

Pollock PH, Hamann K, Wilson BM. Learning through discussions: comparing the benefits of small-group and large-class settings. J Polit Sci Educ. 2011;7:48-64.CrossRef

26.

Salas E, Cannon-Bowers JA. The science of training: a decade of progress. Ann Rev Psychol. 2001;52:471-499.CrossRef

27.

Salas E, Kosarzycski MP, Burke S, et al. Emergent themes in distance learning research: some food for thought. Int J Manag Rev. 2002;4:135-153.CrossRef

28.

Bandura A. Social learning theory. Englewood Cliffs: Prentice-Hall; 1977.

29.

Lorencatto F, West R, Seymour N, et al. Developing a method for specifying the components of behavior change interventions in practice: the example of smoking cessation. J Consult Clin Psychol. 2013;81:528-544.CrossRefPubMed

30.

Byrt T, Bishop J, Carlin JB. Bias, prevalence and kappa. J Clin Epidemiol. 1993;46:423-429.CrossRefPubMed

31.

Michie S, Wood CE, Johnston M, Abraham C, Francis J, et al. Behaviour change techniques: the development and evaluation of a taxonomic method for reporting and describing behaviour change interventions. Manuscript under review.

32.

Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull. 1968;70:213-220.CrossRefPubMed

33.

Fisher RA. Statistical methods for research workers, Edinburgh: Oliver and Boyd.

34.

Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159-174.CrossRefPubMed

35.

Glasziou PP, Chalmers I, Altman DG, et al. Taking healthcare interventions from trial to practice. BMJ. 2010;341:c3852.CrossRefPubMed

36.

Hoffman TC, Erueti C, Glasziou PP. Poor description of non-pharmacological interventions: analysis of consecutive sample of randomised trials. BMJ. 2013;347:f3755.CrossRef

37.

Aguinis H, Kraiger K. Benefits of training and development for individuals and teams, organisations and society. Annu Rev Psychol. 2009;60:451-474.CrossRefPubMed

38.

Abraham C, Johnston M, Michie S. et al. Are behavior change interventions replicable? Identifying reliable and valid behavior change techniques using BCT taxonomy v1 (BCTTv1), In prep 2013.

Title: Applying the behaviour change technique (BCT) taxonomy v1: a study of coder training
Authors: Caroline E Wood, PhD
Michelle Richardson, PhD
Marie Johnston, PhD
Charles Abraham, PhD
Jill Francis, PhD
Wendy Hardeman, PhD
Susan Michie, DPhil
Publication date: 01-06-2015
Publisher: Springer US
Published in: Translational Behavioral Medicine / Issue 2/2015
Print ISSN: 1869-6716
Electronic ISSN: 1613-9860
DOI: https://doi.org/10.1007/s13142-014-0290-z

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Applying the behaviour change technique (BCT) taxonomy v1: a study of coder training

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 2/2015

Tweet for health: using an online social network to examine temporal trends in weight loss-related posts

Network analysis of RE-AIM framework: chronology of the field and the connectivity of its contributors

Recruitment and initial interest of men in yoga for smoking cessation: QuitStrong, a randomized control pilot study

News from CDC: applying a life course approach to primary cancer prevention

News from NIH: a center for translation research and implementation science

Implementing an evidence-based breast cancer support and communication tool to newly diagnosed patients as standard care in two institutions