Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Translational Behavioral Medicine
Published in: Translational Behavioral Medicine 2/2015

Open Access 01-06-2015 | Original Research

Applying the behaviour change technique (BCT) taxonomy v1: a study of coder training

Authors: Caroline E Wood, PhD, Michelle Richardson, PhD, Marie Johnston, PhD, Charles Abraham, PhD, Jill Francis, PhD, Wendy Hardeman, PhD, Susan Michie, DPhil

Published in: Translational Behavioral Medicine | Issue 2/2015

Login to get access

Abstract

Behaviour Change Technique Taxonomy v1 (BCTTv1) has been used to detect active ingredients of interventions. The purpose of this study was to evaluate effectiveness of user training in improving reliable, valid and confident application of BCTTv1 to code BCTs in intervention descriptions. One hundred sixty-one trainees (109 in workshops and 52 in group tutorials) were trained to code frequent BCTs. The following measures were taken before and after training: (i) inter-coder agreement, (ii) trainee agreement with expert consensus, (iii) confidence ratings and (iv) coding competence. Coding was assessed for 12 BCTs (workshops) and for 17 BCTs (tutorials). Trainees completed a course evaluation. Methods improved agreement with expert consensus (p < .05) but not inter-coder agreement (p = .08, p = .57, respectively) and increased confidence for BCTs assessed (both p < .05). Methods were as effective as one another at improving coding competence (p = .55). Training was evaluated positively. The training improved agreement with expert consensus, confidence for BCTs assessed, coding competence but not inter-coder agreement. This varied according to BCT.
Literature
1.
Murray CJL, Richards MA, Newton JN, et al. UK health performance: findings of the global burden of disease study. Lancet. 2010;2013:997-1020.
2.
National Institute for Health and Clinical Excellence. Health systems and health-related behavior change: a review of primary and secondary evidence. London: National Institute for Health and Care Excellence; 2007.
3.
Craig P, Dieppe P, Macintyre S, et al. Developing and evaluating complex interventions: the new medical research council guidance. BMJ. 2008;337:a1655.CrossRefPubMedCentralPubMed
4.
Moher DG, Schulz KF, Altman DG. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. BMC. 2001;1:2.CrossRef
5.
Moher DG, Schulz KF, Altman DG. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Clin Oral Investig. 2003;7:2-7.PubMed
6.
Des Jarlais DC, Lyles C, Crepaz N, et al. Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the trend statement. AJPH. 2004;94:3.
7.
Medical Research Council. A framework for development and evaluation of RCTs for complex interventions to improve health. London: Medical Research Council; 2000.
8.
9.
McCleary N, Duncan EM, Stewart F, et al. Active ingredients are reported more often for pharmacologic interventions than non-pharmacologic interventions: an illustrative review of reporting practices in titles and abstracts. Trials. 2013;14:146.CrossRefPubMedCentralPubMed
10.
Michie S, Abraham C, Eccles MP, et al. Strengthening evaluation and implementation by specifying components of behavior change interventions: a study protocol. Impair Sci. 2011;6:10.
11.
Michie S, Johnston M. Theories and techniques of behavior change: developing a cumulative science of behavior change. Health Psychol Rev. 2012;6(1):1-6.CrossRef
12.
Michie S, Richardson M, Abraham C, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Beh Med. 2013.
13.
Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol. 2008;27:3. 379–387.CrossRef
14.
Michie S, Hyder N, Walia A, et al. Development of a taxonomy of behavior change techniques used in individual behavioral support for smoking cessation. Addict Behav. 2011;36:315-319.CrossRefPubMed
15.
Michie S, Ashford A, Sniehotta FF, et al. A refined taxonomy of behavior change techniques to help people change their physical activity and healthy eating behaviors: the calore taxonomy. Psychol Health. 2011;26:1479-1498.CrossRefPubMed
16.
Michie S, Whittington C, Hamoudi Z, et al. Identification of behavior change techniques to reduce excessive alcohol consumption. Addiction. 2012;107:1431-1440.CrossRefPubMed
17.
Dixon D, Johnston M. Health behavior change competency framework: competences to deliver interventions to change lifestyle behaviors that affect health. National Health Service Scotland, 2010.
18.
Abraham C, Good A, Huedo-Medina TB, et al. Reliability and utility of the sharp taxonomy of behavior change techniques. Psychol Health, 2012; sup1: 1–357.
19.
Hak T, Bernts T. Coder training: explicit instruction and implicit socialization? In: Krippendorff K, Bock A, eds. The content analysis reader. Thousand Oaks: Sage; 2009:220-233.
20.
Bernard RM, Abrami PC, Lou Y, et al. How does distance education compare with classroom instruction? A meta-analysis of the empirical literature. Rev Educ Res. 2004;74:379-439.CrossRef
21.
Potter WJ, Levine-Donnerstein D. Rethinking validity and reliability in content analysis. J App Commun Res, 1999: 258–284.
22.
Michie S, Abraham C, Whittington C, et al. Effective techniques in healthy eating and physical activity interventions: a meta-regression. Health Psychol. 2009;28(6):690-701.CrossRefPubMed
23.
Dombrowski SU, Sniehotta FF, Johnston M, et al. Optimizing acceptability and feasibility of an evidence-based behavioral intervention for obese adults with obesity-related co-morbidities or additional risk factors for co-morbidities: an open-pilot intervention study in secondary care. Patient Educ Couns. 2012;87(1):108-119.CrossRefPubMed
24.
Murphy C, Ciszewska-Carr J. Sources of difference in reliability: identifying sources of difference in reliability in content analysis of online asynchronous discussions. Int Rev Res in Online Dist Learn, 2005.
25.
Pollock PH, Hamann K, Wilson BM. Learning through discussions: comparing the benefits of small-group and large-class settings. J Polit Sci Educ. 2011;7:48-64.CrossRef
26.
Salas E, Cannon-Bowers JA. The science of training: a decade of progress. Ann Rev Psychol. 2001;52:471-499.CrossRef
27.
Salas E, Kosarzycski MP, Burke S, et al. Emergent themes in distance learning research: some food for thought. Int J Manag Rev. 2002;4:135-153.CrossRef
28.
Bandura A. Social learning theory. Englewood Cliffs: Prentice-Hall; 1977.
29.
Lorencatto F, West R, Seymour N, et al. Developing a method for specifying the components of behavior change interventions in practice: the example of smoking cessation. J Consult Clin Psychol. 2013;81:528-544.CrossRefPubMed
30.
31.
Michie S, Wood CE, Johnston M, Abraham C, Francis J, et al. Behaviour change techniques: the development and evaluation of a taxonomic method for reporting and describing behaviour change interventions. Manuscript under review.
32.
Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull. 1968;70:213-220.CrossRefPubMed
33.
Fisher RA. Statistical methods for research workers, Edinburgh: Oliver and Boyd.
34.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159-174.CrossRefPubMed
35.
Glasziou PP, Chalmers I, Altman DG, et al. Taking healthcare interventions from trial to practice. BMJ. 2010;341:c3852.CrossRefPubMed
36.
Hoffman TC, Erueti C, Glasziou PP. Poor description of non-pharmacological interventions: analysis of consecutive sample of randomised trials. BMJ. 2013;347:f3755.CrossRef
37.
Aguinis H, Kraiger K. Benefits of training and development for individuals and teams, organisations and society. Annu Rev Psychol. 2009;60:451-474.CrossRefPubMed
38.
Abraham C, Johnston M, Michie S. et al. Are behavior change interventions replicable? Identifying reliable and valid behavior change techniques using BCT taxonomy v1 (BCTTv1), In prep 2013.
Metadata
Title
Applying the behaviour change technique (BCT) taxonomy v1: a study of coder training
Authors
Caroline E Wood, PhD
Michelle Richardson, PhD
Marie Johnston, PhD
Charles Abraham, PhD
Jill Francis, PhD
Wendy Hardeman, PhD
Susan Michie, DPhil
Publication date
01-06-2015
Publisher
Springer US
Published in
Translational Behavioral Medicine / Issue 2/2015
Print ISSN: 1869-6716
Electronic ISSN: 1613-9860
DOI
https://doi.org/10.1007/s13142-014-0290-z

Other articles of this Issue 2/2015

Translational Behavioral Medicine 2/2015 Go to the issue

News from CDC

News from CDC: applying a life course approach to primary cancer prevention

News from NIH

News from NIH: a center for translation research and implementation science

Original Research

Tweet for health: using an online social network to examine temporal trends in weight loss-related posts

Original Research

Recruitment and initial interest of men in yoga for smoking cessation: QuitStrong, a randomized control pilot study

Original Research

Engaging veterans with substance abuse disorders into a research trial: success with study branding, networking, and presence

Systematic Reviews

Network analysis of RE-AIM framework: chronology of the field and the connectivity of its contributors