Skip to main content
Top
Published in: Prevention Science 1/2016

01-01-2016

Feasibility and Reliability of a Coding System to Capture In-Session Group Behavior in Adolescents

Authors: Benjamin O. Ladd, Kristin Tomlinson, Mark G. Myers, Kristen G. Anderson

Published in: Prevention Science | Issue 1/2016

Login to get access

Abstract

Limited research has explored the role of in-session behavior during motivational enhancement (ME) in group formats. The current study presents initial feasibility of assessing behavior of high school students (N = 425) attending Project Options, a voluntary secondary drug and alcohol prevention program utilizing ME techniques. Building on previous research exploring client language supporting/opposing health behavior, student group behavior was coded live at the specific utterance and global level; group leader behavior was also coded globally. Interrater reliability of the coding system was assessed, and preliminary validity of the coding system was examined by exploring associations between characteristics of group members and in-session group behavior. Initial reliability estimates were excellent for the specific behavior codes. Reliability of the global codes was mixed, with raters demonstrating good reliability on support for unhealthy behavior, opposition to unhealthy behavior, and support for healthy behavior. Reliability of the group leader codes was fair to poor. Greater percent healthy talk was associated with a lower percentage of group members reporting lifetime alcohol use. The results of the current study suggest that some in-session behavior at the group level can be coded reliably via live observation and that in-session behavior at the group level is associated with alcohol use prior to attending the program. Future research is needed to explore the utility of in-session behavior in terms of predicting future behavior at the group and individual level.
Literature
go back to reference Amrhein, P. C., Miller, W. R., Yahne, C. E., Palmer, M., & Fulcher, L. (2003). Client commitment language during motivational interviewing predicts drug use outcomes. Journal of Consulting and Clinical Psychology, 71, 862–878.PubMedCrossRef Amrhein, P. C., Miller, W. R., Yahne, C. E., Palmer, M., & Fulcher, L. (2003). Client commitment language during motivational interviewing predicts drug use outcomes. Journal of Consulting and Clinical Psychology, 71, 862–878.PubMedCrossRef
go back to reference Baer, J. S., Beadnell, B., Garrett, S. B., Hartzler, B., Wells, E., & Peterson, P. L. (2008). Adolescent change language within a brief motivational intervention and substance use outcomes. Psychology of Addictive Behaviors, 22, 570–575.PubMedCrossRef Baer, J. S., Beadnell, B., Garrett, S. B., Hartzler, B., Wells, E., & Peterson, P. L. (2008). Adolescent change language within a brief motivational intervention and substance use outcomes. Psychology of Addictive Behaviors, 22, 570–575.PubMedCrossRef
go back to reference Bailey, K. A., Baker, A. L., Webster, R. A., & Lewin, T. J. (2004). Pilot randomized controlled trial of a brief alcohol intervention group for adolescents. Drug and Alcohol Review, 23, 157–166.PubMedCrossRef Bailey, K. A., Baker, A. L., Webster, R. A., & Lewin, T. J. (2004). Pilot randomized controlled trial of a brief alcohol intervention group for adolescents. Drug and Alcohol Review, 23, 157–166.PubMedCrossRef
go back to reference Barnett, E., Moyers, T. B., Sussman, S., Smith, C., Rohrbach, L. A., Sun, P., & Sprujit-Metz, D. (2014). From counselor skill to decreased marijuana use: Does change talk matter? Journal of Substance Abuse Treatment, 46, 498–505.PubMedPubMedCentralCrossRef Barnett, E., Moyers, T. B., Sussman, S., Smith, C., Rohrbach, L. A., Sun, P., & Sprujit-Metz, D. (2014). From counselor skill to decreased marijuana use: Does change talk matter? Journal of Substance Abuse Treatment, 46, 498–505.PubMedPubMedCentralCrossRef
go back to reference Bland, J. M., & Altman, D. G. (1986). Statistical methods for assessing agreement between two methods of clinical measurement. Lancet, 1, 307–310.PubMedCrossRef Bland, J. M., & Altman, D. G. (1986). Statistical methods for assessing agreement between two methods of clinical measurement. Lancet, 1, 307–310.PubMedCrossRef
go back to reference Bland, J. M., & Altman, D. G. (2007). Agreement between methods of measurement with multiple observations per individual. Journal of Biopharmaceutical Statistics, 17, 571–582.PubMedCrossRef Bland, J. M., & Altman, D. G. (2007). Agreement between methods of measurement with multiple observations per individual. Journal of Biopharmaceutical Statistics, 17, 571–582.PubMedCrossRef
go back to reference Botvin, G. J., & Griffin, K. W. (2007). School-based programmes to prevent alcohol, tobacco and other drug use. International Review of Psychiatry, 19, 607–615.PubMedCrossRef Botvin, G. J., & Griffin, K. W. (2007). School-based programmes to prevent alcohol, tobacco and other drug use. International Review of Psychiatry, 19, 607–615.PubMedCrossRef
go back to reference Brown, S. A. (2001). Facilitating change for adolescent alcohol problems: A multiple options approach. In E. F. Wagner & H. B. Waldron (Eds.), Innovations in adolescent substance abuse intervention (pp. 169–187). Oxford: Elsevier Science.CrossRef Brown, S. A. (2001). Facilitating change for adolescent alcohol problems: A multiple options approach. In E. F. Wagner & H. B. Waldron (Eds.), Innovations in adolescent substance abuse intervention (pp. 169–187). Oxford: Elsevier Science.CrossRef
go back to reference Brown, S. A., Anderson, K. G., Schulte, M. T., Sintov, N. D., & Frissell, K. C. (2005). Facilitating youth self-change through school-based intervention. Addictive Behaviors, 30, 1797–1810.PubMedCrossRef Brown, S. A., Anderson, K. G., Schulte, M. T., Sintov, N. D., & Frissell, K. C. (2005). Facilitating youth self-change through school-based intervention. Addictive Behaviors, 30, 1797–1810.PubMedCrossRef
go back to reference Christiansen, B. A., Goldman, M. S., & Brown, S. A. (1995). Alcohol expectancy questionnaire: Adolescent form. In N. I. A. A. A. Assessing (Ed.), Alcohol problems: A guide for clinicians and researchers (pp. 223–228). National Institute of Alcohol Abuse and Alcoholism: Rockville, MD. Christiansen, B. A., Goldman, M. S., & Brown, S. A. (1995). Alcohol expectancy questionnaire: Adolescent form. In N. I. A. A. A. Assessing (Ed.), Alcohol problems: A guide for clinicians and researchers (pp. 223–228). National Institute of Alcohol Abuse and Alcoholism: Rockville, MD.
go back to reference Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6, 284–290.CrossRef Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6, 284–290.CrossRef
go back to reference Cuijpers, P. (2002). Effective ingredients of school-based drug prevention programs: A systematic review. Addictive Behaviors, 27, 1009–1023.PubMedCrossRef Cuijpers, P. (2002). Effective ingredients of school-based drug prevention programs: A systematic review. Addictive Behaviors, 27, 1009–1023.PubMedCrossRef
go back to reference D’Amico, E. J., Feldstein Ewing, S. W., Engle, B., Hunter, S. B., Osilla, K. C., & Bryan, A. (2011). Group alcohol and drug treatment. In S. Naar-King & M. Suarez (Eds.), Motivational interviewing with adolescents and young adults (pp. 151–157). New York: Guilford Press. D’Amico, E. J., Feldstein Ewing, S. W., Engle, B., Hunter, S. B., Osilla, K. C., & Bryan, A. (2011). Group alcohol and drug treatment. In S. Naar-King & M. Suarez (Eds.), Motivational interviewing with adolescents and young adults (pp. 151–157). New York: Guilford Press.
go back to reference D’Amico, E. J., Osilla, K. C., Miles, J. N. V., Ewing, B., Sullivan, K., Katz, K., & Hunter, S. B. (2012). Assessing motivational interviewing integrity for group interventions with adolescents. Psychology of Addictive Behaviors, 26, 994–1000.PubMedPubMedCentralCrossRef D’Amico, E. J., Osilla, K. C., Miles, J. N. V., Ewing, B., Sullivan, K., Katz, K., & Hunter, S. B. (2012). Assessing motivational interviewing integrity for group interventions with adolescents. Psychology of Addictive Behaviors, 26, 994–1000.PubMedPubMedCentralCrossRef
go back to reference Ebel, R. L. (1979). Essentials of educational measurement (3rd ed.). Englewood Cliffs: Prentice-Hall. Ebel, R. L. (1979). Essentials of educational measurement (3rd ed.). Englewood Cliffs: Prentice-Hall.
go back to reference Engle, B., Macgowan, M. J., Wagner, E. F., & Amrhein, P. C. (2010). Markers of marijuana use outcomes with in adolescent substance abuse group treatment. Research on Social Work Practice, 20, 271–282.CrossRef Engle, B., Macgowan, M. J., Wagner, E. F., & Amrhein, P. C. (2010). Markers of marijuana use outcomes with in adolescent substance abuse group treatment. Research on Social Work Practice, 20, 271–282.CrossRef
go back to reference Gaume, J., Bertholet, N., Faouzi, M., Gmel, G., & Daeppen, J. B. (2010). Counselor motivational interviewing skills and young adult change talk articulation during brief motivational interventions. Journal of Substance Abuse Treatment, 39, 272–281.PubMedCrossRef Gaume, J., Bertholet, N., Faouzi, M., Gmel, G., & Daeppen, J. B. (2010). Counselor motivational interviewing skills and young adult change talk articulation during brief motivational interventions. Journal of Substance Abuse Treatment, 39, 272–281.PubMedCrossRef
go back to reference Gaume, J., Bertholet, N., Faouzi, M., Gmel, G., & Daeppen, J. B. (2013). Does change talk during brief motivational interventions with young men predict change in alcohol use? Journal of Substance Abuse Treatment, 44, 177–185.PubMedCrossRef Gaume, J., Bertholet, N., Faouzi, M., Gmel, G., & Daeppen, J. B. (2013). Does change talk during brief motivational interventions with young men predict change in alcohol use? Journal of Substance Abuse Treatment, 44, 177–185.PubMedCrossRef
go back to reference Glynn, L. H., & Moyers, T. B. (2010). Chasing change talk: The clinician’s role in evoking client language about changing. Journal of Substance Abuse Treatment, 39, 65–70.PubMedCrossRef Glynn, L. H., & Moyers, T. B. (2010). Chasing change talk: The clinician’s role in evoking client language about changing. Journal of Substance Abuse Treatment, 39, 65–70.PubMedCrossRef
go back to reference Hallgren, K. A. (2012). Computing inter-rater reliability for observational data: An overview and tutorial. Tutorial in Quantitative Methods for Psychology, 8, 23–34. Hallgren, K. A. (2012). Computing inter-rater reliability for observational data: An overview and tutorial. Tutorial in Quantitative Methods for Psychology, 8, 23–34.
go back to reference Hennessy, E.A. & Tanner-Smith, E.E. (2014). Effectiveness of brief school-based interventions for adolescents: A meta-analysis of alcohol use prevention programs. Prevention Science, online publication 10/8/14. Hennessy, E.A. & Tanner-Smith, E.E. (2014). Effectiveness of brief school-based interventions for adolescents: A meta-analysis of alcohol use prevention programs. Prevention Science, online publication 10/8/14.
go back to reference Hettema, J., Steele, J., & Miller, W. R. (2005). Motivational interviewing. Annual Review of Clinical Psychology, 1, 91–111.PubMedCrossRef Hettema, J., Steele, J., & Miller, W. R. (2005). Motivational interviewing. Annual Review of Clinical Psychology, 1, 91–111.PubMedCrossRef
go back to reference Johnston, L. D., O’Malley, P. M., Bachman, J. G., & Schulenberg, J. E. (2006). Monitoring the future national survey results on drug use, 1975–2005. Volume I: Secondary school students (NIH publication no. 06-5883). Bethesda: National Institute on Drug Abuse. Johnston, L. D., O’Malley, P. M., Bachman, J. G., & Schulenberg, J. E. (2006). Monitoring the future national survey results on drug use, 1975–2005. Volume I: Secondary school students (NIH publication no. 06-5883). Bethesda: National Institute on Drug Abuse.
go back to reference Miller, W. R., & Rollnick, S. (2002). Motivational interviewing: Preparing people for change (2nd ed.). New York: Guilford. Miller, W. R., & Rollnick, S. (2002). Motivational interviewing: Preparing people for change (2nd ed.). New York: Guilford.
go back to reference Moyers, T. B., Martin, T., Christopher, P. J., Houck, J. M., Tonigan, J. S., & Amrhein, P. C. (2007). Client language as a mediator of motivational interviewing efficacy: Where is the evidence? Alcoholism: Clinical and Experimental Research, 31, 40S–47S.CrossRef Moyers, T. B., Martin, T., Christopher, P. J., Houck, J. M., Tonigan, J. S., & Amrhein, P. C. (2007). Client language as a mediator of motivational interviewing efficacy: Where is the evidence? Alcoholism: Clinical and Experimental Research, 31, 40S–47S.CrossRef
go back to reference Moyers, T. B., Martin, T., Houck, J. M., Christopher, P. J., & Tonigan, J. S. (2009). From in-session behaviors to drinking outcomes: A causal chain for motivational interviewing. Journal of Consulting and Clinical Psychology, 77, 1113–1124.PubMedPubMedCentralCrossRef Moyers, T. B., Martin, T., Houck, J. M., Christopher, P. J., & Tonigan, J. S. (2009). From in-session behaviors to drinking outcomes: A causal chain for motivational interviewing. Journal of Consulting and Clinical Psychology, 77, 1113–1124.PubMedPubMedCentralCrossRef
go back to reference Popham, W. J. (1981). Modern educational measurement. Englewood Cliffs: Prentice-Hall. Popham, W. J. (1981). Modern educational measurement. Englewood Cliffs: Prentice-Hall.
go back to reference Sadava, S. W. (1986). Alcohol consumption and alcohol problems: Gender differences. Bulletin of the Society of Psychologists in Addictive Behaviors, 5, 67–73.CrossRef Sadava, S. W. (1986). Alcohol consumption and alcohol problems: Gender differences. Bulletin of the Society of Psychologists in Addictive Behaviors, 5, 67–73.CrossRef
go back to reference Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420–428.PubMedCrossRef Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420–428.PubMedCrossRef
go back to reference Teunissen, H. A., Spijkerman, R., Prinstein, M. J., Cohen, G. L., Engels, R. C. M. E., & Scholte, R. H. J. (2012). Adolescents’ conformity to their peers’ pro-alcohol and anti-alcohol norms: The power of popularity. Alcoholism: Clinical and Experimental Research, 36, 1257–1267.CrossRef Teunissen, H. A., Spijkerman, R., Prinstein, M. J., Cohen, G. L., Engels, R. C. M. E., & Scholte, R. H. J. (2012). Adolescents’ conformity to their peers’ pro-alcohol and anti-alcohol norms: The power of popularity. Alcoholism: Clinical and Experimental Research, 36, 1257–1267.CrossRef
Metadata
Title
Feasibility and Reliability of a Coding System to Capture In-Session Group Behavior in Adolescents
Authors
Benjamin O. Ladd
Kristin Tomlinson
Mark G. Myers
Kristen G. Anderson
Publication date
01-01-2016
Publisher
Springer US
Published in
Prevention Science / Issue 1/2016
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-015-0588-1

Other articles of this Issue 1/2016

Prevention Science 1/2016 Go to the issue