Skip to main content
Top
Published in: Journal of Clinical Psychology in Medical Settings 4/2013

01-12-2013

Reliability and Validity of a Treatment Fidelity Assessment for Motivational Interviewing Targeting Sexual Risk Behaviors in People Living with HIV/AIDS

Authors: Elizabeth K. Seng, Travis I. Lovejoy, The Project SAFER Intervention Team

Published in: Journal of Clinical Psychology in Medical Settings | Issue 4/2013

Login to get access

Abstract

This study psychometrically evaluates the Motivational Interviewing Treatment Integrity Code (MITI) to assess fidelity to motivational interviewing to reduce sexual risk behaviors in people living with HIV/AIDS. 74 sessions from a pilot randomized controlled trial of motivational interviewing to reduce sexual risk behaviors in people living with HIV were coded with the MITI. Participants reported sexual behavior at baseline, 3-month, and 6-months. Regarding reliability, excellent inter-rater reliability was achieved for measures of behavior frequency across the 12 sessions coded by both coders; global scales demonstrated poor intraclass correlations, but adequate percent agreement. Regarding validity, principle components analyses indicated that a two-factor model accounted for an adequate amount of variance in the data. These factors were associated with decreases in sexual risk behaviors after treatment. The MITI is a reliable and valid measurement of treatment fidelity for motivational interviewing targeting sexual risk behaviors in people living with HIV/AIDS.
Literature
go back to reference Aidala, A. A., Lee, G., Garbers, S., & Chiasson, M. A. (2006). Sexual behaviors and sexual risk in a prospective cohort of HIV-positive men and women in New York City, 1994–2002: Implications for prevention. AIDS Education and Prevention, 18, 12–32.PubMedCrossRef Aidala, A. A., Lee, G., Garbers, S., & Chiasson, M. A. (2006). Sexual behaviors and sexual risk in a prospective cohort of HIV-positive men and women in New York City, 1994–2002: Implications for prevention. AIDS Education and Prevention, 18, 12–32.PubMedCrossRef
go back to reference Antiss, T. (2009). Motivational interviewing in primary care. Journal of Clinical Psychology in Medical Settings, 16, 87–93.CrossRef Antiss, T. (2009). Motivational interviewing in primary care. Journal of Clinical Psychology in Medical Settings, 16, 87–93.CrossRef
go back to reference Bellg, A. J., Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., et al. (2004). Enhancing treatment fidelity in health behavior change studies: Best practices and recommendations from the NIH Behavior Chance Consortium. Health Psychology, 12(5), 443–451.CrossRef Bellg, A. J., Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., et al. (2004). Enhancing treatment fidelity in health behavior change studies: Best practices and recommendations from the NIH Behavior Chance Consortium. Health Psychology, 12(5), 443–451.CrossRef
go back to reference Bennett, G. A., Roberts, H. A., Vaughan, T. E., Gibbins, J. A., & Rouse, L. (2007). Evaluating a method of assessing competence in Motivational Interviewing: A study using simulated patients in the United Kingdom. Addictive Behaviors, 32, 69–79.PubMedCrossRef Bennett, G. A., Roberts, H. A., Vaughan, T. E., Gibbins, J. A., & Rouse, L. (2007). Evaluating a method of assessing competence in Motivational Interviewing: A study using simulated patients in the United Kingdom. Addictive Behaviors, 32, 69–79.PubMedCrossRef
go back to reference Brueck, R. K., Frick, K., Loessl, B., Kriston, L., Schondelmaier, S., Go, C., et al. (2009). Psychometric properties of the German version of the Motivational Interviewing Treatment Integrity Code. Journal of Substance Abuse Treatment, 36, 44–48.PubMedCrossRef Brueck, R. K., Frick, K., Loessl, B., Kriston, L., Schondelmaier, S., Go, C., et al. (2009). Psychometric properties of the German version of the Motivational Interviewing Treatment Integrity Code. Journal of Substance Abuse Treatment, 36, 44–48.PubMedCrossRef
go back to reference Cicchetti, D. V., & Sparrow, S. A. (1981). Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior. American Journal of Mental Deficiency, 86, 127–137.PubMed Cicchetti, D. V., & Sparrow, S. A. (1981). Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior. American Journal of Mental Deficiency, 86, 127–137.PubMed
go back to reference Cosio, D., Heckman, T. G., Anderson, T., Heckman, B. D., Garske, J., & McCarthy, J. (2010). Telephone-administered motivational interviewing to reduce risky sexual behavior in HIV-infected rural persons: A pilot randomized clinical trial. Sexually Transmitted Diseases, 37, 140–146.PubMedCrossRef Cosio, D., Heckman, T. G., Anderson, T., Heckman, B. D., Garske, J., & McCarthy, J. (2010). Telephone-administered motivational interviewing to reduce risky sexual behavior in HIV-infected rural persons: A pilot randomized clinical trial. Sexually Transmitted Diseases, 37, 140–146.PubMedCrossRef
go back to reference Crystal, S., Akincigil, A., Sambamoorthi, U., Wenger, N., Fleishman, J. A., Zingmond, D. S., et al. (2003). The diverse older HIV-positive population: A national profile of economic circumstances, social support and quality of life. Journal of Acquired Immune Deficiency Syndromes, 33, S76–S83.PubMedCrossRef Crystal, S., Akincigil, A., Sambamoorthi, U., Wenger, N., Fleishman, J. A., Zingmond, D. S., et al. (2003). The diverse older HIV-positive population: A national profile of economic circumstances, social support and quality of life. Journal of Acquired Immune Deficiency Syndromes, 33, S76–S83.PubMedCrossRef
go back to reference Fisher, J. D., & Smith, L. (2009). Secondary prevention of HIV infection: The current state of prevention for positives. Current Opinion in HIV and AIDS, 4, 279–287.PubMedCrossRef Fisher, J. D., & Smith, L. (2009). Secondary prevention of HIV infection: The current state of prevention for positives. Current Opinion in HIV and AIDS, 4, 279–287.PubMedCrossRef
go back to reference Fleiss, J. L., & Shrout, P. E. (1978). Approximate interval estimation for a certain intraclass correlation coefficient. Psychometrika, 43, 259–262.CrossRef Fleiss, J. L., & Shrout, P. E. (1978). Approximate interval estimation for a certain intraclass correlation coefficient. Psychometrika, 43, 259–262.CrossRef
go back to reference Forsberg, L., Berman, A. H., Kallmen, H., Hermansson, U., & Helgason, A. R. (2008). A test of the validity of the motivational interviewing treatment integrity code. Cognitive Behaviour Therapy, 37, 183–191.PubMedCrossRef Forsberg, L., Berman, A. H., Kallmen, H., Hermansson, U., & Helgason, A. R. (2008). A test of the validity of the motivational interviewing treatment integrity code. Cognitive Behaviour Therapy, 37, 183–191.PubMedCrossRef
go back to reference Forsberg, L., Kallmen, H., Hermansson, U., Berman, A. H., & Helgason, A. R. (2007). Coding counsellor behavior in motivational interviewing sessions: Inter-rater reliability for the Swedish Motivational Interviewing Treatment Integrity Code (MITI). Cognitive Behaviour Therapy, 36, 162–169.PubMedCrossRef Forsberg, L., Kallmen, H., Hermansson, U., Berman, A. H., & Helgason, A. R. (2007). Coding counsellor behavior in motivational interviewing sessions: Inter-rater reliability for the Swedish Motivational Interviewing Treatment Integrity Code (MITI). Cognitive Behaviour Therapy, 36, 162–169.PubMedCrossRef
go back to reference Golin, C. E., Davis, R. A., Przybyla, S. M., Fowler, B., Parker, S., Earp, J. A., et al. (2010). SafeTalk, a multicomponent, motivational interviewing-based, safer sex counseling program for people living with HIV/AIDS: A qualitative assessment of patients’ views. AIDS Patient Care STDS, 24, 237–245.PubMedCrossRef Golin, C. E., Davis, R. A., Przybyla, S. M., Fowler, B., Parker, S., Earp, J. A., et al. (2010). SafeTalk, a multicomponent, motivational interviewing-based, safer sex counseling program for people living with HIV/AIDS: A qualitative assessment of patients’ views. AIDS Patient Care STDS, 24, 237–245.PubMedCrossRef
go back to reference Golin, C. E., Earp, J. A., Grodensky, C. A., Patel, S. N., Suchindran, C., Parikh, M., et al. (2011). Longitudinal effects of SafeTalk, a motivational interviewing-based program to improve safer sex practices among people living with HIV/AIDS. AIDS and Behaviour, 16(5), 1182–1191.CrossRef Golin, C. E., Earp, J. A., Grodensky, C. A., Patel, S. N., Suchindran, C., Parikh, M., et al. (2011). Longitudinal effects of SafeTalk, a motivational interviewing-based program to improve safer sex practices among people living with HIV/AIDS. AIDS and Behaviour, 16(5), 1182–1191.CrossRef
go back to reference Golin, C. E., Patel, S., Tiller, K., Quinlivan, E. B., Grodensky, C. A., & Boland, M. (2007). Start talking about risks: Development of a motivational interviewing-based safer sex program for people living with HIV. AIDS and Behavior, 11, S72–S83.PubMedCrossRef Golin, C. E., Patel, S., Tiller, K., Quinlivan, E. B., Grodensky, C. A., & Boland, M. (2007). Start talking about risks: Development of a motivational interviewing-based safer sex program for people living with HIV. AIDS and Behavior, 11, S72–S83.PubMedCrossRef
go back to reference Gorusch, R. L. (1983). Factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates. Gorusch, R. L. (1983). Factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
go back to reference Gottlieb Hansen, A. B., Becker, U., Nielsen, A. S., Gronbaek, M., & Tolstrup, J. S. (2011). Brief alcohol intervention by newly trained workers versus leaflets: Comparison of effect in older heavy drinkers identified in a population health examination survey: A randomized controlled trial. Alcohol and Alcoholism, 47(1), 25–32.CrossRef Gottlieb Hansen, A. B., Becker, U., Nielsen, A. S., Gronbaek, M., & Tolstrup, J. S. (2011). Brief alcohol intervention by newly trained workers versus leaflets: Comparison of effect in older heavy drinkers identified in a population health examination survey: A randomized controlled trial. Alcohol and Alcoholism, 47(1), 25–32.CrossRef
go back to reference Hettema, J., Steele, J., & Miller, W. R. (2005). Motivational interviewing. Annual Review of Clinical Psychology, 1, 91–111.PubMedCrossRef Hettema, J., Steele, J., & Miller, W. R. (2005). Motivational interviewing. Annual Review of Clinical Psychology, 1, 91–111.PubMedCrossRef
go back to reference Kalichman, S., & Cain, D. (2008). Repeat HIV testing and HIV transmission risk behaviors among sexually transmitted infection clinic patients. Journal of Clinical Psychology in Medical Settings, 15, 127–133.PubMedCrossRef Kalichman, S., & Cain, D. (2008). Repeat HIV testing and HIV transmission risk behaviors among sexually transmitted infection clinic patients. Journal of Clinical Psychology in Medical Settings, 15, 127–133.PubMedCrossRef
go back to reference Lovejoy, T. I., Heckman, T. G., Suhr, J. A., Anderson, T., Heckman, B. D., & France, C. R. (2011). Telephone-administered motivational interviewing reduces risky sexual behavior in HIV-positive late middle-age and older adults: A pilot randomized controlled trial. AIDS and Behavior, 15, 1623–1634.PubMedCrossRef Lovejoy, T. I., Heckman, T. G., Suhr, J. A., Anderson, T., Heckman, B. D., & France, C. R. (2011). Telephone-administered motivational interviewing reduces risky sexual behavior in HIV-positive late middle-age and older adults: A pilot randomized controlled trial. AIDS and Behavior, 15, 1623–1634.PubMedCrossRef
go back to reference MacCallum, R. C., Wideman, K. F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4, 84–99.CrossRef MacCallum, R. C., Wideman, K. F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4, 84–99.CrossRef
go back to reference Maissi, E., Ridge, K., Treasure, J., Chalder, T., Roche, S., Bartlett, J., et al. (2011). Nurse-led psychological interventions to improve diabetes control: Assessing competencies. Patient Education and Counseling, 84, e37–e43.PubMedCrossRef Maissi, E., Ridge, K., Treasure, J., Chalder, T., Roche, S., Bartlett, J., et al. (2011). Nurse-led psychological interventions to improve diabetes control: Assessing competencies. Patient Education and Counseling, 84, e37–e43.PubMedCrossRef
go back to reference Marks, G., Crepaz, N., Senterfitt, J. W., & Janssen, R. S. (2005). Meta-analysis of high-risk sexual behavior in persons aware and unaware they are infected with HIV in the United States: Implications for HIV prevention programs. Journal of Acquired Immune Deficiency Syndromes, 39, 446–453.PubMedCrossRef Marks, G., Crepaz, N., Senterfitt, J. W., & Janssen, R. S. (2005). Meta-analysis of high-risk sexual behavior in persons aware and unaware they are infected with HIV in the United States: Implications for HIV prevention programs. Journal of Acquired Immune Deficiency Syndromes, 39, 446–453.PubMedCrossRef
go back to reference McCambridge, J., Day, M., Thomas, B. A., & Strang, J. (2011). Fidelity to Motivational Interviewing and subsequent cannabis cessation among adolescents. Addictive Behaviors, 36, 749–754.PubMedCrossRef McCambridge, J., Day, M., Thomas, B. A., & Strang, J. (2011). Fidelity to Motivational Interviewing and subsequent cannabis cessation among adolescents. Addictive Behaviors, 36, 749–754.PubMedCrossRef
go back to reference Morgenstern, J., Bux, D. A., Jr, Parsons, J., Hagman, B. T., Wainberg, M., & Irwin, T. (2009). Randomized trial to reduce club drug use and HIV risk behaviors among men who have sex with men. Journal of Consulting and Clinical Psychology, 77, 645–656.PubMedCrossRef Morgenstern, J., Bux, D. A., Jr, Parsons, J., Hagman, B. T., Wainberg, M., & Irwin, T. (2009). Randomized trial to reduce club drug use and HIV risk behaviors among men who have sex with men. Journal of Consulting and Clinical Psychology, 77, 645–656.PubMedCrossRef
go back to reference Moyers, T. B., Martin, T., Manuel, J. K., Hendrickson, S. M., & Miller, W. R. (2005). Assessing competence in the use of motivational interviewing. Journal of Substance Abuse Treatment, 28, 19–26.PubMedCrossRef Moyers, T. B., Martin, T., Manuel, J. K., Hendrickson, S. M., & Miller, W. R. (2005). Assessing competence in the use of motivational interviewing. Journal of Substance Abuse Treatment, 28, 19–26.PubMedCrossRef
go back to reference Mundfrom, D. J., Shaw, D. G., & Tian, L. K. (2005). Minimum sample size recommendations for conducting factor analysis. International Journal of Testing, 5, 159–168.CrossRef Mundfrom, D. J., Shaw, D. G., & Tian, L. K. (2005). Minimum sample size recommendations for conducting factor analysis. International Journal of Testing, 5, 159–168.CrossRef
go back to reference Naar-King, S., Outlaw, A., Green-Jones, M., Wright, K., & Parsons, J. T. (2009). Motivational interviewing by peer outreach workers: A pilot randomized clinical trial to retain adolescents and young adults in HIV care. AIDS Care, 21, 868–873.PubMedCrossRef Naar-King, S., Outlaw, A., Green-Jones, M., Wright, K., & Parsons, J. T. (2009). Motivational interviewing by peer outreach workers: A pilot randomized clinical trial to retain adolescents and young adults in HIV care. AIDS Care, 21, 868–873.PubMedCrossRef
go back to reference Naar-King, S., Parsons, J., Murphy, D. A., Kolmodin, K., & Harris, D. R. (2010). A multisite randomized trial of a motivational intervention targeting multiple risks in youth living with HIV: Initial effects on motivation, self-efficacy and depression. Journal of Adolescent Health, 46, 422–428.PubMedCrossRef Naar-King, S., Parsons, J., Murphy, D. A., Kolmodin, K., & Harris, D. R. (2010). A multisite randomized trial of a motivational intervention targeting multiple risks in youth living with HIV: Initial effects on motivation, self-efficacy and depression. Journal of Adolescent Health, 46, 422–428.PubMedCrossRef
go back to reference Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill, Inc. Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill, Inc.
go back to reference Piccano, J. F., Roffman, R. A., Kalichman, S., Rutledge, S. E., & Berghuis, J. P. (2011). A telephone based brief intervention using motivational enhancement to facilitate HIV risk reduction among MSM: A pilot study. AIDS and Behavior, 5, 251–262.CrossRef Piccano, J. F., Roffman, R. A., Kalichman, S., Rutledge, S. E., & Berghuis, J. P. (2011). A telephone based brief intervention using motivational enhancement to facilitate HIV risk reduction among MSM: A pilot study. AIDS and Behavior, 5, 251–262.CrossRef
go back to reference Pierson, H. M., Hayes, S. C., Gifford, E. V., Roget, N., Padilla, M., Bissett, R., et al. (2007). An examination of the Motivational Interviewing Treatment Integrity code. Journal of Substance Abuse Treatment, 32, 11–17.PubMedCrossRef Pierson, H. M., Hayes, S. C., Gifford, E. V., Roget, N., Padilla, M., Bissett, R., et al. (2007). An examination of the Motivational Interviewing Treatment Integrity code. Journal of Substance Abuse Treatment, 32, 11–17.PubMedCrossRef
go back to reference Rollnick, S., & Miller, W. R. (1995). What is motivational interviewing? Behavioral and Cognitive Psychotherapy, 23, 325–334.CrossRef Rollnick, S., & Miller, W. R. (1995). What is motivational interviewing? Behavioral and Cognitive Psychotherapy, 23, 325–334.CrossRef
go back to reference Soderlund, L. L., Madson, M. B., Rubak, S., & Nilsen, P. (2011). A systematic review of motivational interviewing training for general health care practitioners. Patient Education and Counseling, 2011, 16–26.CrossRef Soderlund, L. L., Madson, M. B., Rubak, S., & Nilsen, P. (2011). A systematic review of motivational interviewing training for general health care practitioners. Patient Education and Counseling, 2011, 16–26.CrossRef
Metadata
Title
Reliability and Validity of a Treatment Fidelity Assessment for Motivational Interviewing Targeting Sexual Risk Behaviors in People Living with HIV/AIDS
Authors
Elizabeth K. Seng
Travis I. Lovejoy
The Project SAFER Intervention Team
Publication date
01-12-2013
Publisher
Springer US
Published in
Journal of Clinical Psychology in Medical Settings / Issue 4/2013
Print ISSN: 1068-9583
Electronic ISSN: 1573-3572
DOI
https://doi.org/10.1007/s10880-012-9343-y

Other articles of this Issue 4/2013

Journal of Clinical Psychology in Medical Settings 4/2013 Go to the issue