Skip to main content
Top
Published in: Prevention Science 4/2008

01-12-2008

Estimating Intervention Effects of Prevention Programs: Accounting for Noncompliance

Authors: Elizabeth A. Stuart, Deborah F. Perry, Huynh-Nhu Le, Nicholas S. Ialongo

Published in: Prevention Science | Issue 4/2008

Login to get access

Abstract

Individuals not fully complying with their assigned treatments is a common problem encountered in randomized evaluations of behavioral interventions. Treatment group members rarely attend all sessions or do all “required” activities; control group members sometimes find ways to participate in aspects of the intervention. As a result, there is often interest in estimating both the effect of being assigned to participate in the intervention, as well as the impact of actually participating and doing all of the required activities. Methods known broadly as “complier average causal effects” (CACE) or “instrumental variables” (IV) methods have been developed to estimate this latter effect, but they are more commonly applied in medical and treatment research. Since the use of these statistical techniques in prevention trials has been less widespread, many prevention scientists may not be familiar with the underlying assumptions and limitations of CACE and IV approaches. This paper provides an introduction to these methods, described in the context of randomized controlled trials of two preventive interventions: one for perinatal depression among at-risk women and the other for aggressive disruptive behavior in children. Through these case studies, the underlying assumptions and limitations of these methods are highlighted.
Footnotes
1
The exact line of code for R is “tsls(outcome~D + x1 + x2, ~T + x1 + x2, data = dataset).”
 
2
The exact line of code for Stata is “ivregress 2sls outcome x1 x2 (D = T).”
 
Literature
go back to reference Angrist, J., & Imbens, G. W. (1995). Two-stage least squares estimation of average causal effects in models with variable treatment intensity. Journal of the American Statistical Association, 90, 431–442. doi:10.2307/2291054.CrossRef Angrist, J., & Imbens, G. W. (1995). Two-stage least squares estimation of average causal effects in models with variable treatment intensity. Journal of the American Statistical Association, 90, 431–442. doi:10.​2307/​2291054.CrossRef
go back to reference Angrist, J., Imbens, G. W., & Rubin, D. B. (1996). Identification of causal effects using instrumental variables. Journal of the American Statistical Association, 91, 444–472. doi:10.2307/2291629.CrossRef Angrist, J., Imbens, G. W., & Rubin, D. B. (1996). Identification of causal effects using instrumental variables. Journal of the American Statistical Association, 91, 444–472. doi:10.​2307/​2291629.CrossRef
go back to reference Baker, S. G., & Kramer, B. S. (2005). Simple maximum likelihood estimates of efficacy in randomized trials and before-and-after studies, with implications for meta-analysis. Statistical Methods in Medical Research, 14, 349–367. doi:10.1191/0962280205sm404oa.PubMedCrossRef Baker, S. G., & Kramer, B. S. (2005). Simple maximum likelihood estimates of efficacy in randomized trials and before-and-after studies, with implications for meta-analysis. Statistical Methods in Medical Research, 14, 349–367. doi:10.​1191/​0962280205sm404o​a.PubMedCrossRef
go back to reference Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Manual for the Beck Depression Inventory (2nd ed.). San Antonio, TX: The Psychological Corporation. Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Manual for the Beck Depression Inventory (2nd ed.). San Antonio, TX: The Psychological Corporation.
go back to reference Black, M. M., Bentley, M. E., Papas, M. A., Oberlander, S., Teti, L. O., McNary, S., et al. (2006). Delaying second births among adolescent mothers: A randomized, controlled trial of a home-based mentoring program. Pediatrics, 118, e1087–e1099. doi:10.1542/peds.2005-2318.PubMedCrossRef Black, M. M., Bentley, M. E., Papas, M. A., Oberlander, S., Teti, L. O., McNary, S., et al. (2006). Delaying second births among adolescent mothers: A randomized, controlled trial of a home-based mentoring program. Pediatrics, 118, e1087–e1099. doi:10.​1542/​peds.​2005-2318.PubMedCrossRef
go back to reference Connell, A. M., Dishion, T. J., Yasui, M., & Kavanagh, K. (2007). An adaptive approach to family intervention: Linking engagement in family-centered intervention to reductions in adolescent problem behavior. Journal of Consulting and Clinical Psychology, 75, 568–579. doi:10.1037/0022-006X.75.4.568.PubMedCrossRef Connell, A. M., Dishion, T. J., Yasui, M., & Kavanagh, K. (2007). An adaptive approach to family intervention: Linking engagement in family-centered intervention to reductions in adolescent problem behavior. Journal of Consulting and Clinical Psychology, 75, 568–579. doi:10.​1037/​0022-006X.​75.​4.​568.PubMedCrossRef
go back to reference Dunn, G., Maracy, M., Dowrick, C., Ayuso-Mateos, J. L., Dalgard, O. S., Page, H., et al. (2003). Estimating psychological treatment effects from a randomised controlled trial with both non-compliance and loss to follow-up. The British Journal of Psychiatry, 183, 323–331. doi:10.1192/bjp.183.4.323.PubMedCrossRef Dunn, G., Maracy, M., Dowrick, C., Ayuso-Mateos, J. L., Dalgard, O. S., Page, H., et al. (2003). Estimating psychological treatment effects from a randomised controlled trial with both non-compliance and loss to follow-up. The British Journal of Psychiatry, 183, 323–331. doi:10.​1192/​bjp.​183.​4.​323.PubMedCrossRef
go back to reference Dunn, G., Maracy, M., & Tomenson, B. (2005). Estimating treatment effects from randomized controlled trials with noncompliance and loss to follow-up: The role of instrumental variables methods. Statistical Methods in Medical Research, 14, 369–395. doi:10.1191/0962280205sm403oa.PubMedCrossRef Dunn, G., Maracy, M., & Tomenson, B. (2005). Estimating treatment effects from randomized controlled trials with noncompliance and loss to follow-up: The role of instrumental variables methods. Statistical Methods in Medical Research, 14, 369–395. doi:10.​1191/​0962280205sm403o​a.PubMedCrossRef
go back to reference Foster, E. M. (2000). Is more better than less? An analysis of children’s mental health services. Health Services Research, 35, 1135–1158.PubMed Foster, E. M. (2000). Is more better than less? An analysis of children’s mental health services. Health Services Research, 35, 1135–1158.PubMed
go back to reference Frangakis, C. E., & Rubin, D. B. (1999). Addressing complications of intention-to-treat analysis in the combined presence of all-or-none treatment noncompliance and subsequent missing outcomes. Biometrika, 86, 365–379. doi:10.1093/biomet/86.2.365.CrossRef Frangakis, C. E., & Rubin, D. B. (1999). Addressing complications of intention-to-treat analysis in the combined presence of all-or-none treatment noncompliance and subsequent missing outcomes. Biometrika, 86, 365–379. doi:10.​1093/​biomet/​86.​2.​365.CrossRef
go back to reference Hirano, K., Imbens, G. W., Rubin, D. B., & Zhou, X. (2000). Assessing the effect of influenza vaccine in an encouragement design with covariates. Biostatistics (Oxford, England), 1, 69–88. doi:10.1093/biostatistics/1.1.69. Hirano, K., Imbens, G. W., Rubin, D. B., & Zhou, X. (2000). Assessing the effect of influenza vaccine in an encouragement design with covariates. Biostatistics (Oxford, England), 1, 69–88. doi:10.​1093/​biostatistics/​1.​1.​69.
go back to reference Ialongo, N., Werthamer, L., Brown, C. H., Kellam, S., & Wai, S. B. (1999). The proximal impact of two first grade preventive interventions on the early risk behaviors for later substance abuse, depression and antisocial behavior. American Journal of Community Psychology, 27, 599–642. doi:10.1023/A:1022137920532.PubMedCrossRef Ialongo, N., Werthamer, L., Brown, C. H., Kellam, S., & Wai, S. B. (1999). The proximal impact of two first grade preventive interventions on the early risk behaviors for later substance abuse, depression and antisocial behavior. American Journal of Community Psychology, 27, 599–642. doi:10.​1023/​A:​1022137920532.PubMedCrossRef
go back to reference Lin, J. Y., Ten Have, T. R., & Elliott, M. R. (2008). Longitudinal nested compliance class model in the presence of time-varying noncompliance. Journal of the American Statistical Association, 103, 462–473.CrossRef Lin, J. Y., Ten Have, T. R., & Elliott, M. R. (2008). Longitudinal nested compliance class model in the presence of time-varying noncompliance. Journal of the American Statistical Association, 103, 462–473.CrossRef
go back to reference Muñoz, R. F., Le, H. N., Ghosh Ippen, C., Diaz, M. A., Urizar Jr, G. G., Soto, J., et al. (2007). Prevention of postpartum depression in low-income women: Development of the Mamás y Bebés/Mothers and Babies Course. Cognitive and Behavioral Practice, 14, 70–83. doi:10.1016/j.cbpra.2006.04.021.CrossRef Muñoz, R. F., Le, H. N., Ghosh Ippen, C., Diaz, M. A., Urizar Jr, G. G., Soto, J., et al. (2007). Prevention of postpartum depression in low-income women: Development of the Mamás y Bebés/Mothers and Babies Course. Cognitive and Behavioral Practice, 14, 70–83. doi:10.​1016/​j.​cbpra.​2006.​04.​021.CrossRef
go back to reference Muthén, L. K., & Muthén, B. O. (1998–2007). Mplus user’s guide (5th ed.). Los Angeles, CA: Author. Muthén, L. K., & Muthén, B. O. (1998–2007). Mplus user’s guide (5th ed.). Los Angeles, CA: Author.
go back to reference R Core Development Team. (2007). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. ISBN 3-900051-07-0. www.r-project.org. R Core Development Team. (2007). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. ISBN 3-900051-07-0. www.​r-project.​org.
go back to reference Rosenbaum, P. R. (2002). Observational studies (2nd ed.). New York: Springer. Rosenbaum, P. R. (2002). Observational studies (2nd ed.). New York: Springer.
go back to reference SPSS Inc. (2007). SPSS Base 16.0 for Windows. Chicago, IL: Author. SPSS Inc. (2007). SPSS Base 16.0 for Windows. Chicago, IL: Author.
go back to reference Stata Corp. (2007). Stata statistical software: Release 10. College Station, TX: Author. Stata Corp. (2007). Stata statistical software: Release 10. College Station, TX: Author.
go back to reference Werthamer-Larsson, L., Kellam, S. G., & Wheeler, L. (1991). Effect of first-grade classroom environment on child shy behavior, aggressive behavior, and concentration problems. American Journal of Community Psychology, 19, 585–602. doi:10.1007/BF00937993.PubMedCrossRef Werthamer-Larsson, L., Kellam, S. G., & Wheeler, L. (1991). Effect of first-grade classroom environment on child shy behavior, aggressive behavior, and concentration problems. American Journal of Community Psychology, 19, 585–602. doi:10.​1007/​BF00937993.PubMedCrossRef
Metadata
Title
Estimating Intervention Effects of Prevention Programs: Accounting for Noncompliance
Authors
Elizabeth A. Stuart
Deborah F. Perry
Huynh-Nhu Le
Nicholas S. Ialongo
Publication date
01-12-2008
Publisher
Springer US
Published in
Prevention Science / Issue 4/2008
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-008-0104-y

Other articles of this Issue 4/2008

Prevention Science 4/2008 Go to the issue