Skip to main content
Top
Published in: Prevention Science 3/2013

01-06-2013

Toward Rigorous Idiographic Research in Prevention Science: Comparison Between Three Analytic Strategies for Testing Preventive Intervention in Very Small Samples

Authors: Ty A. Ridenour, Thomas Z. Pineo, Mildred M. Maldonado Molina, Kristen Hassmiller Lich

Published in: Prevention Science | Issue 3/2013

Login to get access

Abstract

Psychosocial prevention research lacks evidence from intensive within-person lines of research to understand idiographic processes related to development and response to intervention. Such data could be used to fill gaps in the literature and expand the study design options for prevention researchers, including lower-cost yet rigorous studies (e.g., for program evaluations), pilot studies, designs to test programs for low prevalence outcomes, selective/indicated/adaptive intervention research, and understanding of differential response to programs. This study compared three competing analytic strategies designed for this type of research: autoregressive moving average, mixed model trajectory analysis, and P-technique. Illustrative time series data were from a pilot study of an intervention for nursing home residents with diabetes (N = 4) designed to improve control of blood glucose. A within-person, intermittent baseline design was used. Intervention effects were detected using each strategy for the aggregated sample and for individual patients. The P-technique model most closely replicated observed glucose levels. ARIMA and P-technique models were most similar in terms of estimated intervention effects and modeled glucose levels. However, ARIMA and P-technique also were more sensitive to missing data, outliers and number of observations. Statistical testing suggested that results generalize both to other persons as well as to idiographic, longitudinal processes. This study demonstrated the potential contributions of idiographic research in prevention science as well as the need for simulation studies to delineate the research circumstances when each analytic approach is optimal for deriving the correct parameter estimates.
Literature
go back to reference Biglan, A., Ary, D. V., & Wagenaar, A. C. (2000) The value of interrupted time-series experiments for community intervention research. Prevention Science, 1, 31–49. Biglan, A., Ary, D. V., & Wagenaar, A. C. (2000) The value of interrupted time-series experiments for community intervention research. Prevention Science, 1, 31–49.
go back to reference Biglan, A., Ary, D., Koehn, V., & Levings, D. (1996). Mobilizing positive reinforcement in communities to reduce youth access to tobacco. American Journal of Community Psychology, 24, 625–638.PubMedCrossRef Biglan, A., Ary, D., Koehn, V., & Levings, D. (1996). Mobilizing positive reinforcement in communities to reduce youth access to tobacco. American Journal of Community Psychology, 24, 625–638.PubMedCrossRef
go back to reference Boker, S. M., Molenaar, P. C. M., & Nesselroade, J. R. (2009). Issues in intraindividual variability: Individual differences in equilibria and dynamics over multiple time series. Psychology and Aging, 24, 858–862.PubMedCrossRef Boker, S. M., Molenaar, P. C. M., & Nesselroade, J. R. (2009). Issues in intraindividual variability: Individual differences in equilibria and dynamics over multiple time series. Psychology and Aging, 24, 858–862.PubMedCrossRef
go back to reference Bolderman, K. M. (2002). Putting your patients on the pump (pp. 39–52). Alexandria, VA: American Diabetes Association, Inc. Bolderman, K. M. (2002). Putting your patients on the pump (pp. 39–52). Alexandria, VA: American Diabetes Association, Inc.
go back to reference Borkenau, P., & Ostendorf, F. (1998). The Big Five as states: How useful is the five-factor model to describe intraindividual variations over time? Journal of Research in Personality, 32, 202–221.CrossRef Borkenau, P., & Ostendorf, F. (1998). The Big Five as states: How useful is the five-factor model to describe intraindividual variations over time? Journal of Research in Personality, 32, 202–221.CrossRef
go back to reference Burns, M. K., Christ, T. J., Boice, C. H., & Szadokierski, I. (2010). Special education in an RTI model: Addressing unique learning needs. In T. A. Glover & S. Vaughn (Eds.), The promise of response to intervention (pp. 267–285). New York: Guilford. Burns, M. K., Christ, T. J., Boice, C. H., & Szadokierski, I. (2010). Special education in an RTI model: Addressing unique learning needs. In T. A. Glover & S. Vaughn (Eds.), The promise of response to intervention (pp. 267–285). New York: Guilford.
go back to reference Chatfield, C. (2004). The analysis of time series: an introduction (6th ed.). Boca Raton, FL: Chapman and Hall/CRC Press. Chatfield, C. (2004). The analysis of time series: an introduction (6th ed.). Boca Raton, FL: Chapman and Hall/CRC Press.
go back to reference Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Chicago: Rand McNally Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Chicago: Rand McNally
go back to reference De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131, 483–509.PubMedCrossRef De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131, 483–509.PubMedCrossRef
go back to reference Ennett, S. T., Ringwalt, C. L., Thorne, J., Rohrbach, L. A., Vincus, A., Simons-Rudolph, A., & Jones, S. (2003). A comparison of current practice in school-based substance use prevention programs with meta-analysis findings. Prevention Science, 4, 1–14.PubMedCrossRef Ennett, S. T., Ringwalt, C. L., Thorne, J., Rohrbach, L. A., Vincus, A., Simons-Rudolph, A., & Jones, S. (2003). A comparison of current practice in school-based substance use prevention programs with meta-analysis findings. Prevention Science, 4, 1–14.PubMedCrossRef
go back to reference Gaynor, A. K. (1998). Analyzing problems in schools and school systems: a theoretical approach. Mahwah, N.J., L.: Erlbaum Associates. Gaynor, A. K. (1998). Analyzing problems in schools and school systems: a theoretical approach. Mahwah, N.J., L.: Erlbaum Associates.
go back to reference Hedeker, D., & Gibbons, R. D. (2006). Longitudinal data analysis. Hoboken: Wiley. Hedeker, D., & Gibbons, R. D. (2006). Longitudinal data analysis. Hoboken: Wiley.
go back to reference Hintze, J. M., & Marotte, A. M. (2010). Student assessment and data-based decision making. In T. A. Glover & S. Vaughn (Eds.), The promise of response to intervention (pp. 57–77). New York: Guilford. Hintze, J. M., & Marotte, A. M. (2010). Student assessment and data-based decision making. In T. A. Glover & S. Vaughn (Eds.), The promise of response to intervention (pp. 57–77). New York: Guilford.
go back to reference Howe, G. W., Beach, S. R. H., & Brody, G. H. (2010). Microtrial methods for translation gene- environment dynamics into preventive interventions. Prevention Science, 11, 343–354.PubMedCrossRef Howe, G. W., Beach, S. R. H., & Brody, G. H. (2010). Microtrial methods for translation gene- environment dynamics into preventive interventions. Prevention Science, 11, 343–354.PubMedCrossRef
go back to reference Hoyle, R. H. (1999). Statistical strategies for small sample research. Thousand Oaks, CA: Sage. Hoyle, R. H. (1999). Statistical strategies for small sample research. Thousand Oaks, CA: Sage.
go back to reference Kazdin, A. E., & Blase, S. L. (2011). Rebooting psychotherapy research and practice to reduce the burden of mental illness. Perspective on Psychological Science, 6, 21–37.CrossRef Kazdin, A. E., & Blase, S. L. (2011). Rebooting psychotherapy research and practice to reduce the burden of mental illness. Perspective on Psychological Science, 6, 21–37.CrossRef
go back to reference Kwok, O., West, S. G., & Green, S. B. (2007). The impact of misspecifying the within-subject covariance structure in multiwave longitudinal multilevel models: A Monte Carlo study. Multivariate Behavioral Research, 42, 557–592. Kwok, O., West, S. G., & Green, S. B. (2007). The impact of misspecifying the within-subject covariance structure in multiwave longitudinal multilevel models: A Monte Carlo study. Multivariate Behavioral Research, 42, 557–592.
go back to reference Littell, R. C., Milliken, G. A., Stroup, W. W., Wolfinger, R. D., & Schabenberger, O. (2006). SAS for mixed models (2nd ed.). Cary, NC: SAS Press. Littell, R. C., Milliken, G. A., Stroup, W. W., Wolfinger, R. D., & Schabenberger, O. (2006). SAS for mixed models (2nd ed.). Cary, NC: SAS Press.
go back to reference Maldonado Molina, M. M., & Wagenaar, A. C. (2010). Effects of alcohol taxes on alcohol-related mortality in Florida: Time-series analyses from 1969 to 2004. Alcoholism Clininical and Experimental Research, 34, 1915–1921. Maldonado Molina, M. M., & Wagenaar, A. C. (2010). Effects of alcohol taxes on alcohol-related mortality in Florida: Time-series analyses from 1969 to 2004. Alcoholism Clininical and Experimental Research, 34, 1915–1921.
go back to reference Molenaar, P. C. M. (2004). A manifesto on psychology as idiographic science: Brining the person back into scientific psychology, this time forever. Measurement, 2, 201–218. Molenaar, P. C. M. (2004). A manifesto on psychology as idiographic science: Brining the person back into scientific psychology, this time forever. Measurement, 2, 201–218.
go back to reference Molenaar, P. C. M., & Nesselroade, J. R. (2009). The recoverability of P-technique factor analysis. Multivariate Behavioral Research, 44, 130–141.CrossRef Molenaar, P. C. M., & Nesselroade, J. R. (2009). The recoverability of P-technique factor analysis. Multivariate Behavioral Research, 44, 130–141.CrossRef
go back to reference Murphy, S. A., Lynch, K. G., Oslin, D., McKay, J. R., & Tenhave, T. (2007) Developing adaptive treatment strategies in substance abuse research. Drug and Alcohol Dependence, 88(Suppl 2), S24–S39. Murphy, S. A., Lynch, K. G., Oslin, D., McKay, J. R., & Tenhave, T. (2007) Developing adaptive treatment strategies in substance abuse research. Drug and Alcohol Dependence, 88(Suppl 2), S24–S39.
go back to reference Pickup, J., & Keen, H. (2002). Continuous subcutaneous insulin infusion at 25 years: Evidence base for the expanding use of insulin pump therapy in type 1 diabetes. Diabetes Care, 25, 593–598.PubMedCrossRef Pickup, J., & Keen, H. (2002). Continuous subcutaneous insulin infusion at 25 years: Evidence base for the expanding use of insulin pump therapy in type 1 diabetes. Diabetes Care, 25, 593–598.PubMedCrossRef
go back to reference Ridenour, T. A., Hall, D. L., & Bost, J. E. (2009). A small sample randomized clinical trial methodology using N-of-1 designs and mixed model analysis. American Journal of Drug and Alcohol Abuse, 35, 260–266.PubMedCrossRef Ridenour, T. A., Hall, D. L., & Bost, J. E. (2009). A small sample randomized clinical trial methodology using N-of-1 designs and mixed model analysis. American Journal of Drug and Alcohol Abuse, 35, 260–266.PubMedCrossRef
go back to reference Russell, R. L., Jones, M. E., & Miller, S. A. (2007). Core process components in psychotherapy: A synthetic review of P-technique studies. Psychotherapy Research, 17, 273–291.CrossRef Russell, R. L., Jones, M. E., & Miller, S. A. (2007). Core process components in psychotherapy: A synthetic review of P-technique studies. Psychotherapy Research, 17, 273–291.CrossRef
go back to reference Sivo, S., Fan, X., & Witta, W. (2005). The biasing effects of unmodeled ARMA time series processes on latent growth curve model estimates. Structural Equation Modeling, 12, 215–231.CrossRef Sivo, S., Fan, X., & Witta, W. (2005). The biasing effects of unmodeled ARMA time series processes on latent growth curve model estimates. Structural Equation Modeling, 12, 215–231.CrossRef
go back to reference Velicer, W. F., & Colby, S. M. (1997). Time series analysis for prevention and treatment research. In K. J. Bryant, M. Windle, & S. G. West (Eds.), The science of prevention: Methodological advances from alcohol and substance abuse research (pp. 211–249). Washington, DC.: American Psychological Association. Velicer, W. F., & Colby, S. M. (1997). Time series analysis for prevention and treatment research. In K. J. Bryant, M. Windle, & S. G. West (Eds.), The science of prevention: Methodological advances from alcohol and substance abuse research (pp. 211–249). Washington, DC.: American Psychological Association.
Metadata
Title
Toward Rigorous Idiographic Research in Prevention Science: Comparison Between Three Analytic Strategies for Testing Preventive Intervention in Very Small Samples
Authors
Ty A. Ridenour
Thomas Z. Pineo
Mildred M. Maldonado Molina
Kristen Hassmiller Lich
Publication date
01-06-2013
Publisher
Springer US
Published in
Prevention Science / Issue 3/2013
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-012-0311-4

Other articles of this Issue 3/2013

Prevention Science 3/2013 Go to the issue