Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

01-03-2012 | Original Paper

The Peabody Treatment Progress Battery: History and Methods for Developing a Comprehensive Measurement Battery for Youth Mental Health

Authors: Manuel Riemer, M. Michele Athay, Leonard Bickman, Carolyn Breda, Susan Douglas Kelley, Ana R. Vides de Andrade

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 1-2/2012

Abstract

There is increased need for comprehensive, flexible, and evidence-based approaches to measuring the process and outcomes of youth mental health treatment. This paper introduces a special issue dedicated to the Peabody Treatment Progress Battery (PTPB), a battery of measures created to meet this need. The PTPB is an integrated set of brief, reliable, and valid instruments that can be administered efficiently at low cost and can provide systematic feedback for use in treatment planning. It includes eleven measures completed by youth, caregivers, and/or clinicians that assess clinically-relevant constructs such as symptom severity, therapeutic alliance, life satisfaction, motivation for treatment, hope, treatment expectations, caregiver strain, and service satisfaction. This introductory article describes the rationale for the PTPB and its development and evaluation, detailing the specific analytic approaches utilized by the different papers in the special issue and a description of the study and samples from which the participants were taken.

Achenbach, T. M. (1991). Integrative guide for the 1991 CBCL/4-18, YSR, and TRF profiles. Burlington: University of Vermont, Department of Psychiatry.

Athay, M.M., (2012). The Satisfaction with Life Scale (SWLS) in caregivers of clinically-referred youth: Psychometric properties and mediation analysis. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-011-0390-8.

Athay, M. M., & Bickman, L. (2012). Development and psychometric evaluation of the youth and caregiver Service Satisfaction Scale. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0407-y.

Athay, M.M., Kelley, S.D., & Dew-Reeves, S.E. (2012). Brief multidimensional students’ life satisfaction scale–PTPB Version (BMSLSS-PTPB): Psychometric properties and relationship with mental health symptoms over time. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-011-0385-5.

Athay, M.M., Riemer, M., & Bickman, L. (2012). The symptoms and functioning severity scale (SFSS): Psychometric evaluation and discrepancies among youth, caregiver, and clinician ratings over time. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0403-2.

Bentler, P. M. (1990). Comparative fix indexes in structural models. Psychological Bulletin, 107(2), 238–246.PubMedCrossRef

Bickman, L., Karver, M., & Schut, L. J. A. (1997). Clinician reliability and accuracy in judging appropriate level of care. Journal of Consulting and Clinical Psychology, 65(3), 515–520.PubMedCrossRef

Bickman, L., Nurcombe, B., Townsend, C., Belle, M., Schut, J., & Karver, M. (1998). Consumer measurement systems for child and adolescent mental health. Canberra, ACT: Department of Health and Family Services. http://www.health.gov.au/hsdd/mentalhe.

Bickman, L., de Vides Andrade, A. R., Lambert, E. W., Doucette, A., Sapyta, J., Boyd, A. S., et al. (2004). Youth therapeutic alliance in intensive treatment settings. Journal of Behavioral Health Services and Research, 31(2), 134–148.PubMed

Bickman, L., Riemer, M., Breda, C., & Kelley, S. D. (2006). CFIT: A system to provide a continuous quality improvement infrastructure through organizational responsiveness, measurement, training, and feedback. Report on Emotional and Behavioral Disorders in Youth, 6(86–87), 93–94.

Bickman, L., Riemer, M., Lambert, E.W., Kelley, S.D., Breda, C., Dew, S.E., Brannan, A.M., Vides de Andrade, A.R. (eds.). (2007). Manual of the peabody treatment progress battery [Electronic version]. Nashville: Vanderbilt University. http://peabody.vanderbilt.edu/ptpb\.

Bickman, L., Athay, M.M., Riemer, M., Lambert, E.W., Kelley, S.D., Breda, C., Tempesti, T., Dew-Reeves, S.E., Brannan, A.M., Vides de Andrade, A.R. (eds). (2010). Manual of the peabody treatment progress battery, 2nd ed. [Electronic version]. Nashville: Vanderbilt University. http://peabody.vanderbilt.edu/ptpb\.

Bickman, L., Kelley, S., Breda, C., De Andrade, A., & Riemer, M. (2011). Effects of routine feedback to clinicians on youth mental health outcomes: A randomized cluster design. Psychiatric Services, 62(12), 1423–1429.PubMedCrossRef

Bickman, L., Vides de Andrade, A. R., Athay, M. M., Chen, J. I., De Nadai, A. S., Jordan-Arthur, B., & Karver, M. S. (2012). The relationship between change in therapeutic alliance ratings and improvement in youth symptom severity: Whose ratings matter the most? Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-011-0398-0.

Bond, T. G., & Fox, C. M. (2001). Applying the Rasch model: Fundamental measurement in the human sciences. Mahwah: L. Erlbaum.

Brannan, A. M., Heflinger, C. A., & Bickman, L. (1997). The caregiver strain questionnaire: Measuring the impact on the family of living with a child with serious emotional disturbance. Journal of Emotional and Behavioral Disorders, 5(4), 212–222.CrossRef

Brannan, A. M., Athay, M. M., & Vides de Andrade, A. R. (2012). Measurement quality of the Caregiver Strain Questionnaire–Short Form 7 (CGSQ-SF7). Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0412-1.

Breda, C. S., & Riemer, M. (2012). Motivation for youth’s treatment scale (MYTS): A new tool for measuring motivation among youths and their caregivers. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0408-x.

Brown, W. (1910). Some experimental results in the correlation of mental abilities. British Journal of Psychology, 3, 296–322.

Browne, M. W., & Cudeck, R. (1993). Alternative ways of accessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Newbury Park: Sage.

Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105.PubMedCrossRef

Cronbach, L. J., & Shavelson, R. J. (2004). My current thoughts on coefficient alpha and successor procedures. Educational and Psychological Measurement, 64(3), 391–418.CrossRef

Dew-Reeves, S. E., & Athay, M. M. (2012). Validation and use of the youth and caregiver Treatment Outcome Expectations Scale (TOES) to assess the relationships between expectations, pretreatment characteristics, and outcomes. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0406-z.

Dew-Reeves, S. E., Athay, M. M., & Kelley, S. D. (2012). Validation and use of the Children’s Hope Scale-Revised PTPB Edition (CHS-PTPB): High initial youth hope and elevated baseline symptomatology predict poor treatment outcomes. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0411-2.

Goodman, R. (1999). The extended version of the strengths and difficulties questionnaire as a guide to child psychiatric caseness and consequent burden. The Journal of Child Psychology and Psychiatry and Allied Disciplines, 40(5), 791–799.CrossRef

Harlow, L. L. (2005). The essence of multivariate thinking. Mahwah: Lawrence Erlbaum Associates, Inc.

Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55.CrossRef

Joreskog, K. G. (1988). Analysis of covariance structures. In J. R. Nesselroade & R. B. Cattell (Eds.), Handbook of multivariate experimental psychology (2nd ed., pp. 207–230). New York: Plenum Press.CrossRef

Karver, M. S., & Bickman, L. (2002). Positive functioning: Does it add validity to maladaptive functioning items? Evaluation and Program Planning, 25(1), 85–93.CrossRef

Karver, M. S., Handelsman, J. B., Fields, S., & Bickman, L. (2005). A theoretical model of common process factors in youth and family therapy. Mental Health Services Research, 7(1), 35–51.PubMedCrossRef

Kearns, M. A., Athay, M. M., & Riemer, M. (2012). Measuring youths’ perceptions of counseling impact: Description, psychometric evaluation, and longitudinal examination of the Youth Counseling Impact Scale v.2. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0414-z.

Kelley, S. D., de Vides Andrade, A. R., Sheffer, E., & Bickman, L. (2010). Exploring the black box: Measuring youth treatment process and progress in usual care. Administration and Policy in Mental Health and Mental Health Services Research, 37(3), 287–300. doi:10.1007/s10488-010-0298-8.PubMedCrossRef

Kelley, S. D., Vides de Andrade, A. R., Bickman, L., & Robin, A. (2012). The Session Report Form (SRF): Are clinicians addressing issues of concern to youth and caregivers? Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0415-y.

Knitzer, J. (1984). Mental health services to children and adolescents: A national view of public policies. American Psychologist, 39, 905–911.PubMedCrossRef

Lambert, M. J. (2005). Special section on the placebo concept in psychotherapy. Early response in psychotherapy: Further evidence for the importance of common factors rather than “placebo effects”. Journal of Clinical Psychology, 61(7), 855–869.PubMedCrossRef

Linacre, J. M. (2007). WINSTEPS^® 3.63.0.[Computer software]. Retrieved Jan 8, 2007, from http://www.winsteps.com/index.htm.

Linacre, J. M., & Wright, B. D. (2006). WINSTEPS Rasch-model computer program (Version 3.47) [computer software]. Chicago: MESA Press.

Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.

Pavot, W., & Diener, E. (1993). Review of the satisfaction with life scale. Psychological Assessment, 5(2), 164–172.CrossRef

Riemer, M., & Kearns, M. A. (2010). Description and psychometric evaluation of the youth counseling impact scale. Psychological Assessment, 22(10), 259–268.PubMedCrossRef

Schmitt, J. S., & Di Fabio, R. P. (2004). Reliable change and minimum important difference (MID) proportions facilitated group responsiveness comparisons using individual threshold criteria. Journal of Clinical Epidemiology, 57, 1008–1018.PubMedCrossRef

Seligson, J., Huebner, E. S., & Valois, R. F. (2003). Preliminary validation of the brief multidimensional students’ life satisfaction scale (BMSLSS). Social Indicators Research, 61, 121–145.CrossRef

Smith, C. M., Breda, C. B., Simmons, T. M., Lambert, E. W., & Bickman, L. (2009). Data preparation and data standards: The devil is in the details. In A. R. Stiffman (Ed.), The field research survival guide (pp. 82–103). New York: Oxford University.CrossRef

Snyder, C. R., Hoza, B., Pelham, W. E., Rapoff, M., Ware, L., Danovsky, M., et al. (1997). The development and validation of the Children’s Hope Scale. Journal of Pediatric Psychology, 22(3), 399–421.PubMedCrossRef

Spearman, C. (1910). Correlation calculated from faulty data. British Journal of Psychology, 3, 171–195.

Steiger, J. H. (2000). Point estimation, hypothesis testing, and interval estimation using the RMSEA: Some comments and a reply to Hayduck and Glaser. Structural Equation Modeling A Multidisciplinary Journal, 72(2), 149–162.CrossRef

Wells, M. G., Burlingame, G. M., & Lambert, M. J. (1999). Youth outcome questionnaire. In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcome assessment (2nd ed.). Mahwah: Lawrence Erlbaum.

Wright, B.D., & Linacre, J.M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8, 370. Retrieved March 10, 2011 from www.rasch.org/rmt/rmt83b.htm.

Yu, C.-Y. (2002). Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes (Doctoral dissertation, University of California, Los Angeles, 2002). (UMI ProQuest ATT 3066425).

Title: The Peabody Treatment Progress Battery: History and Methods for Developing a Comprehensive Measurement Battery for Youth Mental Health
Authors: Manuel Riemer
M. Michele Athay
Leonard Bickman
Carolyn Breda
Susan Douglas Kelley
Ana R. Vides de Andrade
Publication date: 01-03-2012
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 1-2/2012
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-012-0404-1

Keynote webinar | Spotlight on medication adherence

Springer Medicine

The Peabody Treatment Progress Battery: History and Methods for Developing a Comprehensive Measurement Battery for Youth Mental Health

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 1-2/2012

Development and Psychometric Evaluation of the Youth and Caregiver Service Satisfaction Scale

Validation and use of the Children’s Hope Scale-Revised PTPB Edition (CHS-PTPB): High Initial Youth Hope and Elevated Baseline Symptomatology Predict Poor Treatment Outcomes

Measuring Youths’ Perceptions of Counseling Impact: Description, Psychometric Evaluation, and Longitudinal Examination of the Youth Counseling Impact Scale v.2

The Relationship Between Change in Therapeutic Alliance Ratings and Improvement in Youth Symptom Severity: Whose Ratings Matter the Most?

The Session Report Form (SRF): Are Clinicians Addressing Concerns Reported by Youth and Caregivers?

The Symptoms and Functioning Severity Scale (SFSS): Psychometric Evaluation and Discrepancies Among Youth, Caregiver, and Clinician Ratings Over Time