Skip to main content
Top
Published in: Prevention Science 3/2018

01-04-2018 | Commentary

Commentary on “Standards of Evidence for Conducting and Reporting Economic Evaluations in Prevention Science”

Author: Brian T. Yates

Published in: Prevention Science | Issue 3/2018

Login to get access

Abstract

The current paper is a commentary on the Standards of Evidence for Conducting and Reporting Economic Evaluations in Prevention Science (Crowley et al. 2018). Although the standards got a lot right, some important issues were not addressed or could be explored further. Measuring rather than modeling is encouraged whenever possible. That also is in keeping with the approach taken by many prevention researchers. Pre-program planning for collection of data on resources used by individual participants (i.e., costs) is recommended, along with devotion of evaluation resources to cost assessment throughout program implementation. A “cost study” should never be an afterthought tacked on as a later aim in a research proposal. Needing inclusion or enhancement in the standards, however, are several key concepts, starting with the often-confused distinction between costs and outcomes. The importance of collecting data on individual-level variability in resource use, i.e., costs, needs to be distinguished from simplistic disaggregation-by-division of program cost totals down to individuals. In some passages of the standards, the uniqueness of individual participants seems dismissed as error variance rather than considered a primary phenomenon for study and understanding. Standards for formatting reports of economic evaluations could themselves be more evidence-based. Missing too is an explicit call for inclusion of the standards’ recommendations in peer review of prevention research proposals, and in funding of prevention research. Finally, we can be confident that the better outcomes the standards promise will come at additional costs to prevention researchers. This commentary concludes by considering whether the standards themselves are cost-beneficial.
Literature
go back to reference Barber, J. A., & Thompson, S. G. (1998). Analysis and interpretation of cost data in randomised controlled trials: Review of published studies. British Medical Journal, 317, 1195–1200.CrossRefPubMedPubMedCentral Barber, J. A., & Thompson, S. G. (1998). Analysis and interpretation of cost data in randomised controlled trials: Review of published studies. British Medical Journal, 317, 1195–1200.CrossRefPubMedPubMedCentral
go back to reference Carter, D. E., & Newman, F. L. (1976). A client-oriented system of mental health service delivery and program management: A workbook and guide. Washington, DC: DHEW Publication No. (ADM) 76–307, Superintendent of Documents, US Government Printing Office. Carter, D. E., & Newman, F. L. (1976). A client-oriented system of mental health service delivery and program management: A workbook and guide. Washington, DC: DHEW Publication No. (ADM) 76–307, Superintendent of Documents, US Government Printing Office.
go back to reference Drummond, M. F., Sculpher, M. J., Claxton, K., Stoddart, G. L., & Torrance, G. W. (2015). Methods for the economic evaluation of health care programmes (4th ed.). Oxford: Oxford University Press. Drummond, M. F., Sculpher, M. J., Claxton, K., Stoddart, G. L., & Torrance, G. W. (2015). Methods for the economic evaluation of health care programmes (4th ed.). Oxford: Oxford University Press.
go back to reference Herman, P. M., Avery, D. J., Schemp, C. S., & Walsh, M. E. (2009). Are cost-inclusive evaluations worth the effort? Evaluation and Program Planning, 32, 55–61.CrossRefPubMed Herman, P. M., Avery, D. J., Schemp, C. S., & Walsh, M. E. (2009). Are cost-inclusive evaluations worth the effort? Evaluation and Program Planning, 32, 55–61.CrossRefPubMed
go back to reference Levin, H. M. (1983). Cost-effectiveness analysis. Beverly Hills, CA: Sage. Levin, H. M. (1983). Cost-effectiveness analysis. Beverly Hills, CA: Sage.
go back to reference Levin, H. M., McEwan, P. J., Belfield, C. R., Bowden, A. B., & Shand, R. D. (2017). Economic evaluation in education: Cost-effectiveness and benefit-cost analysis (3rd ed.). Los Angeles: Sage. Levin, H. M., McEwan, P. J., Belfield, C. R., Bowden, A. B., & Shand, R. D. (2017). Economic evaluation in education: Cost-effectiveness and benefit-cost analysis (3rd ed.). Los Angeles: Sage.
go back to reference Mischel, W. (2007). Toward a cognitive social learning reconceptualization of personality. In Y. Shoda, D. Cervone, & G. Downey (Eds.), Persons in context: Building a science of the individual (pp. 278–326). New York: Guilford Press. Mischel, W. (2007). Toward a cognitive social learning reconceptualization of personality. In Y. Shoda, D. Cervone, & G. Downey (Eds.), Persons in context: Building a science of the individual (pp. 278–326). New York: Guilford Press.
go back to reference Neumann, P. J., Sanders, G. D., Russell, L. B., Siegel, J. E., & Ganiats, T. G. (2017). Cost-effectiveness in health and medicine (2nd ed.). New York: Oxford University Press. Neumann, P. J., Sanders, G. D., Russell, L. B., Siegel, J. E., & Ganiats, T. G. (2017). Cost-effectiveness in health and medicine (2nd ed.). New York: Oxford University Press.
go back to reference Scriven, M. (1969). An introduction to meta-evaluation. Educational Products Report, 2, 36–38. Scriven, M. (1969). An introduction to meta-evaluation. Educational Products Report, 2, 36–38.
go back to reference Steuerle, E., & Jackson, L. M. (Eds.). (2016). Advancing the power of economic evidence to inform investments in children, youth, and families. Washington, DC: National Academies of Sciences, Engineering, Medicine. Steuerle, E., & Jackson, L. M. (Eds.). (2016). Advancing the power of economic evidence to inform investments in children, youth, and families. Washington, DC: National Academies of Sciences, Engineering, Medicine.
go back to reference Yates, B. T. (1980). Improving effectiveness and reducing costs in mental health. Springfield: Thomas. Yates, B. T. (1980). Improving effectiveness and reducing costs in mental health. Springfield: Thomas.
go back to reference Yates, B. T. (1994). Toward the incorporation of costs, cost-effectiveness analysis, and cost-benefit analysis into clinical research. Journal of Consulting and Clinical Psychology, 62, 729–736.CrossRefPubMed Yates, B. T. (1994). Toward the incorporation of costs, cost-effectiveness analysis, and cost-benefit analysis into clinical research. Journal of Consulting and Clinical Psychology, 62, 729–736.CrossRefPubMed
go back to reference Yates, B. T. (1996). Analyzing costs, procedures, processes, and outcomes in human services. Thousand Oaks: Sage.CrossRef Yates, B. T. (1996). Analyzing costs, procedures, processes, and outcomes in human services. Thousand Oaks: Sage.CrossRef
go back to reference Yates, B. T. (2010). Evaluating costs and benefits of consumer-operated services: Unexpected resistance, unanticipated insights, and déjà vu all over again. Case 7 in J. A. Morell (Ed.), Evaluation in the face of uncertainty: Anticipating surprise and responding to the inevitable. New York: Guilford Press. Yates, B. T. (2010). Evaluating costs and benefits of consumer-operated services: Unexpected resistance, unanticipated insights, and déjà vu all over again. Case 7 in J. A. Morell (Ed.), Evaluation in the face of uncertainty: Anticipating surprise and responding to the inevitable. New York: Guilford Press.
go back to reference Yates, B. T. (2011). Delivery systems can determine therapy costs, and effectiveness, more than type of therapy. Perspectives on Psychological Science, 6, 498–502.CrossRefPubMed Yates, B. T. (2011). Delivery systems can determine therapy costs, and effectiveness, more than type of therapy. Perspectives on Psychological Science, 6, 498–502.CrossRefPubMed
go back to reference Yates, B. T. (2012). Step arounds for common pitfalls when valuing resources used versus resources produced. In G. Julnes (Ed.), Promoting valuation in the public interest: Informing policies for judging value in evaluation. New Directions in Program Evaluation, 133, 43–52. Yates, B. T. (2012). Step arounds for common pitfalls when valuing resources used versus resources produced. In G. Julnes (Ed.), Promoting valuation in the public interest: Informing policies for judging value in evaluation. New Directions in Program Evaluation, 133, 43–52.
go back to reference Yates, B. T., & Marra, M. (2017a). Introduction to social return on investment (SROI). Evaluation and Program Planning, 64, 95–97.CrossRefPubMed Yates, B. T., & Marra, M. (2017a). Introduction to social return on investment (SROI). Evaluation and Program Planning, 64, 95–97.CrossRefPubMed
go back to reference Yates, B. T., & Marra, M. (2017b). Social return on investment (SROI): Problems, solutions … and is SROI a good investment? Evaluation and Program Planning, 64, 136–144.CrossRefPubMed Yates, B. T., & Marra, M. (2017b). Social return on investment (SROI): Problems, solutions … and is SROI a good investment? Evaluation and Program Planning, 64, 136–144.CrossRefPubMed
go back to reference Yates, B. T., Mannix, D., Freed, M. C., Campbell, J., Johnsen, M., Jones, K., & Blyler, C. (2011). Consumer-operated service programs: Monetary and donated costs and cost-effectiveness. Psychiatric Rehabilitation Journal, 35(2), 91–99.CrossRefPubMed Yates, B. T., Mannix, D., Freed, M. C., Campbell, J., Johnsen, M., Jones, K., & Blyler, C. (2011). Consumer-operated service programs: Monetary and donated costs and cost-effectiveness. Psychiatric Rehabilitation Journal, 35(2), 91–99.CrossRefPubMed
Metadata
Title
Commentary on “Standards of Evidence for Conducting and Reporting Economic Evaluations in Prevention Science”
Author
Brian T. Yates
Publication date
01-04-2018
Publisher
Springer US
Published in
Prevention Science / Issue 3/2018
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-018-0885-6

Other articles of this Issue 3/2018

Prevention Science 3/2018 Go to the issue