Summary
The increasing number of economic evaluations of healthcare interventions, and of drug therapies in particular, has been well documented. However, surveys have demonstrated that standards of conduct of such studies have not similarly increased. Of particular concern is the lack of development or even consideration of statistical techniques in the reporting of studies. This article addresses issues that must be considered both in the conduct and in the assessment of the quality of studies. Throughout the paper, examples of pharmacoeconomic analyses are used to illustrate the points made.
Recommendations for the conduct of future pharmacoeconomic studies are given. Such recommendations specifically relate to the level of testing that is conducted, the choice of statistical tests and the manner in which statistical significance is reported. In addition, existing methods for the statistical analysis of cost-effectiveness ratios and for the determination of sample size in economic evaluations are discussed, and a partial solution to this issue is offered.
Similar content being viewed by others
References
Backhouse ME, Backhouse RJ, Edey SA. Economic evaluation bibliography. Health Econ 1993; 1 Suppl.
Elixhauser A, Luce BR, Taylor WR, et al. Health care CBA/ CEA: an update on the growth and composition of the literature. Med Care 1993; 31 (7 Suppl.): JS1–JS11
Coyle D, Drummond M. Does expenditure on pharmaceuticals give good value for money? Current evidence and policy implications. Health Policy 1993; 26: 55–75
Commonwealth of Australia. Guidelines for the pharmaceutical industry on preparation of submissions to the Pharmaceutical Benefits Advisory Committee [including submissions involving economic analyses]. Canberra: Department of Health, Housing and Community Services, 1992
Ontario Ministry of Health. Ontario Guidelines for economic analyses of pharmaceutical products. Toronto: Ministry of Health, 1994
Drummond MF. Guidelines for pharmacoeconomic studies: the way forward. PharmacoEconomics 1994; 6: 493–497
McGhan WF, Lewis NJW. Guidelines for pharmacoeconomic studies. Clin Ther 1992; 14: 486–494
Adams ME, McCall NT, Gray DT, et al. Economic analysis in randomized control trials. Med Care 1992; 30: 231–243
Udvarhelyi IS, Colditz GA, Rae AB, et al. Cost-effectiveness and cost-benefit analyses in the medical literature: are the methods being used correctly? Ann Intern Med 1992; 116: 238–244
O’Brien BJ, Drummond MF, Labelle RJ, et al. In search of power and significance: issues in the design and analysis of stochastic cost-effectiveness studies in health care. Med Care 1994; 32: 150–163
Briggs AH, Sculpher MJ, Buxton MJ. Uncertainty in the economic evaluation of health care technologies: the role of sensitivity analysis. Health Econ 1993; 3: 95–104
Keeler E. Decision trees and Markov models in cost-effectiveness research. In: Sloan FA, editor. Valuing health care: cost, benefits and effectiveness of pharmaceuticals and other medical technologies. Cambridge: Cambridge University Press, 1995: 185–205
Steinberg EP, Topol EJ, Sakin JW, et al. Cost and procedure implications of thrombolytic therapy for acute myocardial infarction. J Am Coll Cardiol 1988; 12: 58A–68A
Tsevat J, Durand-Zaleski I, Paucker SG. Cost-effectiveness of antibiotic prophylaxis for dental procedures in patients with artificial joints. Am J Public Health 1989; 79: 739–743
Castellano AR, Nettleman MD. Cost and benefit of secondary prophylaxis for Pneumocystis carinii pneumonia. JAMA 1991; 266: 820–824
Doubilet P, Begg CB, Weinstein MC, et al. Probabilistic sensitivity analysis using Monte Carlo simulation. Med Decis Making 1985; 5: 157–177
Gabriel SE, Campion ME, O’Fallon WM. Acost-utility analysis of misoprostol prophylaxis for rheumatoid arthritis patients receiving nonsteroidal antiinflammatory drugs. Arthritis Rheum 1994; 37 (3): 333–341
Chalfin DB, Holbein ME, Fein AM, et al. Cost-effectiveness of monoclonal antibodies to gram-negative endotoxin in the treatment of gram-negative sepsis in ICU patients. JAMA 1993; 269 (2): 249–255
Schneider T, Fagnani F, Lanoe JL, et al. Economic analysis of an immunosuppressive strategy in renal transplantation. Health Policy 1988; 9: 75–89
Jaakkimainen L, Goodwin PJ, Pater J, et al. Counting the costs of chemotherapy in a National Cancer Institute of Canada randomized trial in nonsmall-cell lung cancer. J Clin Oncol 1990; 8: 1301–1309
Goodwin PJ, Feld R, Evans WK, et al. Cost-effectiveness of cancer chemotherapy: an economic evaluation of a randomized trial in small-cell lung cancer. J Clin Oncol 1988; 6: 1537–1547
Vermeer F, Simoons ML, de Zwaan C, et al. Cost benefit analysis of early thrombolytic treatment with intracoronary streptokinase: twelve months follow up report of the randomised multicentre trial conducted by the Interuniversity Cardiology Institute of the Netherlands. Br Heart J 1988 May; 59 (5): 527–534
Tubman TRJ, Halliday HL, Normand C. Costs of surfactant replacement treatment for severe neonatal respiratory distress syndrome: a randomised controlled trial. BMJ 1990; 301: 842–845
Fenton FR, Tessier L, Contandriopoulos AP, et al. A comparative trial of home and hospital psychiatric treatment: financial costs. Can J Psychiatry 1982; 27 (3): 177–187
Thompson MS, Read JL, Hutchings C, et al. The cost-effectiveness of auranofin: results of a randomized clinical trial. J Rheumatol 1988; 15: 33–42
van Hout BA, Al MJ, Gordon GS, et al. Costs, effects and C/E ratios alongside a clinical trial. Health Econ 1994; 3: 309–319
O’Brien BJ, Drummond MF. Statistical versus quantitative significance in the socioeconomic evaluation of medicines. Phar-macoEconomics 1994; 5 (5): 389–398
Scitovsky AA, Cline MW, Abrams DI. Effects of the use of AZT on the medical care costs of persons with AIDS in the first 12 months. J Acquir Immune Defic Syndr 1990; 3: 904–912
Drummond MF, Menzin J, Oster G. Methodological issues in economic assessments of new therapies: the case of colony-stimulating factors. PharmacoEconomics 1994; 6 Suppl. 2: 18–26
Rutten-van Molken MPMH, van Doorslaer EKA, van Vliet RCJA. Statistical analysis of cost outcomes in a randomized controlled clinical trial. Health Econ 1994; 3: 333–345
Chapekis AT, Burek K, Topol EJ. The cost:benefit ratio of acute intervention for acute myocardial infarction: results of a prospective, matched pair analysis. Am Heart J 1989; 118: 878–882
Johannesson M. The impact of age on the cost-effectiveness of hypertension treatment - an analysis of randomised drug trials. Med Decis Making 1994; 14 (3): 236–244
Gardner MJ, Altman DG. Statistics with confidence — confidence intervals and statistical guidelines. London: British Medical Journal, 1989
Laupacis A, Feeny D, Detsky AS, et al. How attractive does a new technology have to be to warrant adoption and utilization? Tentative guidelines for using clinical and economic evaluations. Can Med Assoc J 1992; 146 (4): 473–481
Detsky AS. Guidelines for economic analysis of pharmaceutical products: a draft document for Ontario and Canada. PharmacoEconomics 1993; 3: 354–361
O’Brien B, Willan A. Cost-effectiveness ratios in clinical trials: from deterministic to stochastic models [abstract]. Proceedings of the American Statistical Association. Toronto: American Statistical Association, 1994: 127
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Coyle, D. Statistical Analysis in Pharmacoeconomic Studies. Pharmacoeconomics 9, 506–516 (1996). https://doi.org/10.2165/00019053-199609060-00005
Published:
Issue Date:
DOI: https://doi.org/10.2165/00019053-199609060-00005