Skip to main content
Top
Published in: BMC Complementary Medicine and Therapies 1/2009

Open Access 01-12-2009 | Research article

Evidence-based effect size estimation:An illustration using the case of acupuncture for cancer-related fatigue

Authors: Michael F Johnston, Ron D Hays, Ka-Kit Hui

Published in: BMC Complementary Medicine and Therapies | Issue 1/2009

Login to get access

Abstract

Background

Estimating a realistic effect size is an important issue in the planning of clinical studies of complementary and alternative medicine therapies. When a minimally important difference is not available, researchers may estimate effect size using the published literature. This evidence-based effect size estimation may be used to produce a range of empirically-informed effect size and consequent sample size estimates. We provide an illustration of deriving plausible effect size ranges for a study of acupuncture in the relief of post-chemotherapy fatigue in breast cancer patients.

Methods

A PubMed search identified three uncontrolled studies reporting the effect of acupuncture in relieving fatigue. A separate search identified five randomized controlled trials (RCTs) with a wait-list control of breast cancer patients receiving standard care that reported data on fatigue. We use these published data to produce best, average, and worst-case effect size estimates and related sample size estimates for a trial of acupuncture in the relief of cancer-related fatigue relative to a wait-list control receiving standard care.

Results

Use of evidence-based effect size estimation to calculate sample size requirements for a study of acupuncture in relieving fatigue in breast cancer survivors relative to a wait-list control receiving standard care suggests that an adequately-powered phase III randomized controlled trial comprised of two arms would require at least 101 subjects (52 per arm) if a strong effect is assumed for acupuncture and 235 (118 per arm) if a moderate effect is assumed.

Conclusion

Evidence-based effect size estimation helps justify assumptions in light of empirical evidence and can lead to more realistic sample size calculations, an outcome that would be of great benefit for the field of complementary and alternative medicine.
Appendix
Available only for authorised users
Literature
1.
go back to reference Buchanan DR, White JD, O'Mara AM, Kelaghan JW, Smith WB, Minasian LM: Research-design issues in cancer-symptom-management trials using complementary and alternative medicine: lessons from the National Cancer Institute Community Clinical Oncology Program experience. J Clin Oncol. 2005, 23 (27): 6682-9. 10.1200/JCO.2005.10.728.CrossRefPubMed Buchanan DR, White JD, O'Mara AM, Kelaghan JW, Smith WB, Minasian LM: Research-design issues in cancer-symptom-management trials using complementary and alternative medicine: lessons from the National Cancer Institute Community Clinical Oncology Program experience. J Clin Oncol. 2005, 23 (27): 6682-9. 10.1200/JCO.2005.10.728.CrossRefPubMed
2.
go back to reference Ernst E: Acupuncture–a critical analysis. J Intern Med. 2006, 259 (2): 125-37. 10.1111/j.1365-2796.2005.01584.x.CrossRefPubMed Ernst E: Acupuncture–a critical analysis. J Intern Med. 2006, 259 (2): 125-37. 10.1111/j.1365-2796.2005.01584.x.CrossRefPubMed
3.
go back to reference Scales DC, Rubenfeld GD: Estimating sample size in critical care clinical trials. J Crit Care. 2005, 20 (1): 6-11. 10.1016/j.jcrc.2005.02.002. ReviewCrossRefPubMed Scales DC, Rubenfeld GD: Estimating sample size in critical care clinical trials. J Crit Care. 2005, 20 (1): 6-11. 10.1016/j.jcrc.2005.02.002. ReviewCrossRefPubMed
4.
go back to reference Weinfurt K: Repeated Measures Analyses: ANOVA, MANOVA, and HLM. Reading and Understanding More Multivariate Statistics. Edited by: Laurence Grimm, Paul Yarnold. 2000, American Psychological Association: Washington DC, 317-361. Weinfurt K: Repeated Measures Analyses: ANOVA, MANOVA, and HLM. Reading and Understanding More Multivariate Statistics. Edited by: Laurence Grimm, Paul Yarnold. 2000, American Psychological Association: Washington DC, 317-361.
5.
go back to reference Vickers AJ: Statistical reanalysis of four recent randomized trials of acupuncture for pain using analysis of covariance. Clin J Pain. 2004, 20 (5): 319-23. 10.1097/00002508-200409000-00006.CrossRefPubMed Vickers AJ: Statistical reanalysis of four recent randomized trials of acupuncture for pain using analysis of covariance. Clin J Pain. 2004, 20 (5): 319-23. 10.1097/00002508-200409000-00006.CrossRefPubMed
6.
go back to reference Vickers AJ, Straus DJ, Fearon B, Cassileth BR: Acupuncture for postchemotherapy fatigue: a phase II study. J Clin Oncol. 2004, 22 (9): 1731-5. 10.1200/JCO.2004.04.102.CrossRefPubMed Vickers AJ, Straus DJ, Fearon B, Cassileth BR: Acupuncture for postchemotherapy fatigue: a phase II study. J Clin Oncol. 2004, 22 (9): 1731-5. 10.1200/JCO.2004.04.102.CrossRefPubMed
7.
go back to reference Harris RE, Tian X, Williams DA, Tian TX, Cupps TR, Petzke F, Groner KH, Biswas P, Gracely RH, Clauw DJ: Treatment of fibromyalgia with formula acupuncture: investigation of needle placement, needle stimulation, and treatment frequency. J Altern Complement Med. 2005, 11 (4): 663-71. 10.1089/acm.2005.11.663.CrossRefPubMed Harris RE, Tian X, Williams DA, Tian TX, Cupps TR, Petzke F, Groner KH, Biswas P, Gracely RH, Clauw DJ: Treatment of fibromyalgia with formula acupuncture: investigation of needle placement, needle stimulation, and treatment frequency. J Altern Complement Med. 2005, 11 (4): 663-71. 10.1089/acm.2005.11.663.CrossRefPubMed
8.
go back to reference Hays RD, Brodsky M, Johnston MF, Spritzer KL, Hui KK: Evaluating the statistical significance of health-related quality-of-life change in individual patients. Eval Health Prof. 2005, 28 (2): 160-71. 10.1177/0163278705275339.CrossRefPubMed Hays RD, Brodsky M, Johnston MF, Spritzer KL, Hui KK: Evaluating the statistical significance of health-related quality-of-life change in individual patients. Eval Health Prof. 2005, 28 (2): 160-71. 10.1177/0163278705275339.CrossRefPubMed
9.
go back to reference Faul F, Erdfelder E, Lang A-G, Buchner A: G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods. 2007, 39 (2): 175-91.CrossRefPubMed Faul F, Erdfelder E, Lang A-G, Buchner A: G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods. 2007, 39 (2): 175-91.CrossRefPubMed
11.
go back to reference Price S, Lewith G, Thomas K: Acupuncture care for breast cancer patients during chemotherapy: a feasibility study. Integr Cancer Ther. 2006, 5 (4): 308-14. 10.1177/1534735406294899.CrossRefPubMed Price S, Lewith G, Thomas K: Acupuncture care for breast cancer patients during chemotherapy: a feasibility study. Integr Cancer Ther. 2006, 5 (4): 308-14. 10.1177/1534735406294899.CrossRefPubMed
12.
go back to reference Birch S: A review and analysis of placebo treatments, placebo effects, and placebo controls in trials of medical procedures when sham is not inert. J Altern Complement Med. 2006, 12 (3): 303-10. 10.1089/acm.2006.12.303.CrossRefPubMed Birch S: A review and analysis of placebo treatments, placebo effects, and placebo controls in trials of medical procedures when sham is not inert. J Altern Complement Med. 2006, 12 (3): 303-10. 10.1089/acm.2006.12.303.CrossRefPubMed
13.
go back to reference Walach H, Jonas WB: Placebo research: the evidence base for harnessing self-healing capacities. J Altern Complement Med. 2004, 10 (Suppl 1): S103-12. 10.1089/1075553042245773.CrossRefPubMed Walach H, Jonas WB: Placebo research: the evidence base for harnessing self-healing capacities. J Altern Complement Med. 2004, 10 (Suppl 1): S103-12. 10.1089/1075553042245773.CrossRefPubMed
14.
go back to reference Badger T, Segrin C, Meek P, Lopez AM, Bonham E, Sieger A: Telephone interpersonal counseling with women with breast cancer: symptom management and quality of life. Oncol Nurs Forum. 2005, 32 (2): 273-9. 10.1188/05.ONF.273-279.CrossRefPubMed Badger T, Segrin C, Meek P, Lopez AM, Bonham E, Sieger A: Telephone interpersonal counseling with women with breast cancer: symptom management and quality of life. Oncol Nurs Forum. 2005, 32 (2): 273-9. 10.1188/05.ONF.273-279.CrossRefPubMed
15.
go back to reference Carpenter JS, Storniolo AM, Johns S, Monahan PO, Azzouz F, Elam JL, Johnson CS, Shelton RC: Randomized, double-blind, placebo-controlled crossover trials of venlafaxine for hot flashes after breast cancer. Oncologist. 2007, 12 (1): 124-35. 10.1634/theoncologist.12-1-124.CrossRefPubMed Carpenter JS, Storniolo AM, Johns S, Monahan PO, Azzouz F, Elam JL, Johnson CS, Shelton RC: Randomized, double-blind, placebo-controlled crossover trials of venlafaxine for hot flashes after breast cancer. Oncologist. 2007, 12 (1): 124-35. 10.1634/theoncologist.12-1-124.CrossRefPubMed
16.
go back to reference Courneya KS, Mackey JR, Bell GJ, Jones LW, Field CJ, Fairey AS: Randomized controlled trial of exercise training in postmenopausal breast cancer survivors: cardiopulmonary and quality of life outcomes. J Clin Oncol. 2003, 21 (9): 1660-8. 10.1200/JCO.2003.04.093.CrossRefPubMed Courneya KS, Mackey JR, Bell GJ, Jones LW, Field CJ, Fairey AS: Randomized controlled trial of exercise training in postmenopausal breast cancer survivors: cardiopulmonary and quality of life outcomes. J Clin Oncol. 2003, 21 (9): 1660-8. 10.1200/JCO.2003.04.093.CrossRefPubMed
17.
go back to reference Pinto BM, Frierson GM, Rabin C, Trunzo JJ, Marcus BH: Home-based physical activity intervention for breast cancer patients. J Clin Oncol. 2005, 23 (15): 3577-87. 10.1200/JCO.2005.03.080.CrossRefPubMed Pinto BM, Frierson GM, Rabin C, Trunzo JJ, Marcus BH: Home-based physical activity intervention for breast cancer patients. J Clin Oncol. 2005, 23 (15): 3577-87. 10.1200/JCO.2005.03.080.CrossRefPubMed
18.
go back to reference Stanton AL, Ganz PA, Kwan L, Meyerowitz BE, Bower JE, Krupnick JL, Rowland JH, Leedham B, Belin TR: Outcomes from the Moving Beyond Cancer psychoeducational, randomized, controlled trial with breast cancer patients. J Clin Oncol. 2005, 23 (25): 6009-18. 10.1200/JCO.2005.09.101.CrossRefPubMed Stanton AL, Ganz PA, Kwan L, Meyerowitz BE, Bower JE, Krupnick JL, Rowland JH, Leedham B, Belin TR: Outcomes from the Moving Beyond Cancer psychoeducational, randomized, controlled trial with breast cancer patients. J Clin Oncol. 2005, 23 (25): 6009-18. 10.1200/JCO.2005.09.101.CrossRefPubMed
19.
go back to reference Curt GA, Breitbart W, Cella D, Groopman JE, Horning SJ, Itri LM, Johnson DH, Miaskowski C, Scherr SL, Portenoy RK, Vogelzang NJ: Impact of cancer-related fatigue on the lives of patients: new findings from the Fatigue Coalition. Oncologist. 2000, 5 (5): 353-60. 10.1634/theoncologist.5-5-353.CrossRefPubMed Curt GA, Breitbart W, Cella D, Groopman JE, Horning SJ, Itri LM, Johnson DH, Miaskowski C, Scherr SL, Portenoy RK, Vogelzang NJ: Impact of cancer-related fatigue on the lives of patients: new findings from the Fatigue Coalition. Oncologist. 2000, 5 (5): 353-60. 10.1634/theoncologist.5-5-353.CrossRefPubMed
20.
go back to reference Lawrence DP, Kupelnick B, Miller K, Devine D, Lau J: Evidence Report on the Occurrence, Assessment, and Treatment of Fatigue in Cancer Patients. Journal of the National Cancer Institute Monographs. 2004, 32: 40-50. 10.1093/jncimonographs/lgh027.CrossRefPubMed Lawrence DP, Kupelnick B, Miller K, Devine D, Lau J: Evidence Report on the Occurrence, Assessment, and Treatment of Fatigue in Cancer Patients. Journal of the National Cancer Institute Monographs. 2004, 32: 40-50. 10.1093/jncimonographs/lgh027.CrossRefPubMed
21.
go back to reference Hox J: Multilevel Analysis Techniques and Applications. 2002, Lawrence Erlbaum Associates, Publishers: London Hox J: Multilevel Analysis Techniques and Applications. 2002, Lawrence Erlbaum Associates, Publishers: London
23.
go back to reference Molassiotis A, Sylt P, Diggins H: The management of cancer-related fatigue after chemotherapy with acupuncture and acupressure: a randomised controlled trial. Complement Ther Med. 2007, 15 (4): 228-37. 10.1016/j.ctim.2006.09.009.CrossRefPubMed Molassiotis A, Sylt P, Diggins H: The management of cancer-related fatigue after chemotherapy with acupuncture and acupressure: a randomised controlled trial. Complement Ther Med. 2007, 15 (4): 228-37. 10.1016/j.ctim.2006.09.009.CrossRefPubMed
24.
go back to reference Langevin HM, Hammerschlag R, Lao L, Napadow V, Schnyer RN, Sherman KJ: Controversies in acupuncture research: selection of controls and outcome measures in acupuncture clinical trials. J Altern Complement Med. 2006, 12 (10): 943-53. 10.1089/acm.2006.12.943.CrossRefPubMed Langevin HM, Hammerschlag R, Lao L, Napadow V, Schnyer RN, Sherman KJ: Controversies in acupuncture research: selection of controls and outcome measures in acupuncture clinical trials. J Altern Complement Med. 2006, 12 (10): 943-53. 10.1089/acm.2006.12.943.CrossRefPubMed
Metadata
Title
Evidence-based effect size estimation:An illustration using the case of acupuncture for cancer-related fatigue
Authors
Michael F Johnston
Ron D Hays
Ka-Kit Hui
Publication date
01-12-2009
Publisher
BioMed Central
Published in
BMC Complementary Medicine and Therapies / Issue 1/2009
Electronic ISSN: 2662-7671
DOI
https://doi.org/10.1186/1472-6882-9-1

Other articles of this Issue 1/2009

BMC Complementary Medicine and Therapies 1/2009 Go to the issue