Skip to main content
Top
Published in: BMC Palliative Care 1/2008

Open Access 01-12-2008 | Research article

How useful are systematic reviews for informing palliative care practice? Survey of 25 Cochrane systematic reviews

Authors: Bee Wee, Gina Hadley, Sheena Derry

Published in: BMC Palliative Care | Issue 1/2008

Login to get access

Abstract

Background

In contemporary medical research, randomised controlled trials are seen as the gold standard for establishing treatment effects where it is ethical and practical to conduct them. In palliative care such trials are often impractical, unethical, or extremely difficult, with multiple methodological problems. We review the utility of Cochrane reviews in informing palliative care practice.

Methods

Published reviews in palliative care registered with the Cochrane Pain, Palliative and Supportive Care Group as of December 2007 were obtained from the Cochrane Database of Systematic Reviews, issue 1, 2008. We reviewed the quality and quantity of primary studies available for each review, assessed the quality of the review process, and judged the strength of the evidence presented. There was no prior intention to perform any statistical analyses.

Results

25 published systematic reviews were identified. Numbers of included trials ranged from none to 54. Within each review, included trials were heterogeneous with respect to patients, interventions, and outcomes, and the number of patients contributing to any single analysis was generally much lower than the total included in the review. A variety of tools were used to assess trial quality; seven reviews did not use this information to exclude low quality studies, weight analyses, or perform sensitivity analysis for effect of low quality. Authors indicated that there were frequently major problems with the primary studies, individually or in aggregate. Our judgment was that the reviewing process was generally good in these reviews, and that conclusions were limited by the number, size, quality and validity of the primary studies.
We judged the evidence about 23 of the 25 interventions to be weak. Two reviews had stronger evidence, but with limitations due to methodological heterogeneity or definition of outcomes. No review provided strong evidence of no effect.

Conclusion

Cochrane reviews in palliative care are well performed, but fail to provide good evidence for clinical practice because the primary studies are few in number, small, clinically heterogeneous, and of poor quality and external validity. They are useful in highlighting the weakness of the evidence base and problems in performing trials in palliative care.
Appendix
Available only for authorised users
Literature
1.
go back to reference Rinck GC, Bos van den GA, Kleijnen J, de Haes HJ, Schade E, Veenhof CH: Methodologic issues in effectiveness research on palliative cancer care: a systematic review. J Clin Oncol. 1997, 15: 1697-1707.PubMed Rinck GC, Bos van den GA, Kleijnen J, de Haes HJ, Schade E, Veenhof CH: Methodologic issues in effectiveness research on palliative cancer care: a systematic review. J Clin Oncol. 1997, 15: 1697-1707.PubMed
2.
3.
go back to reference Mazzocato C, Sweeney C, Bruera E: Clinical research in palliative care: choice of trial design. Palliat Med. 2001, 15: 261-264.CrossRefPubMed Mazzocato C, Sweeney C, Bruera E: Clinical research in palliative care: choice of trial design. Palliat Med. 2001, 15: 261-264.CrossRefPubMed
4.
go back to reference Mularski RA, Rosenfeld K, Joel Coons S, Dueck A, Cella D, Feuer DJ, Lipscomb J, Karpeh MS, Mosich T, Sloan JA, Krouse RS: Measuring Outcomes in Randomized Prospective Trials in Palliative Care. J Pain Symptom Manage. 2007, 34: S7-S19.CrossRefPubMed Mularski RA, Rosenfeld K, Joel Coons S, Dueck A, Cella D, Feuer DJ, Lipscomb J, Karpeh MS, Mosich T, Sloan JA, Krouse RS: Measuring Outcomes in Randomized Prospective Trials in Palliative Care. J Pain Symptom Manage. 2007, 34: S7-S19.CrossRefPubMed
6.
go back to reference Moore RA, McQuay HJ: Bandolier's little book of making sense of medical evidence. 2006, Oxford: Oxford University PressCrossRef Moore RA, McQuay HJ: Bandolier's little book of making sense of medical evidence. 2006, Oxford: Oxford University PressCrossRef
7.
go back to reference Oxman AD, Guyatt GH: Validation of an index of the quality of review articles. J Clin Epidemiol. 1991, 44: 1271-1278.CrossRefPubMed Oxman AD, Guyatt GH: Validation of an index of the quality of review articles. J Clin Epidemiol. 1991, 44: 1271-1278.CrossRefPubMed
8.
go back to reference Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, McQuay HJ: Assessing the quality of reports of randomized clinical trials: is blinding necessary?. Control Clin Trials. 1996, 17: 1-12.CrossRefPubMed Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, McQuay HJ: Assessing the quality of reports of randomized clinical trials: is blinding necessary?. Control Clin Trials. 1996, 17: 1-12.CrossRefPubMed
9.
go back to reference Counsell CE, Clarke MJ, Slattery J, Sandercock PA: The miracle of DICE therapy for acute stroke: fact or fictional product of subgroup analysis?. BMJ. 1994, 309: 1677-1681.CrossRefPubMedPubMedCentral Counsell CE, Clarke MJ, Slattery J, Sandercock PA: The miracle of DICE therapy for acute stroke: fact or fictional product of subgroup analysis?. BMJ. 1994, 309: 1677-1681.CrossRefPubMedPubMedCentral
10.
go back to reference Clarke M, Halsey J: DICE 2: a further investigation of the effects of chance in life, death and subgroup analyses. Int J Clin Pract. 2001, 55: 240-242.PubMed Clarke M, Halsey J: DICE 2: a further investigation of the effects of chance in life, death and subgroup analyses. Int J Clin Pract. 2001, 55: 240-242.PubMed
11.
go back to reference Nicholson AB: Methadone for cancer pain. Cochrane Database Syst Rev. 2004, CD003971-2 Nicholson AB: Methadone for cancer pain. Cochrane Database Syst Rev. 2004, CD003971-2
12.
go back to reference Wiffen PJ, Edwards JE, Barden J, McQuay HJM: Oral morphine for cancer pain. Cochrane Database Syst Rev. 2003, 4: CD003868.PubMed Wiffen PJ, Edwards JE, Barden J, McQuay HJM: Oral morphine for cancer pain. Cochrane Database Syst Rev. 2003, 4: CD003868.PubMed
13.
go back to reference Dewey A, Baughan C, Dean T, Higgins B, Johnson I: Eicosapentaenoic acid (EPA, an omega-3 fatty acid from fish oils) for the treatment of cancer cachexia. Cochrane Database Syst Rev. 2007, 1: CD004597.PubMed Dewey A, Baughan C, Dean T, Higgins B, Johnson I: Eicosapentaenoic acid (EPA, an omega-3 fatty acid from fish oils) for the treatment of cancer cachexia. Cochrane Database Syst Rev. 2007, 1: CD004597.PubMed
14.
go back to reference Miles CL, Fellowes D, Goodman ML, Wilkinson S: Laxatives for the management of constipation in palliative care patients. Cochrane Database Syst Rev. 2006, 4: CD003448.PubMed Miles CL, Fellowes D, Goodman ML, Wilkinson S: Laxatives for the management of constipation in palliative care patients. Cochrane Database Syst Rev. 2006, 4: CD003448.PubMed
15.
go back to reference Dennert G, Horneber M: Selenium for alleviating the side effects of chemotherapy, radiotherapy and surgery in cancer patients. Cochrane Database Syst Rev. 2006, 3: CD005037.PubMed Dennert G, Horneber M: Selenium for alleviating the side effects of chemotherapy, radiotherapy and surgery in cancer patients. Cochrane Database Syst Rev. 2006, 3: CD005037.PubMed
16.
go back to reference Martinez-Zapata MJ, Roqué M, Alonso-Coello P, Català E: Calcitonin for metastatic bone pain. Cochrane Database Syst Rev. 2006, 3: CD003223.PubMed Martinez-Zapata MJ, Roqué M, Alonso-Coello P, Català E: Calcitonin for metastatic bone pain. Cochrane Database Syst Rev. 2006, 3: CD003223.PubMed
17.
go back to reference Tsao MN, Lloyd N, Wong R, Chow E, Rakovitch E, Laperriere N: Whole brain radiotherapy for the treatment of multiple brain metastases. Cochrane Database Syst Rev. 2006, 3: CD003869.PubMed Tsao MN, Lloyd N, Wong R, Chow E, Rakovitch E, Laperriere N: Whole brain radiotherapy for the treatment of multiple brain metastases. Cochrane Database Syst Rev. 2006, 3: CD003869.PubMed
18.
go back to reference Ezzo JM, Richardson MA, Vickers A, Allen C, Dibble SL, Issell BF, Lao L, Pearl M, Ramirez G, Roscoe JA, Shen J, Shivnan JC, Streitberger K, Treish I, Zhang G: Acupuncture-point stimulation for chemotherapy-induced nausea or vomiting. Cochrane Database Syst Rev. 2006, 2: CD002285.PubMed Ezzo JM, Richardson MA, Vickers A, Allen C, Dibble SL, Issell BF, Lao L, Pearl M, Ramirez G, Roscoe JA, Shen J, Shivnan JC, Streitberger K, Treish I, Zhang G: Acupuncture-point stimulation for chemotherapy-induced nausea or vomiting. Cochrane Database Syst Rev. 2006, 2: CD002285.PubMed
19.
go back to reference Zeppetella G, Ribeiro MDC: Opioids for the management of breakthrough (episodic) pain in cancer patients. Cochrane Database Syst Rev. 2006, 1: CD004311.PubMed Zeppetella G, Ribeiro MDC: Opioids for the management of breakthrough (episodic) pain in cancer patients. Cochrane Database Syst Rev. 2006, 1: CD004311.PubMed
20.
go back to reference Berenstein EG, Ortiz Z: Megestrol acetate for the treatment of anorexia-cachexia syndrome. Cochrane Database Syst Rev. 2005, 2: CD004310.PubMed Berenstein EG, Ortiz Z: Megestrol acetate for the treatment of anorexia-cachexia syndrome. Cochrane Database Syst Rev. 2005, 2: CD004310.PubMed
21.
go back to reference Ahmed N, Ahmedzai SH, Vora V, Hillam S, Paz S: Supportive care for patients with gastrointestinal cancer. Cochrane Database Syst Rev. 2004, 3: CD003445.PubMed Ahmed N, Ahmedzai SH, Vora V, Hillam S, Paz S: Supportive care for patients with gastrointestinal cancer. Cochrane Database Syst Rev. 2004, 3: CD003445.PubMed
22.
go back to reference Ballantyne JC, Carwood CM: Comparative efficacy of epidural, subarachnoid, and intracerebroventricular opioids in patients with pain due to cancer. Cochrane Database Syst Rev. 2005, CD005178-1 Ballantyne JC, Carwood CM: Comparative efficacy of epidural, subarachnoid, and intracerebroventricular opioids in patients with pain due to cancer. Cochrane Database Syst Rev. 2005, CD005178-1
23.
go back to reference McNicol E, Strassels SA, Goudas L, Lau J, Carr DB: NSAIDS or paracetamol, alone or combined with opioids, for cancer pain. Cochrane Database Syst Rev. 2005, 2: CD005180. McNicol E, Strassels SA, Goudas L, Lau J, Carr DB: NSAIDS or paracetamol, alone or combined with opioids, for cancer pain. Cochrane Database Syst Rev. 2005, 2: CD005180.
24.
go back to reference Shaw P, Agarwal R: Pleurodesis for malignant pleural effusions. Cochrane Database Syst Rev. 2004, 1: CD002916.PubMed Shaw P, Agarwal R: Pleurodesis for malignant pleural effusions. Cochrane Database Syst Rev. 2004, 1: CD002916.PubMed
25.
go back to reference Fellowes D, Barnes K, Wilkinson S: Aromatherapy and massage for symptom relief in patients with cancer. Cochrane Database Syst Rev. 2004, CD002287-2 Fellowes D, Barnes K, Wilkinson S: Aromatherapy and massage for symptom relief in patients with cancer. Cochrane Database Syst Rev. 2004, CD002287-2
26.
go back to reference Quigley C: Opioid switching to improve pain relief and drug tolerability. Cochrane Database Syst Rev. 2004, 3: CD004847.PubMed Quigley C: Opioid switching to improve pain relief and drug tolerability. Cochrane Database Syst Rev. 2004, 3: CD004847.PubMed
27.
go back to reference Jackson KC, Lipman AG: Drug therapy for delirium in terminally ill patients. Cochrane Database Syst Rev. 2004, 2: CD004770.PubMed Jackson KC, Lipman AG: Drug therapy for delirium in terminally ill patients. Cochrane Database Syst Rev. 2004, 2: CD004770.PubMed
28.
go back to reference Jackson KC, Lipman AG: Drug therapy for anxiety in palliative care. Cochrane Database Syst Rev. 2004, 1: CD004596.PubMed Jackson KC, Lipman AG: Drug therapy for anxiety in palliative care. Cochrane Database Syst Rev. 2004, 1: CD004596.PubMed
29.
go back to reference Roqué M, Martinez-Zapata MJ, Alonso-Coello P, Català E, Garcia JL, Ferrandiz M: Radioisotopes for metastatic bone pain. Cochrane Database Syst Rev. 2003, 4: CD003347.PubMed Roqué M, Martinez-Zapata MJ, Alonso-Coello P, Català E, Garcia JL, Ferrandiz M: Radioisotopes for metastatic bone pain. Cochrane Database Syst Rev. 2003, 4: CD003347.PubMed
30.
go back to reference Bell R, Eccleston C, Kalso E: Ketamine as an adjuvant to opioids for cancer pain. Cochrane Database Syst Rev. 2003, 1: CD003351.PubMed Bell R, Eccleston C, Kalso E: Ketamine as an adjuvant to opioids for cancer pain. Cochrane Database Syst Rev. 2003, 1: CD003351.PubMed
31.
go back to reference Hirst A, Sloan R: Benzodiazepines and related drugs for insomnia in palliative care. Cochrane Database Syst Rev. 2001, CD003346-4 Hirst A, Sloan R: Benzodiazepines and related drugs for insomnia in palliative care. Cochrane Database Syst Rev. 2001, CD003346-4
32.
go back to reference Wong R, Wiffen PJ: Bisphosphonates for the relief of pain secondary to bone metastases. Cochrane Database Syst Rev. 2002, 2: CD002068.PubMed Wong R, Wiffen PJ: Bisphosphonates for the relief of pain secondary to bone metastases. Cochrane Database Syst Rev. 2002, 2: CD002068.PubMed
33.
go back to reference Jennings AL, Davies AN, Higgins JPT, Broadley K: Opioids for the palliation of breathlessness in terminal illness. Cochrane Database Syst Rev. 2001, 3: CD002066. Jennings AL, Davies AN, Higgins JPT, Broadley K: Opioids for the palliation of breathlessness in terminal illness. Cochrane Database Syst Rev. 2001, 3: CD002066.
34.
go back to reference Feuer DJ, Broadley KE: Corticosteroids for the resolution of malignant bowel obstruction in advanced gynaecological and gastrointestinal cancer. Cochrane Database Syst Rev. 2000, CD001219-2 Feuer DJ, Broadley KE: Corticosteroids for the resolution of malignant bowel obstruction in advanced gynaecological and gastrointestinal cancer. Cochrane Database Syst Rev. 2000, CD001219-2
35.
go back to reference McQuay HJ, Collins SL, Carroll D, Moore RA: Radiotherapy for the palliation of painful bone metastases. Cochrane Database Syst Rev. 2000, CD001793-2 McQuay HJ, Collins SL, Carroll D, Moore RA: Radiotherapy for the palliation of painful bone metastases. Cochrane Database Syst Rev. 2000, CD001793-2
36.
go back to reference Smith LA, Oldman AD, McQuay HJ, Moore RA: Teasing apart quality and validity in systematic reviews: an example from acupuncture trials in chronic neck and back pain. Pain. 2000, 86: 119-132.CrossRefPubMed Smith LA, Oldman AD, McQuay HJ, Moore RA: Teasing apart quality and validity in systematic reviews: an example from acupuncture trials in chronic neck and back pain. Pain. 2000, 86: 119-132.CrossRefPubMed
37.
go back to reference Detsky AS, Naylor CD, O'Rourke K, McGeer AJ, L'Abbe KA: Incorporating variations in the quality of individual randomized trials into meta-analysis. J Clin Epidemiol. 1992, 45: 255-265.CrossRefPubMed Detsky AS, Naylor CD, O'Rourke K, McGeer AJ, L'Abbe KA: Incorporating variations in the quality of individual randomized trials into meta-analysis. J Clin Epidemiol. 1992, 45: 255-265.CrossRefPubMed
38.
go back to reference Juni P, Altman DG, Eggert M: Assessing the methodological quality of randomised controlled trials. Systematic Reviews in Health Care. Edited by: Egger M, Smith GD, Altman DG. 2001, London: BMJ Publishing Group, 87-109. 2CrossRef Juni P, Altman DG, Eggert M: Assessing the methodological quality of randomised controlled trials. Systematic Reviews in Health Care. Edited by: Egger M, Smith GD, Altman DG. 2001, London: BMJ Publishing Group, 87-109. 2CrossRef
39.
go back to reference Verhagen AP, de Vet HC, de Bie RA, Kessels AG, Boers M, Bouter LM, Knipschild PG: The Delphi list: a criteria list for quality assessment of randomized clinical trials for conducting systematic reviews developed by Delphi consensus. J Clin Epidemiol. 1998, 51: 1235-1241.CrossRefPubMed Verhagen AP, de Vet HC, de Bie RA, Kessels AG, Boers M, Bouter LM, Knipschild PG: The Delphi list: a criteria list for quality assessment of randomized clinical trials for conducting systematic reviews developed by Delphi consensus. J Clin Epidemiol. 1998, 51: 1235-1241.CrossRefPubMed
40.
go back to reference Mulrow CD, Oxman AD: Libraray of Examples. "Quality scale assessment". The Cochrane Library. Section 6:113. Edited by: Mulrow CD, Oxman AD. 1997, Oxford: Update Software Mulrow CD, Oxman AD: Libraray of Examples. "Quality scale assessment". The Cochrane Library. Section 6:113. Edited by: Mulrow CD, Oxman AD. 1997, Oxford: Update Software
41.
go back to reference Mann T: Clinical Guidelines: using clinical guidelines to improve patient care within the HNS. 1996, Leeds: NHS Executive Mann T: Clinical Guidelines: using clinical guidelines to improve patient care within the HNS. 1996, Leeds: NHS Executive
42.
go back to reference Assessment of study quality. Cochrane handbook for systematic reviews of interventions 4.2.6 [updated September 2006]; Section 6:81. Edited by: Higgins JPT, Green S. 2006, Chichester UK: John Wiley & Sons Ltd Assessment of study quality. Cochrane handbook for systematic reviews of interventions 4.2.6 [updated September 2006]; Section 6:81. Edited by: Higgins JPT, Green S. 2006, Chichester UK: John Wiley & Sons Ltd
43.
go back to reference Carroll D, Tramèr M, McQuay H, Nye B, Moore A: Randomization is important in studies with pain outcomes: systematic review of transcutaneous electrical nerve stimulation in acute postoperative pain. Br J Anaesth. 1996, 77: 798-803.CrossRefPubMed Carroll D, Tramèr M, McQuay H, Nye B, Moore A: Randomization is important in studies with pain outcomes: systematic review of transcutaneous electrical nerve stimulation in acute postoperative pain. Br J Anaesth. 1996, 77: 798-803.CrossRefPubMed
44.
go back to reference Derry CJ, Derry S, McQuay HJ, Moore RA: Systematic review of systematic reviews of acupuncture published 1996–2005. Clin Med. 2006, 6: 381-386.CrossRef Derry CJ, Derry S, McQuay HJ, Moore RA: Systematic review of systematic reviews of acupuncture published 1996–2005. Clin Med. 2006, 6: 381-386.CrossRef
45.
go back to reference Jadad AR, Cook DJ, Jones A, Klassen TP, Tugwell P, Moher M, Moher D: Methodology and reports of systematic reviews and meta-analyses: a comparison of Cochrane reviews with articles published in paper-based journals. JAMA. 1998, 280: 278-280.CrossRefPubMed Jadad AR, Cook DJ, Jones A, Klassen TP, Tugwell P, Moher M, Moher D: Methodology and reports of systematic reviews and meta-analyses: a comparison of Cochrane reviews with articles published in paper-based journals. JAMA. 1998, 280: 278-280.CrossRefPubMed
46.
go back to reference Sheikh L, Johnston S, Thangaratinam S, Kilby MD, Khan KS: A review of the methodological features of systematic reviews in maternal medicine. BMC Med. 2007, 5: 10.CrossRefPubMedPubMedCentral Sheikh L, Johnston S, Thangaratinam S, Kilby MD, Khan KS: A review of the methodological features of systematic reviews in maternal medicine. BMC Med. 2007, 5: 10.CrossRefPubMedPubMedCentral
47.
go back to reference Aoun SM, Kristjanson LJ: Challenging the framework for evidence in palliative care research. Palliat Med. 2005, 19: 461-465.CrossRefPubMed Aoun SM, Kristjanson LJ: Challenging the framework for evidence in palliative care research. Palliat Med. 2005, 19: 461-465.CrossRefPubMed
48.
go back to reference Goodwin DM, Higginson IJ, Edwards AG, Finlay IG, Cook AM, Hood K, Douglas HR, Normand CE: An evaluation of systematic reviews of palliative care services. J Palliat Care. 2002, 18: 77-83.PubMed Goodwin DM, Higginson IJ, Edwards AG, Finlay IG, Cook AM, Hood K, Douglas HR, Normand CE: An evaluation of systematic reviews of palliative care services. J Palliat Care. 2002, 18: 77-83.PubMed
49.
go back to reference K Benson, AJ Hartz: A comparison of observational studies and randomised controlled trials. NEJM. 2000, 342: 1878-1886.CrossRef K Benson, AJ Hartz: A comparison of observational studies and randomised controlled trials. NEJM. 2000, 342: 1878-1886.CrossRef
50.
go back to reference Geborek P, Crnkic M, Petersson IF, Saxne T, South Swedish Arthritis Treatment Group: Etanercept, infliximab, and leflunomide in established rheumatoid arthritis: clinical experience using a structured follow up programme in southern Sweden. Ann Rheum Dis. 2002, 61: 793-798.CrossRefPubMedPubMedCentral Geborek P, Crnkic M, Petersson IF, Saxne T, South Swedish Arthritis Treatment Group: Etanercept, infliximab, and leflunomide in established rheumatoid arthritis: clinical experience using a structured follow up programme in southern Sweden. Ann Rheum Dis. 2002, 61: 793-798.CrossRefPubMedPubMedCentral
51.
go back to reference Apolone G, Mangano S, Compagnoni A, Negri E, Mosconi P, Mannino S, Villa M, Zuccaro P, Cancer Pain Outcome Research Study Group (CPOR SG): A multidisciplinary project to improve the quality of cancer pain management in Italy: background, methods, and preliminary results. J Ambul Care Manage. 2006, 29: 332-341.CrossRefPubMed Apolone G, Mangano S, Compagnoni A, Negri E, Mosconi P, Mannino S, Villa M, Zuccaro P, Cancer Pain Outcome Research Study Group (CPOR SG): A multidisciplinary project to improve the quality of cancer pain management in Italy: background, methods, and preliminary results. J Ambul Care Manage. 2006, 29: 332-341.CrossRefPubMed
Metadata
Title
How useful are systematic reviews for informing palliative care practice? Survey of 25 Cochrane systematic reviews
Authors
Bee Wee
Gina Hadley
Sheena Derry
Publication date
01-12-2008
Publisher
BioMed Central
Published in
BMC Palliative Care / Issue 1/2008
Electronic ISSN: 1472-684X
DOI
https://doi.org/10.1186/1472-684X-7-13

Other articles of this Issue 1/2008

BMC Palliative Care 1/2008 Go to the issue