Skip to main content
Top
Published in: Trials 1/2017

Open Access 01-12-2017 | Research

Assessing the quality of reports about randomized controlled trials of scalp acupuncture treatment for vascular dementia

Authors: Young-Nim You, Myung-Rae Cho, Ju-Hyung Park, Gwang-Cheon Park, Min-Yeong Song, Jin-Bong Choi, Chang-Su Na, Jae-Young Han, Jeong-cheol Shin, Jae-Hong Kim

Published in: Trials | Issue 1/2017

Login to get access

Abstract

Background

This study aimed to evaluate the quality of reports about randomized controlled trials (RCTs) of scalp acupuncture (SA) for the treatment of vascular dementia (VD).

Method

A systematic search of reports published through to December 2015 was performed in eight databases. The quality of RCTs that used SA as an intervention for VD was evaluated based on the 2010 Consolidated Standards for Reporting of Trials (CONSORT) and 2010 Standards for Reporting Interventions in Controlled Trials of Acupuncture (STRICTA) guidelines. Thirteen items from the CONSORT guideline were scored to give an overall quality score (OQS, range 0–13), and a combined key methodological index score (MIS) (range 0–5) of five key methodological items was measured. The OQS of 17 items from the STRICTA guideline (range 0–17) was also measured.

Results

In total, 26 reports were evaluated. The median OQS based on the CONSORT guideline was 8 (minimum 5, maximum 11), and “trial design,” “sample size,” “ancillary analyses,” and “harms” had a positive rate of less than 10%. The median MIS was 2 (minimum 0, maximum 5), with “allocation concealment and implementation,” “blinding,” and “intent-to-treat analysis” having a positive rate of less than 15%. The median OQS based on the STRICTA guideline was 12 (minimum 8, maximum 14), with “extent to which treatment was varied (1c),” “number of needle insertions per subject per session (2a),” and “setting and context of treatment (4b)” having a positive rate of less than 10%.

Conclusions

The overall quality of reports on RCTs of SA treatment for VD was moderate to low. The quality of methodological items was markedly lower than that of other items. The CONSORT and STRICTA guidelines should be used more frequently to standardize the quality of RCT reports of SA treatment for VD.
Literature
1.
go back to reference Murray ME, Knopman DS, Dickson DW. Vascular dementia: clinical, neuroradiologic and neuropathologic aspects. Panminerva Med. 2007;49:197–207.PubMed Murray ME, Knopman DS, Dickson DW. Vascular dementia: clinical, neuroradiologic and neuropathologic aspects. Panminerva Med. 2007;49:197–207.PubMed
2.
3.
go back to reference Battistin L, Cagnin A. Vascular cognitive disorder. A biological and clinical overview. Neurochem Res. 2010;35:1933–8.CrossRefPubMed Battistin L, Cagnin A. Vascular cognitive disorder. A biological and clinical overview. Neurochem Res. 2010;35:1933–8.CrossRefPubMed
4.
go back to reference Olsson Y, Brun A, Englund E. Fundamental pathological lesions in vascular dementia. Acta Neurol Scand Suppl. 1996;168:31–8.CrossRefPubMed Olsson Y, Brun A, Englund E. Fundamental pathological lesions in vascular dementia. Acta Neurol Scand Suppl. 1996;168:31–8.CrossRefPubMed
7.
go back to reference Sahathevan R, Brodtmann A, Donnan GA. Dementia, stroke, and vascular risk factors; a review. Int J Stroke. 2012;7:61–73.CrossRefPubMed Sahathevan R, Brodtmann A, Donnan GA. Dementia, stroke, and vascular risk factors; a review. Int J Stroke. 2012;7:61–73.CrossRefPubMed
8.
go back to reference Quentin W, Riedel-Heller SG, Luppa M, Rudolph A, König HH. Cost-of-illness studies of dementia: a systematic review focusing on stage dependency of costs. Acta Psychiatr Scand. 2010;121:243–59.CrossRefPubMed Quentin W, Riedel-Heller SG, Luppa M, Rudolph A, König HH. Cost-of-illness studies of dementia: a systematic review focusing on stage dependency of costs. Acta Psychiatr Scand. 2010;121:243–59.CrossRefPubMed
9.
go back to reference Liu Z, Guan L, Wang Y, Xie CL, Lin XM, Zheng GQ. History and mechanism for treatment of intracerebral hemorrhage with scalp acupuncture. Evid Based Complement Alternat Med. 2012;2012:895032.PubMedPubMedCentral Liu Z, Guan L, Wang Y, Xie CL, Lin XM, Zheng GQ. History and mechanism for treatment of intracerebral hemorrhage with scalp acupuncture. Evid Based Complement Alternat Med. 2012;2012:895032.PubMedPubMedCentral
10.
go back to reference WHO Scientific Group on International Acupuncture Nomenclature. A proposed standard international acupuncture nomenclature: report of a WHO scientific group. Geneva: World Health Organization; 1991. WHO Scientific Group on International Acupuncture Nomenclature. A proposed standard international acupuncture nomenclature: report of a WHO scientific group. Geneva: World Health Organization; 1991.
11.
go back to reference Wang Y, Shen J, Wang XM, Fu DL, Chen CY, Lu LY, et al. Scalp acupuncture for acute ischemic stroke: a meta-analysis of randomized controlled trials. Evid Based Complement Alternat Med. 2012;2012:480950.PubMedPubMedCentral Wang Y, Shen J, Wang XM, Fu DL, Chen CY, Lu LY, et al. Scalp acupuncture for acute ischemic stroke: a meta-analysis of randomized controlled trials. Evid Based Complement Alternat Med. 2012;2012:480950.PubMedPubMedCentral
12.
go back to reference Lee GE, Yang HD, Heo EJ, Jeon WK, Lyu YS, Kang HW. The current state of clinical studies on scalp acupuncture-treatment for dementia-by search for China literature published from 2001 to 2011 in CAJ (China Academic Journals). J Orient Neuropsychiatry. 2012;23:13–32.CrossRef Lee GE, Yang HD, Heo EJ, Jeon WK, Lyu YS, Kang HW. The current state of clinical studies on scalp acupuncture-treatment for dementia-by search for China literature published from 2001 to 2011 in CAJ (China Academic Journals). J Orient Neuropsychiatry. 2012;23:13–32.CrossRef
13.
go back to reference Peng W, Zhao H, Liu Z, Liu B. Systematic assessment of electroacupuncture treatment for vascular dementia. Chin Acupunct Moxibustion. 2004;24(5):297–301. Peng W, Zhao H, Liu Z, Liu B. Systematic assessment of electroacupuncture treatment for vascular dementia. Chin Acupunct Moxibustion. 2004;24(5):297–301.
14.
go back to reference Son C. Overview for pattern and results of moxibustion-derived clinical trials. Korean J Acupunct. 2009;26:41–9. Son C. Overview for pattern and results of moxibustion-derived clinical trials. Korean J Acupunct. 2009;26:41–9.
15.
go back to reference Jang MK, Yoon EH, Jung CY, Kim EJ, Lee SD, Hwang MS, et al. Review of randomized controlled trials on pharmacopuncture treatment for musculoskeletal diseases. J Korean Acupunct Moxibust Soc. 2009;26(3):149–63. Jang MK, Yoon EH, Jung CY, Kim EJ, Lee SD, Hwang MS, et al. Review of randomized controlled trials on pharmacopuncture treatment for musculoskeletal diseases. J Korean Acupunct Moxibust Soc. 2009;26(3):149–63.
16.
go back to reference Kim YY, Yoo JH, Lee SK, Lee SW. Quality assessment of randomized controlled trials using herbal remedies in Korea. J Physiol Pathol Korean Med. 2011;25:927–33. Kim YY, Yoo JH, Lee SK, Lee SW. Quality assessment of randomized controlled trials using herbal remedies in Korea. J Physiol Pathol Korean Med. 2011;25:927–33.
17.
go back to reference Park JE, Kang KW, Choi SM. Assessing methodological quality of acupuncture clinical trials of Korea. J Korean Acupunct Moxibust Soc. 2007;24:127–35. Park JE, Kang KW, Choi SM. Assessing methodological quality of acupuncture clinical trials of Korea. J Korean Acupunct Moxibust Soc. 2007;24:127–35.
18.
go back to reference Schulz KF, Altman DG, Moher D. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. Zhong Xi Yi Jie He Xue Bao. 2010;8:604–12.CrossRefPubMed Schulz KF, Altman DG, Moher D. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. Zhong Xi Yi Jie He Xue Bao. 2010;8:604–12.CrossRefPubMed
19.
go back to reference MacPherson H, Altman DG, Hammerschlag R, Youping L, Taixiang W, White A, et al. Revised STandards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA): extending the CONSORT statement. PLoS Med. 2010;7:e1000261.CrossRefPubMedPubMedCentral MacPherson H, Altman DG, Hammerschlag R, Youping L, Taixiang W, White A, et al. Revised STandards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA): extending the CONSORT statement. PLoS Med. 2010;7:e1000261.CrossRefPubMedPubMedCentral
20.
go back to reference Zhuang L, He J, Zhuang X, Lu L. Quality of reporting on randomized controlled trials of acupuncture for stroke rehabilitation. BMC Complement Altern Med. 2014;14:151.CrossRefPubMedPubMedCentral Zhuang L, He J, Zhuang X, Lu L. Quality of reporting on randomized controlled trials of acupuncture for stroke rehabilitation. BMC Complement Altern Med. 2014;14:151.CrossRefPubMedPubMedCentral
21.
go back to reference Chen ZW, Chen YC, Zeng JC, Wang Y, Ye T, Zhou QC, Du XJ, Su WT, Ding ZS. Quality of randomized controlled trials reporting in the treatment of melasma conducted in china. Trials. 2015;16:156.CrossRefPubMedPubMedCentral Chen ZW, Chen YC, Zeng JC, Wang Y, Ye T, Zhou QC, Du XJ, Su WT, Ding ZS. Quality of randomized controlled trials reporting in the treatment of melasma conducted in china. Trials. 2015;16:156.CrossRefPubMedPubMedCentral
22.
go back to reference Bo C, Xue Z, Yi G, Zelin C, Yang B, Zixu W, Yajun W. Assessing the quality of reports about randomized controlled trials of acupuncture treatment on diabetic peripheral neuropathy. PLoS One. 2012;7:e38461.CrossRefPubMedPubMedCentral Bo C, Xue Z, Yi G, Zelin C, Yang B, Zixu W, Yajun W. Assessing the quality of reports about randomized controlled trials of acupuncture treatment on diabetic peripheral neuropathy. PLoS One. 2012;7:e38461.CrossRefPubMedPubMedCentral
23.
go back to reference Lai R, Chu R, Fraumeni M, Thabane L. Quality of randomized controlled trials reporting in the primary treatment of brain tumors. J Clin Oncol. 2006;24:1136–44.CrossRefPubMed Lai R, Chu R, Fraumeni M, Thabane L. Quality of randomized controlled trials reporting in the primary treatment of brain tumors. J Clin Oncol. 2006;24:1136–44.CrossRefPubMed
24.
go back to reference Toulmonde M, Bellera C, Mathoulin-Pelissier S, Debled M, Bui B, Italiano A. Quality of randomized controlled trials reporting in the treatment of sarcomas. J Clin Oncol. 2011;29(9):1204–9.CrossRefPubMed Toulmonde M, Bellera C, Mathoulin-Pelissier S, Debled M, Bui B, Italiano A. Quality of randomized controlled trials reporting in the treatment of sarcomas. J Clin Oncol. 2011;29(9):1204–9.CrossRefPubMed
25.
go back to reference Rios LP, Odueyungbo A, Moitri MO, Rahman MO, Thabane L. Quality of reporting of randomized controlled trials in general endocrinology literature. J Clin Endocrinol Metab. 2008;93(10):3810–6.CrossRefPubMed Rios LP, Odueyungbo A, Moitri MO, Rahman MO, Thabane L. Quality of reporting of randomized controlled trials in general endocrinology literature. J Clin Endocrinol Metab. 2008;93(10):3810–6.CrossRefPubMed
26.
go back to reference Gao J, Deng G, Hu Y, Huang Y, Lu L, Huang D, et al. Quality of reporting on randomized controlled trials on recurrent spontaneous abortion in China. Trials. 2015;16:172.CrossRefPubMedPubMedCentral Gao J, Deng G, Hu Y, Huang Y, Lu L, Huang D, et al. Quality of reporting on randomized controlled trials on recurrent spontaneous abortion in China. Trials. 2015;16:172.CrossRefPubMedPubMedCentral
27.
go back to reference Lu X, Hongcai S, Jiaying W, Jing H, Jun X. Assessing the quality of reports about randomized controlled trials of acupuncture treatment on mild cognitive impairment. PLoS One. 2011;6:e16922.CrossRefPubMedPubMedCentral Lu X, Hongcai S, Jiaying W, Jing H, Jun X. Assessing the quality of reports about randomized controlled trials of acupuncture treatment on mild cognitive impairment. PLoS One. 2011;6:e16922.CrossRefPubMedPubMedCentral
28.
go back to reference Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869.CrossRefPubMedPubMedCentral Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869.CrossRefPubMedPubMedCentral
29.
go back to reference Baer H. The emergence of integrative medicine in Australia: the growing interest of biomedicine and nursing in complementary medicine in a southern developed society. Med Anthropol Q. 2008;22(1):52–66.CrossRefPubMed Baer H. The emergence of integrative medicine in Australia: the growing interest of biomedicine and nursing in complementary medicine in a southern developed society. Med Anthropol Q. 2008;22(1):52–66.CrossRefPubMed
30.
31.
go back to reference Gluud LL, Thorlund K, Gluud C, Woods L, Harris R, Sterne JA. Correction: reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Ann Intern Med. 2008;149:219.CrossRefPubMed Gluud LL, Thorlund K, Gluud C, Woods L, Harris R, Sterne JA. Correction: reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Ann Intern Med. 2008;149:219.CrossRefPubMed
32.
go back to reference Montori VM, Bhandari M, Devereaux PJ, Manns BJ, Ghali WA, Guyatt GH. In the dark: the reporting of blinding status in randomized controlled trials. J Clin Epidemiol. 2002;55:787–90.CrossRefPubMed Montori VM, Bhandari M, Devereaux PJ, Manns BJ, Ghali WA, Guyatt GH. In the dark: the reporting of blinding status in randomized controlled trials. J Clin Epidemiol. 2002;55:787–90.CrossRefPubMed
33.
go back to reference McDonald AM, Knight RC, Campbell MK, Entwistle VA, Grant AM, Cook JA, et al. What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006;7:9.CrossRefPubMedPubMedCentral McDonald AM, Knight RC, Campbell MK, Entwistle VA, Grant AM, Cook JA, et al. What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006;7:9.CrossRefPubMedPubMedCentral
34.
go back to reference Chen X, Zhai X, Wang X, Su J, Li M. Methodological reporting quality of randomized controlled trials in three spine journals from 2010 to 2012. Eur Spine J. 2014;23:1606–11.CrossRefPubMed Chen X, Zhai X, Wang X, Su J, Li M. Methodological reporting quality of randomized controlled trials in three spine journals from 2010 to 2012. Eur Spine J. 2014;23:1606–11.CrossRefPubMed
35.
go back to reference Tukey JW. Some thoughts on clinical trials, especially problems of multiplicity. Science. 1977;198:679–84.CrossRefPubMed Tukey JW. Some thoughts on clinical trials, especially problems of multiplicity. Science. 1977;198:679–84.CrossRefPubMed
36.
go back to reference Hahn S, Williamson PR, Hutton JL, Garner P, Flynn EV. Assessing the potential for bias in meta-analysis due to selective reporting of subgroup analyses within studies. Stat Med. 2000;19:3325–36.CrossRefPubMed Hahn S, Williamson PR, Hutton JL, Garner P, Flynn EV. Assessing the potential for bias in meta-analysis due to selective reporting of subgroup analyses within studies. Stat Med. 2000;19:3325–36.CrossRefPubMed
37.
go back to reference Ioannidis JP, Lau J. Completeness of safety reporting in randomized trials: an evaluation of Q medical areas. JAMA. 2001;285:437–43.CrossRefPubMed Ioannidis JP, Lau J. Completeness of safety reporting in randomized trials: an evaluation of Q medical areas. JAMA. 2001;285:437–43.CrossRefPubMed
38.
go back to reference Scharf O, Colevas AD. Adverse event reporting in publications compared with sponsor database for cancer clinical trials. J Clin Oncol. 2006;24:3933–8.CrossRefPubMed Scharf O, Colevas AD. Adverse event reporting in publications compared with sponsor database for cancer clinical trials. J Clin Oncol. 2006;24:3933–8.CrossRefPubMed
39.
go back to reference Pitrou I, Boutron I, Ahmad N, Ravaud P. Reporting of safety results in published reports of randomized controlled trials. Arch Intern Med. 2009;169:1756–61.CrossRefPubMed Pitrou I, Boutron I, Ahmad N, Ravaud P. Reporting of safety results in published reports of randomized controlled trials. Arch Intern Med. 2009;169:1756–61.CrossRefPubMed
40.
go back to reference Lee HS, Cha SJ, Park HJ, Seo JC, Park JB, Lee HJ. Revised STandards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA): extending the CONSORT statement. Korean J Acupunct. 2010;27:1–23. Lee HS, Cha SJ, Park HJ, Seo JC, Park JB, Lee HJ. Revised STandards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA): extending the CONSORT statement. Korean J Acupunct. 2010;27:1–23.
41.
go back to reference Di Blasi Z, Kleijnen J. Context effects. Powerful therapies or methodological bias? Eval Health Prof. 2003;26:166–79.CrossRefPubMed Di Blasi Z, Kleijnen J. Context effects. Powerful therapies or methodological bias? Eval Health Prof. 2003;26:166–79.CrossRefPubMed
42.
go back to reference Chen B, Liu J, Zhang C, Li M. A retrospective survey of reporting quality on randomized controlled trials of metformin for polycystic ovary syndrome. Trials. 2014;15:128.CrossRefPubMedPubMedCentral Chen B, Liu J, Zhang C, Li M. A retrospective survey of reporting quality on randomized controlled trials of metformin for polycystic ovary syndrome. Trials. 2014;15:128.CrossRefPubMedPubMedCentral
43.
go back to reference Lu L, Luo G, Xiao F. A retrospective survey of the quality of reports and their correlates among randomized controlled trials of immunotherapy for Guillain-Barre syndrome. Immunotherapy. 2013;5:829–36.CrossRefPubMed Lu L, Luo G, Xiao F. A retrospective survey of the quality of reports and their correlates among randomized controlled trials of immunotherapy for Guillain-Barre syndrome. Immunotherapy. 2013;5:829–36.CrossRefPubMed
44.
go back to reference Lu L, Liao M, Zeng J, He J. Quality of reporting and its correlates among randomized controlled trials on acupuncture for cancer pain: application of the CONSORT 2010 Statement and STRICTA. Expert Rev Anticancer Ther. 2013;13:489–98.CrossRefPubMed Lu L, Liao M, Zeng J, He J. Quality of reporting and its correlates among randomized controlled trials on acupuncture for cancer pain: application of the CONSORT 2010 Statement and STRICTA. Expert Rev Anticancer Ther. 2013;13:489–98.CrossRefPubMed
45.
go back to reference Asher GN, Motsinger-Reif AA, Jonas DE, Viera AJ. Quality of reporting on randomised controlled trials of auriculotherapy for pain. Acupunct Med. 2011;29:122–6.CrossRefPubMed Asher GN, Motsinger-Reif AA, Jonas DE, Viera AJ. Quality of reporting on randomised controlled trials of auriculotherapy for pain. Acupunct Med. 2011;29:122–6.CrossRefPubMed
46.
go back to reference Hammerschlag R, Milley R, Colbert A, Weih J, Yohalem-Ilsley B, Mist S, et al. Randomized controlled trials of acupuncture (1997-2007): an assessment of reporting quality with a CONSORT- and STRICTA-based instrument. Evid Based Complement Alternat Med. 2011;2011:183910. doi:10.1155/2011/183910.CrossRefPubMed Hammerschlag R, Milley R, Colbert A, Weih J, Yohalem-Ilsley B, Mist S, et al. Randomized controlled trials of acupuncture (1997-2007): an assessment of reporting quality with a CONSORT- and STRICTA-based instrument. Evid Based Complement Alternat Med. 2011;2011:183910. doi:10.​1155/​2011/​183910.CrossRefPubMed
Metadata
Title
Assessing the quality of reports about randomized controlled trials of scalp acupuncture treatment for vascular dementia
Authors
Young-Nim You
Myung-Rae Cho
Ju-Hyung Park
Gwang-Cheon Park
Min-Yeong Song
Jin-Bong Choi
Chang-Su Na
Jae-Young Han
Jeong-cheol Shin
Jae-Hong Kim
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Trials / Issue 1/2017
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-017-1945-0

Other articles of this Issue 1/2017

Trials 1/2017 Go to the issue