Skip to main content
Top
Published in: BMC Complementary Medicine and Therapies 1/2017

Open Access 01-12-2017 | Research article

Assessing the quality of reports about randomized controlled trials of scalp acupuncture combined with another treatment for stroke

Authors: Young-Nim You, Myung-Rae Cho, Jae-Hong Kim, Ju-Hyung Park, Gwang-Cheon Park, Min-Yeong Song, Jin-Bong Choi, Jae-Young Han

Published in: BMC Complementary Medicine and Therapies | Issue 1/2017

Login to get access

Abstract

Background

This study was designed to assess the quality of reporting on randomized controlled trials (RCTs) of scalp acupuncture for the treatment of stroke.

Methods

The following 8 databases were systematically investigated from their inception to December 2015: PubMed, Embase, Cochrane Library, China National Knowledge Infrastructure, National Institute of Informatics Scholarly and Academic Information Navigator, National Digital Science Library, Korean Traditional Knowledge Portal, and Korean Studies Information Service System. RCTs utilizing scalp acupuncture as an intervention for stroke were selected, and the quality of reports was assessed based on the Consolidated Standards of Reporting Trials 2010 statement (CONSORT) and Standards for Reporting Interventions in Controlled Trials of Acupuncture 2010 (STRICTA). For each study, the overall quality score (OQS) of 13 CONSORT items, a combined key methodological index score (MIS) of 5 CONSORT items, and the OQS of 17 STRICTA items were measured.

Results

The original reports of 63 RCTs were ultimately obtained, and the median CONSORT OQS was 7 (minimum 2, maximum 11). Particularly, the items ‘trial design’, ‘sample size’, ‘ancillary analyses’, and ‘harms’ had a positive rate of less than 10%. The median MIS was 1 (minimum 0, maximum 5), with ‘allocation concealment and implementation’ and ‘intent-to-treat analysis (ITT) analysis’ having a positive rate of less than 10%. The median STRICTA OQS was 11 (minimum 6, maximum 14), and only the items ‘sample size’ and ‘intent-to-treat analysis’ were reported, with a positive rate of less than 10%. The mean CONSORT OQS increased by approximately 0.81 for each 5-year period in which manuscripts were published (95% confidence interval: 0.43 to 1.19; p < 0.001). No variable was significantly associated with MIS in the ordinal regression model.

Conclusion

The quality of reports on RCTs investigating scalp acupuncture treatment for stroke was moderate to low. Furthermore, reporting of some items was either insufficient or inadequate in the majority of studies. In order to improve and standardize the quality of RCTs investigating scalp acupuncture for stroke, CONSORT and STRICTA guidelines should be utilized more frequently.
Appendix
Available only for authorised users
Literature
2.
go back to reference He J, Gu D, Wu X, Reynolds K, Duan X, Yao C, et al. Major causes of death among men and women in China. N Engl J Med. 2005;353:1124–34.CrossRefPubMed He J, Gu D, Wu X, Reynolds K, Duan X, Yao C, et al. Major causes of death among men and women in China. N Engl J Med. 2005;353:1124–34.CrossRefPubMed
4.
go back to reference Lee WH, Kim JS. A review study of stroke in Korea. Korean J Epidemiol. 1981;3:1–22. Lee WH, Kim JS. A review study of stroke in Korea. Korean J Epidemiol. 1981;3:1–22.
5.
go back to reference Gorelick PB, Sacco RL, Smith DB, Alberts M, Mustone-Alexander L, Rader D, et al. Prevention of a first stroke: a review of guidelines and a multidisciplinary consensus statement from the National Stroke Association. JAMA. 1999;281:1112–20.CrossRefPubMed Gorelick PB, Sacco RL, Smith DB, Alberts M, Mustone-Alexander L, Rader D, et al. Prevention of a first stroke: a review of guidelines and a multidisciplinary consensus statement from the National Stroke Association. JAMA. 1999;281:1112–20.CrossRefPubMed
6.
go back to reference Liu Z, Guan L, Wang Y, Xie CL, Lin XM, Zheng GQ. History and mechanism for treatment of intracerebral hemorrhage with scalp acupuncture. Evid Based Complement Alternat Med. 2012;2012:895032.PubMedPubMedCentral Liu Z, Guan L, Wang Y, Xie CL, Lin XM, Zheng GQ. History and mechanism for treatment of intracerebral hemorrhage with scalp acupuncture. Evid Based Complement Alternat Med. 2012;2012:895032.PubMedPubMedCentral
7.
go back to reference WHO Scientific Group on International Acupuncture Nomenclature. A proposed standard international acupuncture nomenclature. Report of a WHO scientific group. Geneva: World Health Organization; 1991. WHO Scientific Group on International Acupuncture Nomenclature. A proposed standard international acupuncture nomenclature. Report of a WHO scientific group. Geneva: World Health Organization; 1991.
8.
go back to reference Dharmananda S, Vickers E. Synopsis of scalp acupuncture. 2000. http://www.itmonline.org/arts/newscalp.htm Accessed 31 Mar 2016. Dharmananda S, Vickers E. Synopsis of scalp acupuncture. 2000. http://​www.​itmonline.​org/​arts/​newscalp.​htm Accessed 31 Mar 2016.
9.
go back to reference Beak KM, Kim MJ, Lee HU, Lim SM, Yoo HR, Jo HK, et al. A clinical study of 3 cases of stroke patients with dysphagia treated by simultaneous scalp-acupuncture and electroacupuncture. Korean J Orient Int Med. 2007;28:632–44. Beak KM, Kim MJ, Lee HU, Lim SM, Yoo HR, Jo HK, et al. A clinical study of 3 cases of stroke patients with dysphagia treated by simultaneous scalp-acupuncture and electroacupuncture. Korean J Orient Int Med. 2007;28:632–44.
10.
go back to reference Cho TS, Son IS, Park IB, Kim SW, Seo JC, Youn HM, et al. Effects of scalp acupuncture on short-term NIHSS and MBI in stroke patients. J Korean Orient Med. 2003;24:65–73. Cho TS, Son IS, Park IB, Kim SW, Seo JC, Youn HM, et al. Effects of scalp acupuncture on short-term NIHSS and MBI in stroke patients. J Korean Orient Med. 2003;24:65–73.
11.
go back to reference Ha CH, Han SG, Cho MR, Ryu CR, Lee BR. A clinical study on 29 cases with stroke treated by body acupuncture therapy and scalp acupuncture. J Korean Acupunct Moxibust Soc. 2001;18:82–90. Ha CH, Han SG, Cho MR, Ryu CR, Lee BR. A clinical study on 29 cases with stroke treated by body acupuncture therapy and scalp acupuncture. J Korean Acupunct Moxibust Soc. 2001;18:82–90.
12.
go back to reference Kim JH, Park GC. A case report of central post-stroke pain patient treated with SA (MS6 and MS7) and usual treatment of Korean medicine. J Korean Acupunct Moxibust Soc. 2014;31:57–65. Kim JH, Park GC. A case report of central post-stroke pain patient treated with SA (MS6 and MS7) and usual treatment of Korean medicine. J Korean Acupunct Moxibust Soc. 2014;31:57–65.
13.
go back to reference Wang Y, Shen J, Wang X-M, Fu D-L, Chen C-Y, Lu L-Y, et al. Scalp acupuncture for acute ischemic stroke: a meta-analysis of randomized controlled trials. Evid Based Complement Alternat Med. 2012;2012:1–9. Wang Y, Shen J, Wang X-M, Fu D-L, Chen C-Y, Lu L-Y, et al. Scalp acupuncture for acute ischemic stroke: a meta-analysis of randomized controlled trials. Evid Based Complement Alternat Med. 2012;2012:1–9.
14.
go back to reference Lee SJ, Shin BC, Lee MS, Han CH, Kim JI. Scalp STRICTA recommendations for stroke recovery: a systematic review and meta-analysis of randomized controlled trials. Eur J Integr Med. 2013;5:87–99.CrossRef Lee SJ, Shin BC, Lee MS, Han CH, Kim JI. Scalp STRICTA recommendations for stroke recovery: a systematic review and meta-analysis of randomized controlled trials. Eur J Integr Med. 2013;5:87–99.CrossRef
15.
go back to reference Kong JC, Lee MS, Shin BC, Song YS, Ernst E. Acupuncture for functional recovery after stroke: a systematic review of sham-controlled randomized clinical trials. CMAJ. 2010;182:1723–9.CrossRefPubMedPubMedCentral Kong JC, Lee MS, Shin BC, Song YS, Ernst E. Acupuncture for functional recovery after stroke: a systematic review of sham-controlled randomized clinical trials. CMAJ. 2010;182:1723–9.CrossRefPubMedPubMedCentral
16.
go back to reference Son C. Overview for pattern and results of moxibustion-derived clinical trials. J Meridian Acupoint. 2009;26:41–9. Son C. Overview for pattern and results of moxibustion-derived clinical trials. J Meridian Acupoint. 2009;26:41–9.
17.
go back to reference Chung W, Lee KW, Hwang IH, Lee DH, Kim SY. Quality assessment of randomized controlled trials in the journal of the Korean academy of family medicine. Korean J Fam Med. 2009;30:626–31.CrossRef Chung W, Lee KW, Hwang IH, Lee DH, Kim SY. Quality assessment of randomized controlled trials in the journal of the Korean academy of family medicine. Korean J Fam Med. 2009;30:626–31.CrossRef
18.
go back to reference Park J, Kang K, Choi S. Assessing methodological quality of acupuncture clinical trials of Korea. J Korean Acupunct Moxibust Soc. 2007;24:127–35. Park J, Kang K, Choi S. Assessing methodological quality of acupuncture clinical trials of Korea. J Korean Acupunct Moxibust Soc. 2007;24:127–35.
20.
go back to reference MacPherson H, Altman DG, Hammerschlag R, Youping L, Taixiang W, White A, et al. Revised STandards for reporting interventions in clinical trials of acupuncture (STRICTA): extending the CONSORT statement. PLoS Med. 2010;7:e1000261.CrossRefPubMedPubMedCentral MacPherson H, Altman DG, Hammerschlag R, Youping L, Taixiang W, White A, et al. Revised STandards for reporting interventions in clinical trials of acupuncture (STRICTA): extending the CONSORT statement. PLoS Med. 2010;7:e1000261.CrossRefPubMedPubMedCentral
21.
go back to reference Zhuang L, He J, Zhuang X, Lu L. Quality of reporting on randomized controlled trials of acupuncture for stroke rehabilitation. BMC Complement Altern Med. 2014;14:151.CrossRefPubMedPubMedCentral Zhuang L, He J, Zhuang X, Lu L. Quality of reporting on randomized controlled trials of acupuncture for stroke rehabilitation. BMC Complement Altern Med. 2014;14:151.CrossRefPubMedPubMedCentral
22.
go back to reference The Chinese Medical Association of the Fourth National Cerebrovascular Disease Conference. Essentials of diagnosis of all kinds of cerebrovascular diseases. Chin J Neurol. 1996;29:379. The Chinese Medical Association of the Fourth National Cerebrovascular Disease Conference. Essentials of diagnosis of all kinds of cerebrovascular diseases. Chin J Neurol. 1996;29:379.
23.
go back to reference Li P, Wu ZZ, Zhang YR, Li BZ, Hua RC, Wei JN, et al. Criterion of diagnosis and therapeutic effect of apoplexy. J Beijing Univ Tradit Chin Med. 1996;19:55–6. Li P, Wu ZZ, Zhang YR, Li BZ, Hua RC, Wei JN, et al. Criterion of diagnosis and therapeutic effect of apoplexy. J Beijing Univ Tradit Chin Med. 1996;19:55–6.
24.
go back to reference The Forth National Cerebrovascular Diseases Conference. Classification, diagnostic criteria and evaluation of neurological impairment for stroke patients. Chin J Neurol. 1996;29:381–3. The Forth National Cerebrovascular Diseases Conference. Classification, diagnostic criteria and evaluation of neurological impairment for stroke patients. Chin J Neurol. 1996;29:381–3.
25.
go back to reference Chen ZW, Chen YC, Zeng JC, Wang Y, Ye T, Zhou QC, et al. Quality of randomized controlled trials reporting in the treatment of melasma conducted in China. Trials. 2015;16:156.CrossRefPubMedPubMedCentral Chen ZW, Chen YC, Zeng JC, Wang Y, Ye T, Zhou QC, et al. Quality of randomized controlled trials reporting in the treatment of melasma conducted in China. Trials. 2015;16:156.CrossRefPubMedPubMedCentral
26.
27.
go back to reference Gluud LL, Thorlund K, Gluud C, Woods L, Harris R, Sterne JA. Correction: reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Ann Intern Med. 2008;149:219.CrossRefPubMed Gluud LL, Thorlund K, Gluud C, Woods L, Harris R, Sterne JA. Correction: reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Ann Intern Med. 2008;149:219.CrossRefPubMed
28.
go back to reference Montori VM, Bhandari M, Devereaux PJ, Manns BJ, Ghali WA, Guyatt GH. In the dark: the reporting of blinding status in randomized controlled trials. J Clin Epidemiol. 2002;55:787–90.CrossRefPubMed Montori VM, Bhandari M, Devereaux PJ, Manns BJ, Ghali WA, Guyatt GH. In the dark: the reporting of blinding status in randomized controlled trials. J Clin Epidemiol. 2002;55:787–90.CrossRefPubMed
29.
go back to reference Gao J, Deng G, Hu Y, Huang Y, Lu L, Huang D, et al. Quality of reporting on randomized controlled trials on recurrent spontaneous abortion in China. Trials. 2015;16:172.CrossRefPubMedPubMedCentral Gao J, Deng G, Hu Y, Huang Y, Lu L, Huang D, et al. Quality of reporting on randomized controlled trials on recurrent spontaneous abortion in China. Trials. 2015;16:172.CrossRefPubMedPubMedCentral
30.
go back to reference Lai R, Chu R, Fraumeni M, Thabane L. Quality of randomized controlled trials reporting in the primary treatment of brain tumors. J Clin Oncol. 2006;24:1136–44.CrossRefPubMed Lai R, Chu R, Fraumeni M, Thabane L. Quality of randomized controlled trials reporting in the primary treatment of brain tumors. J Clin Oncol. 2006;24:1136–44.CrossRefPubMed
31.
go back to reference Lu X, Hongcai S, Jiaying W, Jing H, Jun X. Assessing the quality of reports about randomized controlled trials of acupuncture treatment on mild cognitive impairment. PLoS One. 2011;6:e16922.CrossRefPubMedPubMedCentral Lu X, Hongcai S, Jiaying W, Jing H, Jun X. Assessing the quality of reports about randomized controlled trials of acupuncture treatment on mild cognitive impairment. PLoS One. 2011;6:e16922.CrossRefPubMedPubMedCentral
32.
go back to reference Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomized trials. BMJ. 2010;340:c869.CrossRefPubMedPubMedCentral Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomized trials. BMJ. 2010;340:c869.CrossRefPubMedPubMedCentral
33.
go back to reference Mcdonald AM, Knight RC, Campbell MK, Entwistle VA, Grant AM, Cook JA, et al. What influences recruitment to randomized controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006;7:9.CrossRefPubMedPubMedCentral Mcdonald AM, Knight RC, Campbell MK, Entwistle VA, Grant AM, Cook JA, et al. What influences recruitment to randomized controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006;7:9.CrossRefPubMedPubMedCentral
34.
go back to reference Chen X, Zhai X, Wang X, Su J, Li M. Methodological reporting quality of randomized controlled trials in three spine journals from 2010 to 2012. Eur Spine J. 2014;23:1606–11.CrossRefPubMed Chen X, Zhai X, Wang X, Su J, Li M. Methodological reporting quality of randomized controlled trials in three spine journals from 2010 to 2012. Eur Spine J. 2014;23:1606–11.CrossRefPubMed
35.
go back to reference Tukey JW. Some thoughts on clinical trials, especially problems of multiplicity. Science. 1977;117:916–21. Tukey JW. Some thoughts on clinical trials, especially problems of multiplicity. Science. 1977;117:916–21.
36.
go back to reference Hahn S, Williamson PR, Hutton JL, Garner P, Flynn EV. Assessing the potential for bias in meta-analysis due to selective reporting of subgroup analyses within studies. Stat Med. 2000;19:3325–36.CrossRefPubMed Hahn S, Williamson PR, Hutton JL, Garner P, Flynn EV. Assessing the potential for bias in meta-analysis due to selective reporting of subgroup analyses within studies. Stat Med. 2000;19:3325–36.CrossRefPubMed
37.
go back to reference Ioannidis JP, Lau J. Completeness of safety reporting in randomized trials: an evaluation of 7 medical areas. JAMA 1999;281:1110-1. Ioannidis JP, Lau J. Completeness of safety reporting in randomized trials: an evaluation of 7 medical areas. JAMA 1999;281:1110-1.
38.
go back to reference Scharf O, Colevas AD. Adverse event reporting in publications compared with sponsor database for cancer clinical trials. J Clin Oncol. 2006;24:3933–8.CrossRefPubMed Scharf O, Colevas AD. Adverse event reporting in publications compared with sponsor database for cancer clinical trials. J Clin Oncol. 2006;24:3933–8.CrossRefPubMed
39.
go back to reference Pitrou I, Boutron I, Ahmad N, Ravaud P. Reporting of safety results in published reports of randomized controlled trials. Arch Intern Med. 2009;169:1756–61.CrossRefPubMed Pitrou I, Boutron I, Ahmad N, Ravaud P. Reporting of safety results in published reports of randomized controlled trials. Arch Intern Med. 2009;169:1756–61.CrossRefPubMed
40.
go back to reference Bo C, Xue Z, Yi G, Zelin C, Yang B, Zixu W, et al. Assessing the quality of reports about randomized controlled trials of acupuncture treatment on diabetic peripheral neuropathy. PLoS One. 2012;7:e38461.CrossRefPubMedPubMedCentral Bo C, Xue Z, Yi G, Zelin C, Yang B, Zixu W, et al. Assessing the quality of reports about randomized controlled trials of acupuncture treatment on diabetic peripheral neuropathy. PLoS One. 2012;7:e38461.CrossRefPubMedPubMedCentral
41.
go back to reference Lee HS, Cha SJ, Park HJ, Seo JC, Park JB, Lee HJ. Revised STandards for reporting interventions in clinical trials of acupuncture (STRICTA): extending the CONSORT statement. Korean J Acupunct. 2010;27:1–23. Lee HS, Cha SJ, Park HJ, Seo JC, Park JB, Lee HJ. Revised STandards for reporting interventions in clinical trials of acupuncture (STRICTA): extending the CONSORT statement. Korean J Acupunct. 2010;27:1–23.
42.
go back to reference Di Blasi Z. Kleijnen J. Context effects. Powerful therapies or methodological bias? Eval Health Prof. 2003;26:166–79.CrossRefPubMed Di Blasi Z. Kleijnen J. Context effects. Powerful therapies or methodological bias? Eval Health Prof. 2003;26:166–79.CrossRefPubMed
43.
go back to reference Baer H. The emergence of integrative medicine in Australia: the growing interest of biomedicine and nursing in complementary medicine in a southern developed society. Med Anthropol Q. 2008;22:52–66.CrossRefPubMed Baer H. The emergence of integrative medicine in Australia: the growing interest of biomedicine and nursing in complementary medicine in a southern developed society. Med Anthropol Q. 2008;22:52–66.CrossRefPubMed
44.
go back to reference Lu L, Liao M, Zeng J, He J. Quality of reporting and its correlates among randomized controlled trials on acupuncture for cancer pain: application of the CONSORT 2010 statement and STRICTA. Expert Rev Anticancer Ther. 2013;13:489–98.CrossRefPubMed Lu L, Liao M, Zeng J, He J. Quality of reporting and its correlates among randomized controlled trials on acupuncture for cancer pain: application of the CONSORT 2010 statement and STRICTA. Expert Rev Anticancer Ther. 2013;13:489–98.CrossRefPubMed
46.
go back to reference Lu L, Zeng J, Chen Y. Quality of reporting in randomized controlled trials conducted in China on the treatment of cancer pain. Expert Rev Anticancer Ther. 2011;11:871–7.CrossRefPubMed Lu L, Zeng J, Chen Y. Quality of reporting in randomized controlled trials conducted in China on the treatment of cancer pain. Expert Rev Anticancer Ther. 2011;11:871–7.CrossRefPubMed
47.
go back to reference Chen B, Liu J, Zhang C, Li M. A retrospective survey of quality of reporting on randomized controlled trials of metformin for polycystic ovary syndrome. Trials. 2014;15:128.CrossRefPubMedPubMedCentral Chen B, Liu J, Zhang C, Li M. A retrospective survey of quality of reporting on randomized controlled trials of metformin for polycystic ovary syndrome. Trials. 2014;15:128.CrossRefPubMedPubMedCentral
48.
go back to reference Chen B, Zhao X, Guo Y, Chen Z, Bai Y, Wang Z, Wang Y. Assessing the quality of reports about randomized controlled trials of acupuncture treatment on diabetic peripheral neuropathy. PLoS One. 2012;7:e38461.CrossRef Chen B, Zhao X, Guo Y, Chen Z, Bai Y, Wang Z, Wang Y. Assessing the quality of reports about randomized controlled trials of acupuncture treatment on diabetic peripheral neuropathy. PLoS One. 2012;7:e38461.CrossRef
Metadata
Title
Assessing the quality of reports about randomized controlled trials of scalp acupuncture combined with another treatment for stroke
Authors
Young-Nim You
Myung-Rae Cho
Jae-Hong Kim
Ju-Hyung Park
Gwang-Cheon Park
Min-Yeong Song
Jin-Bong Choi
Jae-Young Han
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Complementary Medicine and Therapies / Issue 1/2017
Electronic ISSN: 2662-7671
DOI
https://doi.org/10.1186/s12906-017-1950-6

Other articles of this Issue 1/2017

BMC Complementary Medicine and Therapies 1/2017 Go to the issue