Skip to main content
Top
Published in: Systematic Reviews 1/2017

Open Access 01-12-2017 | Research

Are child-centric aspects in newborn and child health systematic review and meta-analysis protocols and reports adequately reported?—two systematic reviews

Authors: Mufiza Farid-Kapadia, Kariym C. Joachim, Chrinna Balasingham, April Clyburne-Sherin, Martin Offringa

Published in: Systematic Reviews | Issue 1/2017

Login to get access

Abstract

Background

Evidence suggests that newborn and child health systematic reviews and meta-analyses exhibit poor quality in reporting. The “Preferred Reporting Items in Systematic Review and Meta-Analysis” (PRISMA) and PRISMA-Protocols (PRISMA-P) checklists have been developed to improve the reporting of systematic review results and protocols, respectively. We aimed to evaluate the clarity and transparency in reporting of child-centric items in child health systematic reviews (SRs) and SR protocols and to identify areas where reporting could be strengthened.

Methods

Two preliminary lists of potential child-centric reporting items were used to examine current reporting. The Cochrane, DARE, MEDLINE, and EMBASE libraries were searched from 2010 to 2014 for systematic reviews that included children. Each report and protocol that met the inclusion criteria had their quality of reporting assessed by their reporting of child-centric items. Quality of reporting was assessed per whether one third, one to two thirds, or more than two thirds of papers complied with potential child-centric potential modifications/extensions to PRISMA and were analyzed by the following: (i) paper type (i.e., report vs. protocol), (ii) publication type (i.e., Cochrane vs. non-Cochrane), and (iii) population type (i.e., child-only vs. mixed populations vs. family/maternal).

Results

Of the 414 eligible articles, 248 reports and 76 protocols were included. In 21 of 24 potential SR reporting items and 13 of 14 potential SR protocol reporting items, less than two thirds of papers met the child-centric reporting item requirements. Mixed population studies displayed significantly poorer reporting in comparison to child-only and family/maternal intervention studies for 11 potential SR reporting items (p < 0.05) and five potential SR protocol items (p < 0.05). When comparing non-Cochrane to Cochrane reports and protocols, five items in both lists were found to perform significantly poorer in non-Cochrane reports (p < 0.05). Significant differences in reporting quality were found in three of 14 items shared between the potential SR reporting items and potential SR protocol reporting items (p < 0.05).

Conclusions

Newborn and child health systematic reviews and meta-analyses exhibit incomplete reporting, thereby hindering prudent decision-making by healthcare providers and policy makers. These results provide a rationale for the implementation of child-centric extensions and modifications to current PRISMA and PRISMA-P, such as to improve reporting in this population.
Appendix
Available only for authorised users
Literature
1.
go back to reference OCEBM Levels of evidence working group. The Oxford 2011 Levels of Evidence. Oxford Centre for Evidence-Based Medicine; 2011. OCEBM Levels of evidence working group. The Oxford 2011 Levels of Evidence. Oxford Centre for Evidence-Based Medicine; 2011.
2.
go back to reference Zorzela L, Golder S, Liu Y, Pilkington K, Hartling L, Joffe A, Loke Y, Vohra S. Quality of reporting in systematic reviews of adverse events: systematic review. BMJ. 2014;348:f7668.CrossRefPubMedPubMedCentral Zorzela L, Golder S, Liu Y, Pilkington K, Hartling L, Joffe A, Loke Y, Vohra S. Quality of reporting in systematic reviews of adverse events: systematic review. BMJ. 2014;348:f7668.CrossRefPubMedPubMedCentral
3.
go back to reference Bow S, Klassen J, Chisholm A, Tjosvold L, Thomson D, Klassen TP, Moher D, Hartling L. A descriptive analysis of child-relevant systematic reviews in the Cochrane Database of Systematic Reviews. BMC Pediatr. 2010;10:34.CrossRefPubMedPubMedCentral Bow S, Klassen J, Chisholm A, Tjosvold L, Thomson D, Klassen TP, Moher D, Hartling L. A descriptive analysis of child-relevant systematic reviews in the Cochrane Database of Systematic Reviews. BMC Pediatr. 2010;10:34.CrossRefPubMedPubMedCentral
4.
go back to reference Hutton B, Salanti G, Caldwell DM, Chaimani A, Schmid CH, Cameron C, Ioannidis JPA, Straus S, Thorlund K, Jansen JP, Mulrow C, Catalá-López F, Gøtzsche PC, Dickersin K, Boutron I, Altman DG, Moher D. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med. 2015;162:777–84.CrossRefPubMed Hutton B, Salanti G, Caldwell DM, Chaimani A, Schmid CH, Cameron C, Ioannidis JPA, Straus S, Thorlund K, Jansen JP, Mulrow C, Catalá-López F, Gøtzsche PC, Dickersin K, Boutron I, Altman DG, Moher D. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med. 2015;162:777–84.CrossRefPubMed
5.
go back to reference Yusuf S. Meta-analysis of randomized trials: looking back and looking ahead. Control Clin Trials. 1997;18:594–601 [Eighth International Symposium on Long-Term Clinical Trials].CrossRefPubMed Yusuf S. Meta-analysis of randomized trials: looking back and looking ahead. Control Clin Trials. 1997;18:594–601 [Eighth International Symposium on Long-Term Clinical Trials].CrossRefPubMed
6.
go back to reference Klassen TP, Hartling L, Craig JC, Offringa M. Children Are Not just small adults: the urgent need for high-quality trial evidence in children. PLoS Med. 2008;5:e172.CrossRefPubMedPubMedCentral Klassen TP, Hartling L, Craig JC, Offringa M. Children Are Not just small adults: the urgent need for high-quality trial evidence in children. PLoS Med. 2008;5:e172.CrossRefPubMedPubMedCentral
7.
go back to reference Martinez-Castaldi C, Silverstein M, Bauchner H. Child versus adult research: the gap in high-quality study design. Pediatrics. 2008;122:52–7.CrossRefPubMed Martinez-Castaldi C, Silverstein M, Bauchner H. Child versus adult research: the gap in high-quality study design. Pediatrics. 2008;122:52–7.CrossRefPubMed
9.
go back to reference Gagnier JJ, Kellam PJ. Reporting and methodological quality of systematic reviews in the orthopaedic literature. J Bone Joint Surg Am. 2013;95:e771–7.CrossRefPubMed Gagnier JJ, Kellam PJ. Reporting and methodological quality of systematic reviews in the orthopaedic literature. J Bone Joint Surg Am. 2013;95:e771–7.CrossRefPubMed
10.
go back to reference Pölkki T, Kanste O, Kääriäinen M, Elo S, Kyngäs H. The methodological quality of systematic reviews published in high-impact nursing journals: a review of the literature. J Clin Nurs. 2014;23:315–32.CrossRefPubMed Pölkki T, Kanste O, Kääriäinen M, Elo S, Kyngäs H. The methodological quality of systematic reviews published in high-impact nursing journals: a review of the literature. J Clin Nurs. 2014;23:315–32.CrossRefPubMed
11.
go back to reference Jadad AR, Moher M, Browman GP, Booker L, Sigouin C, Fuentes M, Stevens R. Systematic reviews and meta-analyses on treatment of asthma: critical evaluation. BMJ. 2000;320:537–40.CrossRefPubMedPubMedCentral Jadad AR, Moher M, Browman GP, Booker L, Sigouin C, Fuentes M, Stevens R. Systematic reviews and meta-analyses on treatment of asthma: critical evaluation. BMJ. 2000;320:537–40.CrossRefPubMedPubMedCentral
12.
go back to reference Liu Y, Zhang R, Huang J, Zhao X, Liu D, Sun W, Mai Y, Zhang P, Wang Y, Cao H, Hu YK. Reporting quality of systematic reviews/meta-analyses of acupuncture. PLoS ONE. 2014;9:e113172.CrossRefPubMedPubMedCentral Liu Y, Zhang R, Huang J, Zhao X, Liu D, Sun W, Mai Y, Zhang P, Wang Y, Cao H, Hu YK. Reporting quality of systematic reviews/meta-analyses of acupuncture. PLoS ONE. 2014;9:e113172.CrossRefPubMedPubMedCentral
13.
go back to reference Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF. Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Quality of Reporting of Meta-analyses. Lancet. 1999;354:1896–900.CrossRefPubMed Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF. Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Quality of Reporting of Meta-analyses. Lancet. 1999;354:1896–900.CrossRefPubMed
14.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151:264–9.CrossRefPubMed Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151:264–9.CrossRefPubMed
15.
go back to reference Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1.CrossRefPubMedPubMedCentral Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1.CrossRefPubMedPubMedCentral
16.
go back to reference Panic N, Leoncini E, de Belvis G, Ricciardi W, Boccia S. Evaluation of the endorsement of the preferred reporting items for Systematic Reviews and Meta-Analysis (PRISMA) Statement on the quality of published systematic review and meta-analyses. PLoS ONE. 2013;8:e83138.CrossRefPubMedPubMedCentral Panic N, Leoncini E, de Belvis G, Ricciardi W, Boccia S. Evaluation of the endorsement of the preferred reporting items for Systematic Reviews and Meta-Analysis (PRISMA) Statement on the quality of published systematic review and meta-analyses. PLoS ONE. 2013;8:e83138.CrossRefPubMedPubMedCentral
17.
go back to reference Tunis AS, McInnes MDF, Hanna R, Esmail K. Association of study quality with completeness of reporting: have completeness of reporting and quality of systematic reviews and meta-analyses in major radiology journals changed since publication of the PRISMA statement? Radiology. 2013;269:413–26.CrossRefPubMed Tunis AS, McInnes MDF, Hanna R, Esmail K. Association of study quality with completeness of reporting: have completeness of reporting and quality of systematic reviews and meta-analyses in major radiology journals changed since publication of the PRISMA statement? Radiology. 2013;269:413–26.CrossRefPubMed
18.
go back to reference Lundh A, Knijnenburg SL, Jørgensen AW, van Dalen EC, Kremer LCM. Quality of systematic reviews in pediatric oncology—a systematic review. Cancer Treat Rev. 2009;35:645–52.CrossRefPubMed Lundh A, Knijnenburg SL, Jørgensen AW, van Dalen EC, Kremer LCM. Quality of systematic reviews in pediatric oncology—a systematic review. Cancer Treat Rev. 2009;35:645–52.CrossRefPubMed
19.
go back to reference Braga LH, Pemberton J, DeMaria J, Lorenzo AJ. Methodological concerns and quality appraisal of contemporary systematic reviews and meta-analyses in pediatric urology. J Urol. 2011;186:266–72.CrossRefPubMed Braga LH, Pemberton J, DeMaria J, Lorenzo AJ. Methodological concerns and quality appraisal of contemporary systematic reviews and meta-analyses in pediatric urology. J Urol. 2011;186:266–72.CrossRefPubMed
20.
go back to reference Cramer K, Wiebe N, Moyer V, Hartling L, Williams K, Swingler G, Klassen TP. Children in reviews: methodological issues in child-relevant evidence syntheses. BMC Pediatr. 2005;5:38.CrossRefPubMedPubMedCentral Cramer K, Wiebe N, Moyer V, Hartling L, Williams K, Swingler G, Klassen TP. Children in reviews: methodological issues in child-relevant evidence syntheses. BMC Pediatr. 2005;5:38.CrossRefPubMedPubMedCentral
21.
go back to reference Lathyris D, Panagiotou OA, Baltogianni M, Ioannidis JPA, Contopoulos-Ioannidis DG. Safety of medical interventions in children versus adults. Pediatrics. 2014;133:e666–73.CrossRefPubMed Lathyris D, Panagiotou OA, Baltogianni M, Ioannidis JPA, Contopoulos-Ioannidis DG. Safety of medical interventions in children versus adults. Pediatrics. 2014;133:e666–73.CrossRefPubMed
22.
go back to reference Ginsberg G, Hattis D, Sonawane B, Russ A, Banati P, Kozlak M, Smolenski S, Goble R. Evaluation of child/adult pharmacokinetic differences from a database derived from the therapeutic drug literature. Toxicol Sci. 2002;66:185–200.CrossRefPubMed Ginsberg G, Hattis D, Sonawane B, Russ A, Banati P, Kozlak M, Smolenski S, Goble R. Evaluation of child/adult pharmacokinetic differences from a database derived from the therapeutic drug literature. Toxicol Sci. 2002;66:185–200.CrossRefPubMed
23.
go back to reference Contopoulos-Ioannidis DG, Baltogianni MS, Ioannidis JPA. Comparative effectiveness of medical interventions in adults versus children. J Pediatr. 2010;157:322–330.e17.CrossRefPubMed Contopoulos-Ioannidis DG, Baltogianni MS, Ioannidis JPA. Comparative effectiveness of medical interventions in adults versus children. J Pediatr. 2010;157:322–330.e17.CrossRefPubMed
24.
go back to reference Contopoulos-Ioannidis DG, Seto I, Hamm MP, Thomson D, Hartling L, Ioannidis JPA, Curtis S, Constantin E, Batmanabane G, Klassen T, Williams K. Empirical evaluation of age groups and age-subgroup analyses in pediatric randomized trials and pediatric meta-analyses. Pediatrics. 2012;129 Suppl 3:S161–84.CrossRefPubMed Contopoulos-Ioannidis DG, Seto I, Hamm MP, Thomson D, Hartling L, Ioannidis JPA, Curtis S, Constantin E, Batmanabane G, Klassen T, Williams K. Empirical evaluation of age groups and age-subgroup analyses in pediatric randomized trials and pediatric meta-analyses. Pediatrics. 2012;129 Suppl 3:S161–84.CrossRefPubMed
25.
go back to reference Haider BA, Bhutta ZA. Neonatal vitamin A supplementation for the prevention of mortality and morbidity in term neonates in developing countries. Cochrane Database Syst Rev. 2011;5(10):CD006980. Haider BA, Bhutta ZA. Neonatal vitamin A supplementation for the prevention of mortality and morbidity in term neonates in developing countries. Cochrane Database Syst Rev. 2011;5(10):CD006980.
26.
go back to reference Weimer K, Gulewitsch MD, Schlarb AA, Schwille-Kiuntke J, Klosterhalfen S, Enck P. Placebo effects in children: a review. Pediatr Res. 2013;74:96–102.CrossRefPubMed Weimer K, Gulewitsch MD, Schlarb AA, Schwille-Kiuntke J, Klosterhalfen S, Enck P. Placebo effects in children: a review. Pediatr Res. 2013;74:96–102.CrossRefPubMed
27.
go back to reference Sinha I, Jones L, Smyth RL, Williamson PR. A systematic review of studies that aim to determine which outcomes to measure in clinical trials in children. PLoS Med. 2008;5:e96.CrossRefPubMedPubMedCentral Sinha I, Jones L, Smyth RL, Williamson PR. A systematic review of studies that aim to determine which outcomes to measure in clinical trials in children. PLoS Med. 2008;5:e96.CrossRefPubMedPubMedCentral
28.
29.
go back to reference Clyburne-Sherin AV, Thurairajah P, Kapadia MZ, Sampson M, Chan WW, Offringa M. Recommendations and evidence for reporting items in pediatric clinical trial protocols and reports: two systematic reviews. Trials. 2015;16:417.CrossRefPubMedPubMedCentral Clyburne-Sherin AV, Thurairajah P, Kapadia MZ, Sampson M, Chan WW, Offringa M. Recommendations and evidence for reporting items in pediatric clinical trial protocols and reports: two systematic reviews. Trials. 2015;16:417.CrossRefPubMedPubMedCentral
30.
go back to reference Farid-Kapadia M, Askie L, Hartling L, Contopoulos-Ioannidis D, Bhutta ZA, Soll R, Moher D, Offringa M. Do systematic reviews on pediatric topics need. special methodological considerations? in press. Farid-Kapadia M, Askie L, Hartling L, Contopoulos-Ioannidis D, Bhutta ZA, Soll R, Moher D, Offringa M. Do systematic reviews on pediatric topics need. special methodological considerations? in press.
31.
go back to reference Kapadia MZ, Askie L, Hartling L, Contopoulos-Ioannidis D, Bhutta ZA, Soll R, Moher D, Offringa M. PRISMA-Children (C) and PRISMA-Protocol for Children (P-C) Extensions: a study protocol for the development of guidelines for the conduct and reporting of systematic reviews and meta-analyses of newborn and child health research. BMJ Open. 2016;6:e010270.CrossRefPubMedPubMedCentral Kapadia MZ, Askie L, Hartling L, Contopoulos-Ioannidis D, Bhutta ZA, Soll R, Moher D, Offringa M. PRISMA-Children (C) and PRISMA-Protocol for Children (P-C) Extensions: a study protocol for the development of guidelines for the conduct and reporting of systematic reviews and meta-analyses of newborn and child health research. BMJ Open. 2016;6:e010270.CrossRefPubMedPubMedCentral
35.
go back to reference Boluyt N, Tjosvold L, Lefebvre C, Klassen TP, Offringa M. Usefulness of systematic review search strategies in finding child health systematic reviews in MEDLINE. Arch Pediatr Adolesc Med. 2008;162:111–6.CrossRefPubMed Boluyt N, Tjosvold L, Lefebvre C, Klassen TP, Offringa M. Usefulness of systematic review search strategies in finding child health systematic reviews in MEDLINE. Arch Pediatr Adolesc Med. 2008;162:111–6.CrossRefPubMed
36.
37.
go back to reference Wilson EB. Probable inference, the law of succession, and statistical inference. J Am Stat Assoc. 1927;22:209–12.CrossRef Wilson EB. Probable inference, the law of succession, and statistical inference. J Am Stat Assoc. 1927;22:209–12.CrossRef
38.
go back to reference Newcombe RG. Two-sided confidence intervals for the single proportion: comparison of seven methods. Stat Med. 1998;17:857–72.CrossRefPubMed Newcombe RG. Two-sided confidence intervals for the single proportion: comparison of seven methods. Stat Med. 1998;17:857–72.CrossRefPubMed
39.
go back to reference Page MJ, Shamseer L, Altman DG, Tetzlaff J, Sampson M, Tricco AC, Catalá-López F, Li L, Reid EK, Sarkis-Onofre R, Moher D. Epidemiology and reporting characteristics of systematic reviews of biomedical research: a cross-sectional study. PLoS Med. 2016;13:e1002028.CrossRefPubMedPubMedCentral Page MJ, Shamseer L, Altman DG, Tetzlaff J, Sampson M, Tricco AC, Catalá-López F, Li L, Reid EK, Sarkis-Onofre R, Moher D. Epidemiology and reporting characteristics of systematic reviews of biomedical research: a cross-sectional study. PLoS Med. 2016;13:e1002028.CrossRefPubMedPubMedCentral
40.
go back to reference Beller EM, Glasziou PP, Hopewell S, Altman DG. Reporting of effect direction and size in abstracts of systematic reviews. JAMA. 2011;306:1981–2.CrossRefPubMed Beller EM, Glasziou PP, Hopewell S, Altman DG. Reporting of effect direction and size in abstracts of systematic reviews. JAMA. 2011;306:1981–2.CrossRefPubMed
41.
go back to reference Gogia S, Sachdev HS. Vitamin A supplementation for the prevention of morbidity and mortality in infants six months of age or less. Cochrane Database Syst Rev. 2011;5(10):CD007480. Gogia S, Sachdev HS. Vitamin A supplementation for the prevention of morbidity and mortality in infants six months of age or less. Cochrane Database Syst Rev. 2011;5(10):CD007480.
43.
go back to reference Fleming PS, Seehra J, Polychronopoulou A, Fedorowicz Z, Pandis N. A PRISMA assessment of the reporting quality of systematic reviews in orthodontics. Angle Orthod. 2013;83:158–63.CrossRefPubMed Fleming PS, Seehra J, Polychronopoulou A, Fedorowicz Z, Pandis N. A PRISMA assessment of the reporting quality of systematic reviews in orthodontics. Angle Orthod. 2013;83:158–63.CrossRefPubMed
44.
go back to reference Peters JPM, Hooft L, Grolman W, Stegeman I. Reporting quality of systematic reviews and meta-analyses of otorhinolaryngologic articles based on the PRISMA Statement. PLoS ONE. 2015;10:e0136540.CrossRefPubMedPubMedCentral Peters JPM, Hooft L, Grolman W, Stegeman I. Reporting quality of systematic reviews and meta-analyses of otorhinolaryngologic articles based on the PRISMA Statement. PLoS ONE. 2015;10:e0136540.CrossRefPubMedPubMedCentral
45.
go back to reference Anne M, Moseley MRE. Cochrane reviews used more rigorous methods than non-Cochrane reviews: survey of systematic reviews in physiotherapy. J Clin Epidemiol. 2009;62:1021–30.CrossRef Anne M, Moseley MRE. Cochrane reviews used more rigorous methods than non-Cochrane reviews: survey of systematic reviews in physiotherapy. J Clin Epidemiol. 2009;62:1021–30.CrossRef
46.
go back to reference Smaïl-Faugeron V, Fron-Chabouis H, Courson F. Methodological quality and implications for practice of systematic Cochrane reviews in pediatric oral health: a critical assessment. BMC Oral Health. 2014;14:1–7.CrossRef Smaïl-Faugeron V, Fron-Chabouis H, Courson F. Methodological quality and implications for practice of systematic Cochrane reviews in pediatric oral health: a critical assessment. BMC Oral Health. 2014;14:1–7.CrossRef
47.
go back to reference Ijaz S, Croucher RE, Marinho VCC. Systematic reviews of topical fluorides for dental caries: a review of reporting practice. Caries Res. 2010;44:579–92.CrossRefPubMed Ijaz S, Croucher RE, Marinho VCC. Systematic reviews of topical fluorides for dental caries: a review of reporting practice. Caries Res. 2010;44:579–92.CrossRefPubMed
Metadata
Title
Are child-centric aspects in newborn and child health systematic review and meta-analysis protocols and reports adequately reported?—two systematic reviews
Authors
Mufiza Farid-Kapadia
Kariym C. Joachim
Chrinna Balasingham
April Clyburne-Sherin
Martin Offringa
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2017
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/s13643-017-0423-9

Other articles of this Issue 1/2017

Systematic Reviews 1/2017 Go to the issue