Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2021

Open Access 01-12-2021 | Research article

Quality assessment tools used in systematic reviews of in vitro studies: A systematic review

Authors: Linh Tran, Dao Ngoc Hien Tam, Abdelrahman Elshafay, Thao Dang, Kenji Hirayama, Nguyen Tien Huy

Published in: BMC Medical Research Methodology | Issue 1/2021

Login to get access

Abstract

Background

Systematic reviews (SRs) and meta-analyses (MAs) are commonly conducted to evaluate and summarize medical literature. This is especially useful in assessing in vitro studies for consistency. Our study aims to systematically review all available quality assessment (QA) tools employed on in vitro SRs/MAs.

Method

A search on four databases, including PubMed, Scopus, Virtual Health Library and Web of Science, was conducted from 2006 to 2020. The available SRs/MAs of in vitro studies were evaluated. DARE tool was applied to assess the risk of bias of included articles. Our protocol was developed and uploaded to ResearchGate in June 2016.

Results

Our findings reported an increasing trend in publication of in vitro SRs/MAs from 2007 to 2020. Among the 244 included SRs/MAs, 126 articles (51.6%) had conducted the QA procedure. Overall, 51 QA tools were identified; 26 of them (51%) were developed by the authors specifically, whereas 25 (49%) were pre-constructed tools. SRs/MAs in dentistry frequently had their own QA tool developed by the authors, while SRs/MAs in other topics applied various QA tools. Many pre-structured tools in these in vitro SRs/MAs were modified from QA tools of in vivo or clinical trials, therefore, they had various criteria.

Conclusion

Many different QA tools currently exist in the literature; however, none cover all critical aspects of in vitro SRs/MAs. There is a need for a comprehensive guideline to ensure the quality of SR/MA due to their precise nature.
Appendix
Available only for authorised users
Literature
1.
go back to reference Manchikanti L. Evidence-based medicine, systematic reviews, and guidelines in interventional pain management, part I: introduction and general considerations. Pain Physician. 2008;11(2):161–86.CrossRef Manchikanti L. Evidence-based medicine, systematic reviews, and guidelines in interventional pain management, part I: introduction and general considerations. Pain Physician. 2008;11(2):161–86.CrossRef
6.
go back to reference Ritskes-Hoitinga M, Leenaars M, Avey M, Rovers M, Scholten R. Systematic reviews of preclinical animal studies can make significant contributions to health care and more transparent translational medicine. Cochrane Database Syst Rev. 2014;3:ED000078. Ritskes-Hoitinga M, Leenaars M, Avey M, Rovers M, Scholten R. Systematic reviews of preclinical animal studies can make significant contributions to health care and more transparent translational medicine. Cochrane Database Syst Rev. 2014;3:ED000078.
10.
go back to reference Shamliyan T, Kane RL, Jansen S. Quality of systematic reviews of observational nontherapeutic studies. Prev Chronic Dis. 2010;7(6): A133. PMID: 20950540; PMCID: PMC2995597. Shamliyan T, Kane RL, Jansen S. Quality of systematic reviews of observational nontherapeutic studies. Prev Chronic Dis. 2010;7(6): A133. PMID: 20950540; PMCID: PMC2995597.
11.
go back to reference Wong WC, Cheung CS, Hart GJ. Development of a quality assessment tool for systematic reviews of observational studies (QATSO) of HIV prevalence in men having sex with men and associated risk behaviours. Emerg Themes Epidemiol 2008;5(23). https://doi.org/10.1186/1742-7622-5-23. Wong WC, Cheung CS, Hart GJ. Development of a quality assessment tool for systematic reviews of observational studies (QATSO) of HIV prevalence in men having sex with men and associated risk behaviours. Emerg Themes Epidemiol 2008;5(23). https://​doi.​org/​10.​1186/​1742-7622-5-23.
13.
23.
go back to reference Arilla FV, Yeung M, Bell K, Rahnemai-Azar AA, Rothrauff BB, Fu FH, et al. Experimental Execution of the Simulated Pivot-Shift Test: A Systematic Review of Techniques. Arthroscopy. 2015;31(12):2445–54 e2.CrossRef Arilla FV, Yeung M, Bell K, Rahnemai-Azar AA, Rothrauff BB, Fu FH, et al. Experimental Execution of the Simulated Pivot-Shift Test: A Systematic Review of Techniques. Arthroscopy. 2015;31(12):2445–54 e2.CrossRef
25.
go back to reference Golbach LA, Portelli LA, Savelkoul HF, Terwel SR, Kuster N, de Vries RB, et al. Calcium homeostasis and low-frequency magnetic and electric field exposure: A systematic review and meta-analysis of in vitro studies. Environ Int. 2016;92–93:695–706.CrossRef Golbach LA, Portelli LA, Savelkoul HF, Terwel SR, Kuster N, de Vries RB, et al. Calcium homeostasis and low-frequency magnetic and electric field exposure: A systematic review and meta-analysis of in vitro studies. Environ Int. 2016;92–93:695–706.CrossRef
29.
go back to reference Ferrúa CP, Centeno EG, Rosa LC, Amaral CC, Severo RF, Sarkis-Onofre R, et al. How has dental pulp stem cells isolation been conducted? A scoping review. Braz Oral Res. 2017;31:e87.CrossRef Ferrúa CP, Centeno EG, Rosa LC, Amaral CC, Severo RF, Sarkis-Onofre R, et al. How has dental pulp stem cells isolation been conducted? A scoping review. Braz Oral Res. 2017;31:e87.CrossRef
35.
go back to reference Samiei M, Shirazi S, Azar FP, Fathifar Z, Ghojazadeh M, Alipour M. The Effect of Different Mixing Methods on the Properties of Calcium-enriched Mixture Cement: A Systematic Review of in Vitro Studies. Iran Endod J. 2019;14(4):240–6. Samiei M, Shirazi S, Azar FP, Fathifar Z, Ghojazadeh M, Alipour M. The Effect of Different Mixing Methods on the Properties of Calcium-enriched Mixture Cement: A Systematic Review of in Vitro Studies. Iran Endod J. 2019;14(4):240–6.
40.
go back to reference Özcan M, Höhn J, de Araújo GM, Moura DD, Souza R. Influence of testing parameters on the load-bearing capacity of prosthetic materials used for fixed dental prosthesis: A systematic review and meta-analysis. Braz Dental Sci. 2018;21(4):470–90.CrossRef Özcan M, Höhn J, de Araújo GM, Moura DD, Souza R. Influence of testing parameters on the load-bearing capacity of prosthetic materials used for fixed dental prosthesis: A systematic review and meta-analysis. Braz Dental Sci. 2018;21(4):470–90.CrossRef
41.
go back to reference Khaledi A, Meskini M. A systematic review of the effects of Satureja khuzestanica Jamzad and Zataria multiflora Boiss against Pseudomonas aeruginosa. Iran J Med Sci. 2020;45(2):83.PubMed Khaledi A, Meskini M. A systematic review of the effects of Satureja khuzestanica Jamzad and Zataria multiflora Boiss against Pseudomonas aeruginosa. Iran J Med Sci. 2020;45(2):83.PubMed
42.
go back to reference Zhao S, Arnold M, Ma S, Abel R, Cobb J, Hansen U, et al. Standardizing compression testing for measuring the stiffness of human bone. Bone Joint Res. 2018;7(8):524–38.CrossRef Zhao S, Arnold M, Ma S, Abel R, Cobb J, Hansen U, et al. Standardizing compression testing for measuring the stiffness of human bone. Bone Joint Res. 2018;7(8):524–38.CrossRef
44.
go back to reference Wehner C, Lettner S, Moritz A, Andrukhov O, Rausch-Fan X. Effect of bisphosphonate treatment of titanium surfaces on alkaline phosphatase activity in osteoblasts: a systematic review and meta-analysis. BMC Oral Health. 2020;20:1–13.CrossRef Wehner C, Lettner S, Moritz A, Andrukhov O, Rausch-Fan X. Effect of bisphosphonate treatment of titanium surfaces on alkaline phosphatase activity in osteoblasts: a systematic review and meta-analysis. BMC Oral Health. 2020;20:1–13.CrossRef
46.
go back to reference Mirab Samiee S, Rahnomaye Farzami M, Aliasgharpour M, Rafie M, Entekhabie B, Sabzavie F. An overview of a new approach in evaluation, verification and validity of in vitro diagnosis (IVDs) performance in Iran. Iran J Public Health. 2013;42(1):107–9.PubMedPubMedCentral Mirab Samiee S, Rahnomaye Farzami M, Aliasgharpour M, Rafie M, Entekhabie B, Sabzavie F. An overview of a new approach in evaluation, verification and validity of in vitro diagnosis (IVDs) performance in Iran. Iran J Public Health. 2013;42(1):107–9.PubMedPubMedCentral
47.
go back to reference Warner ACI. Criteria for establishing the validity of in vitro studies with rumen micro-organisms in so-called artificial rumen systems. Microbiology. 1956;14:733–48. Warner ACI. Criteria for establishing the validity of in vitro studies with rumen micro-organisms in so-called artificial rumen systems. Microbiology. 1956;14:733–48.
54.
go back to reference J.P.T. Higgins SGE. Cochrane Handbook for Systematic Reviews of Interventions. 1 ed. Chichester, England, Hoboken: Wiley-Blackwell; 2008. J.P.T. Higgins SGE. Cochrane Handbook for Systematic Reviews of Interventions. 1 ed. Chichester, England, Hoboken: Wiley-Blackwell; 2008.
61.
go back to reference Nazeam J, Mohammed EZ, Raafat M, Houssein M, Elkafoury A, Hamdy D, et al. Based on principles and insights of COVID-19 epidemiology, genome sequencing, and pathogenesis: retrospective analysis of Sinigrin and Prolixin (RX) (Fluphenazine) provides off-label drug candidates. SLAS Discovery. 2020;25(10):1123–40. https://doi.org/10.1177/2472555220950236. Nazeam J, Mohammed EZ, Raafat M, Houssein M, Elkafoury A, Hamdy D, et al. Based on principles and insights of COVID-19 epidemiology, genome sequencing, and pathogenesis: retrospective analysis of Sinigrin and Prolixin (RX) (Fluphenazine) provides off-label drug candidates. SLAS Discovery. 2020;25(10):1123–40. https://​doi.​org/​10.​1177/​2472555220950236​.
65.
go back to reference Baumgartner S, Koletsi D, Verna C, Eliades T. The effect of enamel sandblasting on enhancing bond strength of orthodontic brackets: A systematic review and meta-analysis. J Adhes Dent. 2017;19(6):463–73.PubMed Baumgartner S, Koletsi D, Verna C, Eliades T. The effect of enamel sandblasting on enhancing bond strength of orthodontic brackets: A systematic review and meta-analysis. J Adhes Dent. 2017;19(6):463–73.PubMed
70.
go back to reference Silveira RG, Ferrúa CP, do Amaral CC, Garcia TF, de Souza KB, Nedel F. MicroRNAs expressed in neuronal differentiation and their associated pathways: Systematic review and bioinformatics analysis. Brain Res Bull. 2020;157:140–8.CrossRef Silveira RG, Ferrúa CP, do Amaral CC, Garcia TF, de Souza KB, Nedel F. MicroRNAs expressed in neuronal differentiation and their associated pathways: Systematic review and bioinformatics analysis. Brain Res Bull. 2020;157:140–8.CrossRef
79.
go back to reference Samuel GO, Hoffmann S, Wright RA, Lalu MM, Patlewicz G, Becker RA, et al. Guidance on assessing the methodological and reporting quality of toxicologically relevant studies: A scoping review. Environ Int. 2016;92–93:630–46.CrossRef Samuel GO, Hoffmann S, Wright RA, Lalu MM, Patlewicz G, Becker RA, et al. Guidance on assessing the methodological and reporting quality of toxicologically relevant studies: A scoping review. Environ Int. 2016;92–93:630–46.CrossRef
Metadata
Title
Quality assessment tools used in systematic reviews of in vitro studies: A systematic review
Authors
Linh Tran
Dao Ngoc Hien Tam
Abdelrahman Elshafay
Thao Dang
Kenji Hirayama
Nguyen Tien Huy
Publication date
01-12-2021
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2021
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-021-01295-w

Other articles of this Issue 1/2021

BMC Medical Research Methodology 1/2021 Go to the issue