Skip to main content
Top
Published in: Emerging Themes in Epidemiology 1/2008

Open Access 01-12-2008 | Analytic perspective

Development of a quality assessment tool for systematic reviews of observational studies (QATSO) of HIV prevalence in men having sex with men and associated risk behaviours

Authors: William CW Wong, Catherine SK Cheung, Graham J Hart

Published in: Emerging Themes in Epidemiology | Issue 1/2008

Login to get access

Abstract

Background

Systematic reviews based on the critical appraisal of observational and analytic studies on HIV prevalence and risk factors for HIV transmission among men having sex with men are very useful for health care decisions and planning. Such appraisal is particularly difficult, however, as the quality assessment tools available for use with observational and analytic studies are poorly established.

Methods

We reviewed the existing quality assessment tools for systematic reviews of observational studies and developed a concise quality assessment checklist to help standardise decisions regarding the quality of studies, with careful consideration of issues such as external and internal validity.

Results

A pilot version of the checklist was developed based on epidemiological principles, reviews of study designs, and existing checklists for the assessment of observational studies. The Quality Assessment Tool for Systematic Reviews of Observational Studies (QATSO) Score consists of five items: External validity (1 item), reporting (2 items), bias (1 item) and confounding factors (1 item). Expert opinions were sought and it was tested on manuscripts that fulfil the inclusion criteria of a systematic review. Like all assessment scales, QATSO may oversimplify and generalise information yet it is inclusive, simple and practical to use, and allows comparability between papers.

Conclusion

A specific tool that allows researchers to appraise and guide study quality of observational studies is developed and can be modified for similar studies in the future.
Appendix
Available only for authorised users
Literature
2.
go back to reference Frankis J, Flowers P: Men who have sex with men (MSM) in public sex environments (PSES): a systematic review of quantitative literature. AIDS Care. 2005, 17: 273-88. 10.1080/09540120412331299799CrossRefPubMed Frankis J, Flowers P: Men who have sex with men (MSM) in public sex environments (PSES): a systematic review of quantitative literature. AIDS Care. 2005, 17: 273-88. 10.1080/09540120412331299799CrossRefPubMed
3.
go back to reference Colby D, Cao NH, Doussantousse S: Men who have sex with men and HIV in Vietnam: a review. AIDS Educ Prev. 2004, 16: 45-54. 10.1521/aeap.16.1.45.27722CrossRefPubMed Colby D, Cao NH, Doussantousse S: Men who have sex with men and HIV in Vietnam: a review. AIDS Educ Prev. 2004, 16: 45-54. 10.1521/aeap.16.1.45.27722CrossRefPubMed
4.
go back to reference Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF: Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Quality of reporting of meta-analyses. Lancet. 1999, 354: 1896-900. 10.1016/S0140-6736(99)04149-5CrossRefPubMed Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF: Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Quality of reporting of meta-analyses. Lancet. 1999, 354: 1896-900. 10.1016/S0140-6736(99)04149-5CrossRefPubMed
5.
go back to reference Deeks JJ, Dinnes J, D'Amico R, Sowden AJ, Sakarovitch C, Song F, Petticrew M, Altman DG: Evaluating non-randomised intervention studies. Health Technol Assess. 2003, 7: iii-173.CrossRefPubMed Deeks JJ, Dinnes J, D'Amico R, Sowden AJ, Sakarovitch C, Song F, Petticrew M, Altman DG: Evaluating non-randomised intervention studies. Health Technol Assess. 2003, 7: iii-173.CrossRefPubMed
6.
go back to reference West S, King V, Carey TS, Lohr KN, McKoy N, Sutton SF, Lux L: Systems to Rate the Strength of Evidence. Evidence Report/Technology Assessment No. 47. 2002. Agency for Healthcare Research and Quality, Rockville, MD. AHRQ Publication No. 02-E016. West S, King V, Carey TS, Lohr KN, McKoy N, Sutton SF, Lux L: Systems to Rate the Strength of Evidence. Evidence Report/Technology Assessment No. 47. 2002. Agency for Healthcare Research and Quality, Rockville, MD. AHRQ Publication No. 02-E016.
7.
go back to reference Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, Moher D, Becker BJ, Sipe TA, Thacker SB: Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA. 2000, 283: 2008-12. 10.1001/jama.283.15.2008CrossRefPubMed Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, Moher D, Becker BJ, Sipe TA, Thacker SB: Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA. 2000, 283: 2008-12. 10.1001/jama.283.15.2008CrossRefPubMed
8.
go back to reference von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP: The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies. PLoS Medicine. 2007, 4 (10): e296. 10.1371/journal.pmed.0040296CrossRef von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP: The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies. PLoS Medicine. 2007, 4 (10): e296. 10.1371/journal.pmed.0040296CrossRef
10.
go back to reference Sanderson S, Tatt ID, Higgins JP: Tools for assessing quality and susceptibility to bias in observational studies in epidemiology: a systematic review and annotated bibliography. Int J Epidemiol. 2007, 36: 666-676. 10.1093/ije/dym018CrossRefPubMed Sanderson S, Tatt ID, Higgins JP: Tools for assessing quality and susceptibility to bias in observational studies in epidemiology: a systematic review and annotated bibliography. Int J Epidemiol. 2007, 36: 666-676. 10.1093/ije/dym018CrossRefPubMed
11.
go back to reference Systematic reviews in healthcare: meta-analysis in context. Edited by: Egger M, Davey Smith G, Altman DG. 2000, BMJ Publishing Group, London; 2. Systematic reviews in healthcare: meta-analysis in context. Edited by: Egger M, Davey Smith G, Altman DG. 2000, BMJ Publishing Group, London; 2.
13.
go back to reference West S, King V, Carey TS, Lohr KN, McKoy N, Sutton SF, Lux L: Systems to rate the strength of scientific evidence. In Evidence report/technology assessment No. 47 (prepared by the Research Triangle Institute – University of North Carolina Evidence-based Practice Center under Contract No. 290-97-0011). 2002, AHRQ Publication No. 02-E016, Agency for Healthcare Research and Quality, Rockville, MD; 2002. West S, King V, Carey TS, Lohr KN, McKoy N, Sutton SF, Lux L: Systems to rate the strength of scientific evidence. In Evidence report/technology assessment No. 47 (prepared by the Research Triangle Institute – University of North Carolina Evidence-based Practice Center under Contract No. 290-97-0011). 2002, AHRQ Publication No. 02-E016, Agency for Healthcare Research and Quality, Rockville, MD; 2002.
14.
go back to reference Mallen C, Peat G, Croft P: Quality assessment of observational studies is not commonplace in systematic reviews. J Clin Epidemiol. 2006, 59: 765-769. 10.1016/j.jclinepi.2005.12.010CrossRefPubMed Mallen C, Peat G, Croft P: Quality assessment of observational studies is not commonplace in systematic reviews. J Clin Epidemiol. 2006, 59: 765-769. 10.1016/j.jclinepi.2005.12.010CrossRefPubMed
15.
go back to reference Deeks J, Glanville J, Sheldon T: Undertaking Systematic Reviews of Effectiveness: CRD Guidelines for Those Carrying Out or Commissioning Reviews. York, England: NHS Centre for Reviews and Dissemination, University of York; 1996, CRD Report 4 Deeks J, Glanville J, Sheldon T: Undertaking Systematic Reviews of Effectiveness: CRD Guidelines for Those Carrying Out or Commissioning Reviews. York, England: NHS Centre for Reviews and Dissemination, University of York; 1996, CRD Report 4
17.
go back to reference Downs SH, Black N: The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies in health care intervention. J Epidemiol Community Health. 1998, 52: 377-84.PubMedCentralCrossRefPubMed Downs SH, Black N: The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies in health care intervention. J Epidemiol Community Health. 1998, 52: 377-84.PubMedCentralCrossRefPubMed
19.
Metadata
Title
Development of a quality assessment tool for systematic reviews of observational studies (QATSO) of HIV prevalence in men having sex with men and associated risk behaviours
Authors
William CW Wong
Catherine SK Cheung
Graham J Hart
Publication date
01-12-2008
Publisher
BioMed Central
Published in
Emerging Themes in Epidemiology / Issue 1/2008
Electronic ISSN: 1742-7622
DOI
https://doi.org/10.1186/1742-7622-5-23

Other articles of this Issue 1/2008

Emerging Themes in Epidemiology 1/2008 Go to the issue