Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2012

Open Access 01-12-2012 | Correspondence

Reporting guidelines for modelling studies

Authors: Carol Bennett, Douglas G Manuel

Published in: BMC Medical Research Methodology | Issue 1/2012

Login to get access

Abstract

Background

Modelling studies are used widely to help inform decisions about health care and policy and their use is increasing. However, in order for modelling to gain strength as a tool for health policy, it is critical that key model factors are transparent so that users of models can have a clear understanding of the model and its limitations.Reporting guidelines are evidence-based tools that specify minimum criteria for authors to report their research such that readers can both critically appraise and interpret study findings. This study was conducted to determine whether there is an unmet need for population modelling reporting guidelines.

Methods

We conducted a review of the literature to identify: 1) guidance for reporting population modelling studies; and, 2) evidence on the quality of reporting of population modelling studies. Guidance for reporting was analysed using a thematic approach and the data was summarised as frequencies. Evidence on the quality of reporting was reviewed and summarized descriptively.

Results

There were no guidelines that specifically addressed the reporting of population modelling studies. We identified a number of reporting guidelines for economic evaluation studies, some of which had sections that were relevant population modelling studies. Amongst seven relevant records, we identified 69 quality criteria that have distinct reporting characteristics. We identified two papers that addressed reporting practices of modelling studies. Overall, with the exception of describing the data used for calibration, there was little consistency in reporting.

Conclusions

While numerous guidelines exist for developing and evaluating health technology assessment and economic evaluation models, which by extension could be applicable to population modelling studies, there is variation in their comprehensiveness and in the consistency of reporting these methods. Population modelling studies may be an area which would benefit from the development of a reporting guideline.
Appendix
Available only for authorised users
Literature
1.
go back to reference Weinstein MC, Toy EL, Sandberg EA, Neumann PJ, Evans JS, Kuntz KM, Graham JD, Hammitt JK: Modeling for health care and other policy decisions: uses, roles, and validity. Value Health. 2001, 4: 348-361. 10.1046/j.1524-4733.2001.45061.x.CrossRefPubMed Weinstein MC, Toy EL, Sandberg EA, Neumann PJ, Evans JS, Kuntz KM, Graham JD, Hammitt JK: Modeling for health care and other policy decisions: uses, roles, and validity. Value Health. 2001, 4: 348-361. 10.1046/j.1524-4733.2001.45061.x.CrossRefPubMed
2.
go back to reference Kopec JA, Fines P, Manuel DG, Buckeridge DL, Flanagan WM, Oderkirk J, Abrahamowicz M, Harper S, Sharif B, Okhmatovskaia A, Sayre EC, Rahman MM, Wolfson MC: Validation of population-based disease simulation models: a review of concepts and methods. [Review]. BMC Publ Health. 2010, 10: 710-10.1186/1471-2458-10-710.CrossRef Kopec JA, Fines P, Manuel DG, Buckeridge DL, Flanagan WM, Oderkirk J, Abrahamowicz M, Harper S, Sharif B, Okhmatovskaia A, Sayre EC, Rahman MM, Wolfson MC: Validation of population-based disease simulation models: a review of concepts and methods. [Review]. BMC Publ Health. 2010, 10: 710-10.1186/1471-2458-10-710.CrossRef
3.
go back to reference Weinstein MC, O’Brien B, Hornberger J, Jackson J, Johannesson M, McCabe C, Luce BR, ISPOR Task Force on Good Research Practices: Principles of good practice for decision analytic modeling in health-care evaluation: report of the ISPOR Task Force on Good Research Practices–Modeling Studies. Value Health. 2003, 6: 9-17. 10.1046/j.1524-4733.2003.00234.x.CrossRefPubMed Weinstein MC, O’Brien B, Hornberger J, Jackson J, Johannesson M, McCabe C, Luce BR, ISPOR Task Force on Good Research Practices: Principles of good practice for decision analytic modeling in health-care evaluation: report of the ISPOR Task Force on Good Research Practices–Modeling Studies. Value Health. 2003, 6: 9-17. 10.1046/j.1524-4733.2003.00234.x.CrossRefPubMed
4.
go back to reference Garrison LP: The ISPOR Good Practice Modeling Principles–a sensible approach: be transparent, be reasonable. Value Health. 2003, 6: 6-8. 10.1046/j.1524-4733.2003.00003.x.CrossRefPubMed Garrison LP: The ISPOR Good Practice Modeling Principles–a sensible approach: be transparent, be reasonable. Value Health. 2003, 6: 6-8. 10.1046/j.1524-4733.2003.00003.x.CrossRefPubMed
6.
go back to reference Moher D, Schulz KF, Simera I, Altman DG: Guidance for developers of health research reporting guidelines. PLoS Medicine / Public Library of Science. 2010, 7: e1000217- Moher D, Schulz KF, Simera I, Altman DG: Guidance for developers of health research reporting guidelines. PLoS Medicine / Public Library of Science. 2010, 7: e1000217-
7.
go back to reference Nuijten MJ, Pronk MH, Brorens MJ, Hekster YA, Lockefeer JH, de Smet PA, Bonsel G, van der Kuy A: Reporting format for economic evaluation. Part II: Focus on modelling studies. Pharmacoeconomics. 1998, 14: 259-268. 10.2165/00019053-199814030-00003.CrossRefPubMed Nuijten MJ, Pronk MH, Brorens MJ, Hekster YA, Lockefeer JH, de Smet PA, Bonsel G, van der Kuy A: Reporting format for economic evaluation. Part II: Focus on modelling studies. Pharmacoeconomics. 1998, 14: 259-268. 10.2165/00019053-199814030-00003.CrossRefPubMed
8.
go back to reference Drummond M, Manca A, Sculpher M: Increasing the generalizability of economic evaluations: recommendations for the design, analysis, and reporting of studies. Int J Technol Assess Health Care. 2005, 21: 165-171.PubMed Drummond M, Manca A, Sculpher M: Increasing the generalizability of economic evaluations: recommendations for the design, analysis, and reporting of studies. Int J Technol Assess Health Care. 2005, 21: 165-171.PubMed
9.
go back to reference Stout NK, Knudsen AB, Kong CY, McMahon PM, Gazelle GS: Calibration methods used in cancer simulation models and suggested reporting guidelines. [Review] [180 refs]. PharmacoEconomics. 2009, 27: 533-545. 10.2165/11314830-000000000-00000.CrossRefPubMedPubMedCentral Stout NK, Knudsen AB, Kong CY, McMahon PM, Gazelle GS: Calibration methods used in cancer simulation models and suggested reporting guidelines. [Review] [180 refs]. PharmacoEconomics. 2009, 27: 533-545. 10.2165/11314830-000000000-00000.CrossRefPubMedPubMedCentral
10.
go back to reference Philips Z, Ginnelly L, Sculpher M, Claxton K, Golder S, Riemsma R, Woolacoot N, Glanville J: Review of guidelines for good practice in decision-analytic modelling in health technology assessment. [Review] [62 refs]. 2001, Winchester, England: Health Technology Assessment, 8: iii-iiv. Philips Z, Ginnelly L, Sculpher M, Claxton K, Golder S, Riemsma R, Woolacoot N, Glanville J: Review of guidelines for good practice in decision-analytic modelling in health technology assessment. [Review] [62 refs]. 2001, Winchester, England: Health Technology Assessment, 8: iii-iiv.
11.
go back to reference Unal B, Capewell S, Critchley JA: Coronary heart disease policy models: a systematic review. [Review] [51 refs]. BMC Publ Health. 2006, 6: 213-10.1186/1471-2458-6-213.CrossRef Unal B, Capewell S, Critchley JA: Coronary heart disease policy models: a systematic review. [Review] [51 refs]. BMC Publ Health. 2006, 6: 213-10.1186/1471-2458-6-213.CrossRef
12.
go back to reference Smidt N, Rutjes AW, van der Windt DA, Ostelo RW, Bossuyt PM, Reitsma JB, Bouter LM, de Vet HC: The quality of diagnostic accuracy studies since the STARD statement: has it improved?. Neurology. 2006, 67: 792-797. 10.1212/01.wnl.0000238386.41398.30.CrossRefPubMed Smidt N, Rutjes AW, van der Windt DA, Ostelo RW, Bossuyt PM, Reitsma JB, Bouter LM, de Vet HC: The quality of diagnostic accuracy studies since the STARD statement: has it improved?. Neurology. 2006, 67: 792-797. 10.1212/01.wnl.0000238386.41398.30.CrossRefPubMed
13.
go back to reference Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C, Gaboury I: Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust. 2006, 185: 263-267.PubMed Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C, Gaboury I: Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust. 2006, 185: 263-267.PubMed
14.
go back to reference Smith BA, Lee HJ, Lee JH, Choi M, Jones DE, Bausell RB, Broome ME: Quality of reporting randomized controlled trials (RCTs) in the nursing literature: application of the consolidated standards of reporting trials (CONSORT). Nurs Outlook. 2008, 56: 31-37. 10.1016/j.outlook.2007.09.002.CrossRefPubMed Smith BA, Lee HJ, Lee JH, Choi M, Jones DE, Bausell RB, Broome ME: Quality of reporting randomized controlled trials (RCTs) in the nursing literature: application of the consolidated standards of reporting trials (CONSORT). Nurs Outlook. 2008, 56: 31-37. 10.1016/j.outlook.2007.09.002.CrossRefPubMed
15.
go back to reference Prady SL, Richmond SJ, Morton VM, Macpherson H: A systematic evaluation of the impact of STRICTA and CONSORT recommendations on quality of reporting for acupuncture trials. PLoS One. 2008, 3: e1577-10.1371/journal.pone.0001577. Electronic Resource.CrossRefPubMedPubMedCentral Prady SL, Richmond SJ, Morton VM, Macpherson H: A systematic evaluation of the impact of STRICTA and CONSORT recommendations on quality of reporting for acupuncture trials. PLoS One. 2008, 3: e1577-10.1371/journal.pone.0001577. Electronic Resource.CrossRefPubMedPubMedCentral
Metadata
Title
Reporting guidelines for modelling studies
Authors
Carol Bennett
Douglas G Manuel
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2012
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-12-168

Other articles of this Issue 1/2012

BMC Medical Research Methodology 1/2012 Go to the issue