Skip to main content
Top
Published in: Internal and Emergency Medicine 2/2016

01-03-2016 | CE - COCHRANE'S CORNER

Prognosis research and risk of bias

Authors: Gennaro D’Amico, Giuseppe Malizia, Mario D’Amico

Published in: Internal and Emergency Medicine | Issue 2/2016

Login to get access

Abstract

The interest in prognosis research has been steadily growing during the past few decades because of its impact on clinical decision making. However, since the methodology of prognosis research is still incompletely defined, the quality of published prognosis studies is largely unsatisfactory. Seven major domain for risk of bias in prognosis research have been identified, including study participation, attrition, selection of candidate predictors, outcome definition, confounding factors, analysis, and interpretation of results. The methodology for performing prognostic studies is currently aimed at avoiding such potential biases. Amongst methodologic requirements in prognosis research, the following should be considered most relevant: beforehand publication of the study protocol including the full statistical plan; inclusion of patients at a similar point along the course of the disease; rationale and biological plausibility of candidate predictors; complete information; control of overfitting and underfitting; adequate data handling and analysis; publication of the original data. Validation and analysis of the impact that prediction models have on patient management, are key steps for translation of prognosis research into clinical practice. Finally, transparent reporting of prognostic studies is essential for assessing reliability, applicability and generalizability of study results, and recommendations are now available for this aim.
Literature
1.
go back to reference Hayden JA, Cote P, Bombardier C (2006) Evaluation of the quality of prognosis studies in systematic reviews. Ann Intern Med 144:427–437CrossRefPubMed Hayden JA, Cote P, Bombardier C (2006) Evaluation of the quality of prognosis studies in systematic reviews. Ann Intern Med 144:427–437CrossRefPubMed
2.
go back to reference Kyzas PA, Denaxa-Kyza D, Ioannidis JPA (2007) Quality of reporting of cancer prognostic marker studies: association with reported prognostic effect. J Natl Cancer Inst 99:236–243CrossRefPubMed Kyzas PA, Denaxa-Kyza D, Ioannidis JPA (2007) Quality of reporting of cancer prognostic marker studies: association with reported prognostic effect. J Natl Cancer Inst 99:236–243CrossRefPubMed
3.
go back to reference Hingorani DA, van der Windt DA, Riley RD, Moons KGM, Steyerberg EW, Schroter S et al (2013) Prognosis research strategy (PROGRESS) 4: stratified medicine research. BMJ 346:e5793CrossRefPubMedPubMedCentral Hingorani DA, van der Windt DA, Riley RD, Moons KGM, Steyerberg EW, Schroter S et al (2013) Prognosis research strategy (PROGRESS) 4: stratified medicine research. BMJ 346:e5793CrossRefPubMedPubMedCentral
4.
go back to reference Pugh RN, Murray-Lyon IM, Dawson JL, Pietrni MC, Williams R (1973) Transection of the esophagus for bleeding oesophageal varices. Br J Surg 60:646–649CrossRefPubMed Pugh RN, Murray-Lyon IM, Dawson JL, Pietrni MC, Williams R (1973) Transection of the esophagus for bleeding oesophageal varices. Br J Surg 60:646–649CrossRefPubMed
5.
go back to reference Kamath PS, Wiesner RH, Malinchoc M, Kremers W, Therneau TM, Kosberg CL et al (2001) A model to predict survival in patients with endstage liver disease. Hepatology 33:464–470CrossRefPubMed Kamath PS, Wiesner RH, Malinchoc M, Kremers W, Therneau TM, Kosberg CL et al (2001) A model to predict survival in patients with endstage liver disease. Hepatology 33:464–470CrossRefPubMed
6.
go back to reference D’Amico G, Garcia-Tsao G, Pagliaro L (2006) Natural history and prognostic factors in cirrhosis: a systematic review of 118 studies. J Hepatol 44:217–231CrossRefPubMed D’Amico G, Garcia-Tsao G, Pagliaro L (2006) Natural history and prognostic factors in cirrhosis: a systematic review of 118 studies. J Hepatol 44:217–231CrossRefPubMed
7.
go back to reference Moons KGM, Altman DG, Reitsma JB, Collins GS, Ioannidis PA, Macaskill P et al (2015) Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): explanation and elaboration. Ann Int Med 162:W1–W73CrossRefPubMed Moons KGM, Altman DG, Reitsma JB, Collins GS, Ioannidis PA, Macaskill P et al (2015) Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): explanation and elaboration. Ann Int Med 162:W1–W73CrossRefPubMed
8.
9.
go back to reference Di Pietro NA (2010) Methods in epidemiology: observational study designs. Pharmacotherapy 30:973–984CrossRef Di Pietro NA (2010) Methods in epidemiology: observational study designs. Pharmacotherapy 30:973–984CrossRef
10.
go back to reference D’Amico G, Pasta L, Morabito A, D’Amico M, Caltagirone M, Malizia G et al (2014) Competing risks and prognostic stages in cirrhosis: a 25-year inception cohort study of 494 patients. Aliment Pharmacol Ther 39:1180–1193CrossRefPubMed D’Amico G, Pasta L, Morabito A, D’Amico M, Caltagirone M, Malizia G et al (2014) Competing risks and prognostic stages in cirrhosis: a 25-year inception cohort study of 494 patients. Aliment Pharmacol Ther 39:1180–1193CrossRefPubMed
11.
go back to reference D’Amico G, Morabito A, Pagliaro L, Marubini E, The liver study group of “V Cervello Hospital” (1986) Survival and prognostic indicators of compensated and decompensated cirrhosis. Dig Dis Sci 31:468–475CrossRefPubMed D’Amico G, Morabito A, Pagliaro L, Marubini E, The liver study group of “V Cervello Hospital” (1986) Survival and prognostic indicators of compensated and decompensated cirrhosis. Dig Dis Sci 31:468–475CrossRefPubMed
12.
go back to reference Ratib S, Fleming KM, Crooks JC, Aithal G, West J (2014) 1 and 5 year survival estimates for people with cirrhosis of the liver in England, 1998–2009: a large population study. J Hepatol 60:282–289CrossRefPubMed Ratib S, Fleming KM, Crooks JC, Aithal G, West J (2014) 1 and 5 year survival estimates for people with cirrhosis of the liver in England, 1998–2009: a large population study. J Hepatol 60:282–289CrossRefPubMed
13.
go back to reference Donders AR, van der Heijden GJ, Stijnen T (2006) Review: a gentle introduction to imputation of missing data. J Clin Epidemiol 59:1087–1091CrossRefPubMed Donders AR, van der Heijden GJ, Stijnen T (2006) Review: a gentle introduction to imputation of missing data. J Clin Epidemiol 59:1087–1091CrossRefPubMed
14.
go back to reference Royston P, Moons KG, Altman DG, Vergouwe Y (2009) Prognosis and prognostic research: developing a prognostic model. BMJ 338:b604CrossRefPubMed Royston P, Moons KG, Altman DG, Vergouwe Y (2009) Prognosis and prognostic research: developing a prognostic model. BMJ 338:b604CrossRefPubMed
15.
go back to reference Harrell FE Jr (1985) Regression models for prognostic prediction: advantages, problems, and suggested solutions. Cancer Treat Rep 69:1071–1077PubMed Harrell FE Jr (1985) Regression models for prognostic prediction: advantages, problems, and suggested solutions. Cancer Treat Rep 69:1071–1077PubMed
16.
go back to reference Concato J, Feinstein AR, Holford TR (1993) The risk of determining risk with multivariable models. Ann Intern Med 118:201–210CrossRefPubMed Concato J, Feinstein AR, Holford TR (1993) The risk of determining risk with multivariable models. Ann Intern Med 118:201–210CrossRefPubMed
17.
go back to reference Moons KGM, Kengne AP, Woodward M, Royston P, Vergouwe Y, Altman GD, Grobbee DE (2012) Risk prediction models: I. Development, internal validation, and assessing the incremental value of a new (bio)marker. Heart 98:683–690CrossRefPubMed Moons KGM, Kengne AP, Woodward M, Royston P, Vergouwe Y, Altman GD, Grobbee DE (2012) Risk prediction models: I. Development, internal validation, and assessing the incremental value of a new (bio)marker. Heart 98:683–690CrossRefPubMed
18.
go back to reference Royston P, Altman DG, Sauerbrei W (2006) Dichotomizing continuous predictors in multiple regression: a bad idea. Stat Med 25:127–141CrossRefPubMed Royston P, Altman DG, Sauerbrei W (2006) Dichotomizing continuous predictors in multiple regression: a bad idea. Stat Med 25:127–141CrossRefPubMed
19.
go back to reference Jepsen P, Wilstrup H, Andersen PK (2015) The clinical course of cirrhosis. The importance of multistate models and competing risks analysis. Hepatology 62:292–302CrossRefPubMed Jepsen P, Wilstrup H, Andersen PK (2015) The clinical course of cirrhosis. The importance of multistate models and competing risks analysis. Hepatology 62:292–302CrossRefPubMed
20.
go back to reference Pintile M (2006) Competing risks. A practical perspective. Wiley, ChichesterCrossRef Pintile M (2006) Competing risks. A practical perspective. Wiley, ChichesterCrossRef
21.
go back to reference Fine JP, Gray RJ (1999) A proportional hazards model for the subdistribution of competing risk. J Am Stat Ass 94:496–509CrossRef Fine JP, Gray RJ (1999) A proportional hazards model for the subdistribution of competing risk. J Am Stat Ass 94:496–509CrossRef
22.
go back to reference Moons KGM, Royston P, Vergouwe Y, Grobbee DE, Altman DG (2009) Prognosis and prognostic research: what, why and how? BMJ 339:b375CrossRef Moons KGM, Royston P, Vergouwe Y, Grobbee DE, Altman DG (2009) Prognosis and prognostic research: what, why and how? BMJ 339:b375CrossRef
23.
go back to reference Harrel FE, Lee KL, Mark DB (1996) Tutorial in biostatistics. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med 15:361–387CrossRef Harrel FE, Lee KL, Mark DB (1996) Tutorial in biostatistics. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med 15:361–387CrossRef
24.
go back to reference Justice AC, Covinsky KE, Berlin JA (1999) Assessing the generalizability of prognostic information. Ann Intern Med 130:515–524CrossRefPubMed Justice AC, Covinsky KE, Berlin JA (1999) Assessing the generalizability of prognostic information. Ann Intern Med 130:515–524CrossRefPubMed
25.
go back to reference Steyerberg WE, Vickers AJ, Cook N, Gerds T, Gonen M, Obuchowski N et al (2010) Assessing the performance of prediction models. A framework for traditional and novel measures. Epidemiology 21:128–138CrossRefPubMedPubMedCentral Steyerberg WE, Vickers AJ, Cook N, Gerds T, Gonen M, Obuchowski N et al (2010) Assessing the performance of prediction models. A framework for traditional and novel measures. Epidemiology 21:128–138CrossRefPubMedPubMedCentral
26.
go back to reference Altman DG, Vergouwe Y, Royston P, Moons KG (2009) Prognosis and prognostic research: validating a prognostic model. BMJ 338:b605CrossRefPubMed Altman DG, Vergouwe Y, Royston P, Moons KG (2009) Prognosis and prognostic research: validating a prognostic model. BMJ 338:b605CrossRefPubMed
27.
go back to reference Moons KGM, Kengne AP, Grobbee DE, Royston P, Vergouwe Y, Altman GD, Woodward M (2012) Risk prediction models: II. Esternal validation, model updating and impact assessment. Heart 98:691–698CrossRefPubMed Moons KGM, Kengne AP, Grobbee DE, Royston P, Vergouwe Y, Altman GD, Woodward M (2012) Risk prediction models: II. Esternal validation, model updating and impact assessment. Heart 98:691–698CrossRefPubMed
28.
go back to reference Toll DB, Janssen KJM, Vergouwe Y, Moons KGM (2008) Validating, updating and impact of clinical prediction rules: a review. J Clin Epidemiol 61:1085–1094CrossRefPubMed Toll DB, Janssen KJM, Vergouwe Y, Moons KGM (2008) Validating, updating and impact of clinical prediction rules: a review. J Clin Epidemiol 61:1085–1094CrossRefPubMed
29.
go back to reference Reilly BM, Evans AT (2006) Translating clinical research into clinical practice: impact of using prediction rules to make decisions. Ann Int Med 144:201–209CrossRefPubMed Reilly BM, Evans AT (2006) Translating clinical research into clinical practice: impact of using prediction rules to make decisions. Ann Int Med 144:201–209CrossRefPubMed
30.
go back to reference Moons KGM, Altman DG, Vergouwe Y, Royston P (2009) Prognosis and prognostic research: application and impact of prognostic models in clinical practice. BMJ 338:b606CrossRefPubMed Moons KGM, Altman DG, Vergouwe Y, Royston P (2009) Prognosis and prognostic research: application and impact of prognostic models in clinical practice. BMJ 338:b606CrossRefPubMed
31.
go back to reference McGinnTH Guyatt GH, Wyer PC et al (2000) User’s guide to medical literature: XXII. How to use articles about clinical decision rules. Evidence based medicine working group. JAMA 284:79–84CrossRef McGinnTH Guyatt GH, Wyer PC et al (2000) User’s guide to medical literature: XXII. How to use articles about clinical decision rules. Evidence based medicine working group. JAMA 284:79–84CrossRef
32.
go back to reference Campbel MK, Elborne DR, Altman DC (2014) CONSORT statement extension to cluster randomized trials. BMJ 328:702–708CrossRef Campbel MK, Elborne DR, Altman DC (2014) CONSORT statement extension to cluster randomized trials. BMJ 328:702–708CrossRef
34.
go back to reference Toll DB, Janssen KJM, Vergouwe Y, Moons KGM (2008) Validating, Updating and impact of clinical prediction rules: a review. J Clin Epidemiol 61:1085–1094CrossRefPubMed Toll DB, Janssen KJM, Vergouwe Y, Moons KGM (2008) Validating, Updating and impact of clinical prediction rules: a review. J Clin Epidemiol 61:1085–1094CrossRefPubMed
35.
go back to reference Collins GS, Reistma JB, Altman DG, Moons KGM (2015) Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. Ann Int Med 162:55–63CrossRefPubMed Collins GS, Reistma JB, Altman DG, Moons KGM (2015) Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. Ann Int Med 162:55–63CrossRefPubMed
36.
go back to reference Hemingway H, Riley DR, Altman DG (2009) Ten steps towards improving prognosis research. BMJ 339:b4184CrossRefPubMed Hemingway H, Riley DR, Altman DG (2009) Ten steps towards improving prognosis research. BMJ 339:b4184CrossRefPubMed
37.
go back to reference Hemingway H, Croft P, Perel P, Hayden JA, Abrams K, Timmis A et al (2013) Prognosis research strategy (PROGRESS) 1: a framework for researching clinical outcomes. BMJ 346:e5595CrossRefPubMedPubMedCentral Hemingway H, Croft P, Perel P, Hayden JA, Abrams K, Timmis A et al (2013) Prognosis research strategy (PROGRESS) 1: a framework for researching clinical outcomes. BMJ 346:e5595CrossRefPubMedPubMedCentral
38.
go back to reference Riley RD, Hayden JA, Steyerberg EW, Moons KG, Abrams K, Kyzas PA et al (2013) Prognosis research strategy (PROGRESS) 2: prognostic factor research. PLoS Med 10(2):e1001380CrossRefPubMedPubMedCentral Riley RD, Hayden JA, Steyerberg EW, Moons KG, Abrams K, Kyzas PA et al (2013) Prognosis research strategy (PROGRESS) 2: prognostic factor research. PLoS Med 10(2):e1001380CrossRefPubMedPubMedCentral
39.
go back to reference Steyerberg EW, Moons KG, van der Windt DA, Hayden JA, Perel P, Schroter S et al (2013) Prognosis research strategy (PROGRESS) 3: prognostic model research. PLoS Med 10(2):e1001381CrossRefPubMedPubMedCentral Steyerberg EW, Moons KG, van der Windt DA, Hayden JA, Perel P, Schroter S et al (2013) Prognosis research strategy (PROGRESS) 3: prognostic model research. PLoS Med 10(2):e1001381CrossRefPubMedPubMedCentral
40.
go back to reference PLOS Medicine Editors (2014) Observational studies: getting clear about transparency. PLoS Med 11(8):e1001711CrossRef PLOS Medicine Editors (2014) Observational studies: getting clear about transparency. PLoS Med 11(8):e1001711CrossRef
Metadata
Title
Prognosis research and risk of bias
Authors
Gennaro D’Amico
Giuseppe Malizia
Mario D’Amico
Publication date
01-03-2016
Publisher
Springer Milan
Published in
Internal and Emergency Medicine / Issue 2/2016
Print ISSN: 1828-0447
Electronic ISSN: 1970-9366
DOI
https://doi.org/10.1007/s11739-016-1404-z

Other articles of this Issue 2/2016

Internal and Emergency Medicine 2/2016 Go to the issue
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.