Skip to main content
Top
Published in: Journal of Translational Medicine 1/2013

Open Access 01-12-2013 | Editorial

Assessment of risk of bias in translational science

Authors: Andre Barkhordarian, Peter Pellionisz, Mona Dousti, Vivian Lam, Lauren Gleason, Mahsa Dousti, Josemar Moura, Francesco Chiappelli

Published in: Journal of Translational Medicine | Issue 1/2013

Login to get access

Abstract

Risk of bias in translational medicine may take one of three forms: A. a systematic error of methodology as it pertains to measurement or sampling (e.g., selection bias), B. a systematic defect of design that leads to estimates of experimental and control groups, and of effect sizes that substantially deviate from true values (e.g., information bias), and C. a systematic distortion of the analytical process, which results in a misrepresentation of the data with consequential errors of inference (e.g., inferential bias). Risk of bias can seriously adulterate the internal and the external validity of a clinical study, and, unless it is identified and systematically evaluated, can seriously hamper the process of comparative effectiveness and efficacy research and analysis for practice. The Cochrane Group and the Agency for Healthcare Research and Quality have independently developed instruments for assessing the meta-construct of risk of bias. The present article begins to discuss this dialectic.
Appendix
Available only for authorised users
Literature
1.
go back to reference Jiang F, Zhang J, Wang X, Shen X: Important steps to improve translation from medical research to health policy. J Trans Med. 2013, 11: 33-10.1186/1479-5876-11-33.CrossRef Jiang F, Zhang J, Wang X, Shen X: Important steps to improve translation from medical research to health policy. J Trans Med. 2013, 11: 33-10.1186/1479-5876-11-33.CrossRef
2.
go back to reference Sung NS, Crowley WF, Genel M, Salber P, Sandy L, Sherwood LM, Johnson SB, Catanese V, Tilson H, Getz K, Larson EL, Scheinberg D, Reece EA, Slavkin H, Dobs A, Grebb J, Martinez RA, Korn A, Rimoin D: Central challenges facing the national clinical research enterprise. JAMA. 2003, 289: 1278-1287. 10.1001/jama.289.10.1278.CrossRefPubMed Sung NS, Crowley WF, Genel M, Salber P, Sandy L, Sherwood LM, Johnson SB, Catanese V, Tilson H, Getz K, Larson EL, Scheinberg D, Reece EA, Slavkin H, Dobs A, Grebb J, Martinez RA, Korn A, Rimoin D: Central challenges facing the national clinical research enterprise. JAMA. 2003, 289: 1278-1287. 10.1001/jama.289.10.1278.CrossRefPubMed
3.
go back to reference Woolf SH: The meaning of translational research and why it matters. JAMA. 2008, 299 (2): 211-213. 10.1001/jama.2007.26.CrossRefPubMed Woolf SH: The meaning of translational research and why it matters. JAMA. 2008, 299 (2): 211-213. 10.1001/jama.2007.26.CrossRefPubMed
4.
go back to reference Chiappelli F: From translational research to translational effectiveness: the “patient-centered dental home” model. Dental Hypotheses. 2011, 2: 105-112. 10.5436/j.dehy.2011.2.00035.CrossRef Chiappelli F: From translational research to translational effectiveness: the “patient-centered dental home” model. Dental Hypotheses. 2011, 2: 105-112. 10.5436/j.dehy.2011.2.00035.CrossRef
5.
go back to reference Maida C: Building communities of practice in comparative effectiveness research. Comparative effectiveness and efficacy research and analysis for practice (CEERAP): applications for treatment options in health care. Edited by: Chiappelli F, Brant X, Cajulis C. 2012, Heidelberg: Springer–Verlag, Chapter 1 Maida C: Building communities of practice in comparative effectiveness research. Comparative effectiveness and efficacy research and analysis for practice (CEERAP): applications for treatment options in health care. Edited by: Chiappelli F, Brant X, Cajulis C. 2012, Heidelberg: Springer–Verlag, Chapter 1
7.
go back to reference Westfall JM, Mold J, Fagnan L: Practice-based research—“blue highways” on the NIH roadmap. JAMA. 2007, 297: 403-406. 10.1001/jama.297.4.403.CrossRefPubMed Westfall JM, Mold J, Fagnan L: Practice-based research—“blue highways” on the NIH roadmap. JAMA. 2007, 297: 403-406. 10.1001/jama.297.4.403.CrossRefPubMed
8.
go back to reference Chiappelli F, Brant X, Cajulis C: Comparative effectiveness and efficacy research and analysis for practice (CEERAP) applications for treatment options in health care. 2012, Heidelberg: Springer–VerlagCrossRef Chiappelli F, Brant X, Cajulis C: Comparative effectiveness and efficacy research and analysis for practice (CEERAP) applications for treatment options in health care. 2012, Heidelberg: Springer–VerlagCrossRef
9.
go back to reference Dousti M, Ramchandani MH, Chiappelli F: Evidence-based clinical significance in health care: toward an inferential analysis of clinical relevance. Dental Hypotheses. 2011, 2: 165-177. 10.5436/j.dehy.2011.2.00042.CrossRef Dousti M, Ramchandani MH, Chiappelli F: Evidence-based clinical significance in health care: toward an inferential analysis of clinical relevance. Dental Hypotheses. 2011, 2: 165-177. 10.5436/j.dehy.2011.2.00042.CrossRef
10.
go back to reference Campbell D, Stanley J: Experimental and quasi-experimental designs for research. 1963, Chicago, IL: Rand-McNally Campbell D, Stanley J: Experimental and quasi-experimental designs for research. 1963, Chicago, IL: Rand-McNally
11.
go back to reference Littell JH, Corcoran J, Pillai V: Research synthesis reports and meta-analysis. 2008, New York, NY: Oxford Univeristy Press Littell JH, Corcoran J, Pillai V: Research synthesis reports and meta-analysis. 2008, New York, NY: Oxford Univeristy Press
12.
go back to reference Chiappelli F: The science of research synthesis: a manual of evidence-based research for the health sciences. 2008, Hauppauge NY: NovaScience Publisher, Inc Chiappelli F: The science of research synthesis: a manual of evidence-based research for the health sciences. 2008, Hauppauge NY: NovaScience Publisher, Inc
13.
go back to reference Higgins JPT, Green S: Cochrane handbook for systematic reviews of interventions version 5.0.1. 2008, Chichester, West Sussex, UK: John Wiley & Sons. The Cochrane collaborationCrossRef Higgins JPT, Green S: Cochrane handbook for systematic reviews of interventions version 5.0.1. 2008, Chichester, West Sussex, UK: John Wiley & Sons. The Cochrane collaborationCrossRef
14.
go back to reference CRD: Systematic Reviews: CRD’s guidance for undertaking reviews in health care. National Institute for Health Research (NIHR). 2009, University of York, UK: Center for reviews and dissemination CRD: Systematic Reviews: CRD’s guidance for undertaking reviews in health care. National Institute for Health Research (NIHR). 2009, University of York, UK: Center for reviews and dissemination
15.
go back to reference McDonald KM, Chang C, Schultz E: Closing the quality Gap: revisiting the state of the science. Summary report. 2013, U.S. Department of Health & Human Services. AHRQ, Rockville, MD: Summary report. AHRQ publication No. 12(13)-E017 McDonald KM, Chang C, Schultz E: Closing the quality Gap: revisiting the state of the science. Summary report. 2013, U.S. Department of Health & Human Services. AHRQ, Rockville, MD: Summary report. AHRQ publication No. 12(13)-E017
16.
go back to reference Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, Savovic J, Schulz KF, Weeks L, Sterne JA, Cochrane Bias Methods Group; Cochrane Statistical Methods Group: The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. British Med J. 2011, 343: d5928-10.1136/bmj.d5928.CrossRef Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, Savovic J, Schulz KF, Weeks L, Sterne JA, Cochrane Bias Methods Group; Cochrane Statistical Methods Group: The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. British Med J. 2011, 343: d5928-10.1136/bmj.d5928.CrossRef
17.
go back to reference Bartolucci AA, Hillegas WB: Overview, strengths, and limitations of systematic reviews and meta-analyses. Understanding evidence-based practice: toward optimizing clinical outcomes. Edited by: Chiappelli F, Brant XMC, Oluwadara OO, Neagos N, Ramchandani MH. 2010, Heidelberg: Springer–Verlag, Chap 2 Bartolucci AA, Hillegas WB: Overview, strengths, and limitations of systematic reviews and meta-analyses. Understanding evidence-based practice: toward optimizing clinical outcomes. Edited by: Chiappelli F, Brant XMC, Oluwadara OO, Neagos N, Ramchandani MH. 2010, Heidelberg: Springer–Verlag, Chap 2
18.
go back to reference Jüni P, Altman DG, Egger M: Systematic reviews in health care: assessing the quality of controlled clinical trials. British Med J. 2001, 323 (7303): 42-46. 10.1136/bmj.323.7303.42.CrossRef Jüni P, Altman DG, Egger M: Systematic reviews in health care: assessing the quality of controlled clinical trials. British Med J. 2001, 323 (7303): 42-46. 10.1136/bmj.323.7303.42.CrossRef
19.
go back to reference Chiappelli F, Arora R, Barkhordarian B, Ramchandani M: Evidence-based clinical research: toward a New conceptualization of the level and the quality of the evidence. Annals Ayurvedic Med. 2012, 1: 60-64. Chiappelli F, Arora R, Barkhordarian B, Ramchandani M: Evidence-based clinical research: toward a New conceptualization of the level and the quality of the evidence. Annals Ayurvedic Med. 2012, 1: 60-64.
20.
go back to reference Chiappelli F, Barkhordarian A, Arora R, Phi L, Giroux A, Uyeda M, Kung K, Ramchandani M: Reliability of quality assessments in research synthesis: securing the highest quality bioinformation for HIT. Bioinformation. 2012, 8: 691-694. 10.6026/97320630008691.PubMedCentralCrossRefPubMed Chiappelli F, Barkhordarian A, Arora R, Phi L, Giroux A, Uyeda M, Kung K, Ramchandani M: Reliability of quality assessments in research synthesis: securing the highest quality bioinformation for HIT. Bioinformation. 2012, 8: 691-694. 10.6026/97320630008691.PubMedCentralCrossRefPubMed
21.
go back to reference Hartling L, Hamm M, Milne A, Vandermeer B, Santaguida PL, Ansari M, Tsertsvadze A, Hempel S, Shekelle P, Dryden DM: Validity and inter-rater reliability testing of quality assessment instruments. 2012, S. Department of Health & Human Services. AHRQ, Rockville, MD: AHRQ publication No. 12-EHC039-EF Hartling L, Hamm M, Milne A, Vandermeer B, Santaguida PL, Ansari M, Tsertsvadze A, Hempel S, Shekelle P, Dryden DM: Validity and inter-rater reliability testing of quality assessment instruments. 2012, S. Department of Health & Human Services. AHRQ, Rockville, MD: AHRQ publication No. 12-EHC039-EF
22.
go back to reference Viswanathan M, Ansari MT, Berkman ND, Chang S, Hartling L, McPheeters LM, Santaguida PL, Shamliyan T, Singh K, Tsertsvadze A, Treadwell JR: Assessing the risk of bias of individual studies in systematic reviews of health care interventions. 2012, U.S. Department of Health & Human Services. AHRQ, Rockville, MD: AHRQ publication No. 12-EHC047-EF Viswanathan M, Ansari MT, Berkman ND, Chang S, Hartling L, McPheeters LM, Santaguida PL, Shamliyan T, Singh K, Tsertsvadze A, Treadwell JR: Assessing the risk of bias of individual studies in systematic reviews of health care interventions. 2012, U.S. Department of Health & Human Services. AHRQ, Rockville, MD: AHRQ publication No. 12-EHC047-EF
23.
go back to reference Shavelson RJ, Webb NM: Generalizability theory: 1973–1980. Br J Math Stat Psychol. 1981, 34: 133-166. 10.1111/j.2044-8317.1981.tb00625.x.CrossRef Shavelson RJ, Webb NM: Generalizability theory: 1973–1980. Br J Math Stat Psychol. 1981, 34: 133-166. 10.1111/j.2044-8317.1981.tb00625.x.CrossRef
24.
go back to reference Chiappelli F, Navarro AM, Moradi DR, Manfrini E, Prolo P: Evidence-based research in complementary and alternative medicine III: treatment of patients with Alzheimer’s disease. Evidence-Based Comp Alter Med. 2006, 3: 411-424. 10.1093/ecam/nel072.CrossRef Chiappelli F, Navarro AM, Moradi DR, Manfrini E, Prolo P: Evidence-based research in complementary and alternative medicine III: treatment of patients with Alzheimer’s disease. Evidence-Based Comp Alter Med. 2006, 3: 411-424. 10.1093/ecam/nel072.CrossRef
25.
go back to reference Montgomery C: Statistical quality control: a modern introduction. 2009, Chichester, West Sussex, UK: Johm Wiley & sons Montgomery C: Statistical quality control: a modern introduction. 2009, Chichester, West Sussex, UK: Johm Wiley & sons
Metadata
Title
Assessment of risk of bias in translational science
Authors
Andre Barkhordarian
Peter Pellionisz
Mona Dousti
Vivian Lam
Lauren Gleason
Mahsa Dousti
Josemar Moura
Francesco Chiappelli
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Journal of Translational Medicine / Issue 1/2013
Electronic ISSN: 1479-5876
DOI
https://doi.org/10.1186/1479-5876-11-184

Other articles of this Issue 1/2013

Journal of Translational Medicine 1/2013 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.