Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
Implementation Science
Published in: Implementation Science 1/2010

Open Access 01-12-2010 | Debate

Rationality versus reality: the challenges of evidence-based decision making for health policy makers

Authors: Deirdre McCaughey, Nealia S Bruning

Published in: Implementation Science | Issue 1/2010

Login to get access

Abstract

Background

Current healthcare systems have extended the evidence-based medicine (EBM) approach to health policy and delivery decisions, such as access-to-care, healthcare funding and health program continuance, through attempts to integrate valid and reliable evidence into the decision making process. These policy decisions have major impacts on society and have high personal and financial costs associated with those decisions. Decision models such as these function under a shared assumption of rational choice and utility maximization in the decision-making process.

Discussion

We contend that health policy decision makers are generally unable to attain the basic goals of evidence-based decision making (EBDM) and evidence-based policy making (EBPM) because humans make decisions with their naturally limited, faulty, and biased decision-making processes. A cognitive information processing framework is presented to support this argument, and subtle cognitive processing mechanisms are introduced to support the focal thesis: health policy makers' decisions are influenced by the subjective manner in which they individually process decision-relevant information rather than on the objective merits of the evidence alone. As such, subsequent health policy decisions do not necessarily achieve the goals of evidence-based policy making, such as maximizing health outcomes for society based on valid and reliable research evidence.

Summary

In this era of increasing adoption of evidence-based healthcare models, the rational choice, utility maximizing assumptions in EBDM and EBPM, must be critically evaluated to ensure effective and high-quality health policy decisions. The cognitive information processing framework presented here will aid health policy decision makers by identifying how their decisions might be subtly influenced by non-rational factors. In this paper, we identify some of the biases and potential intervention points and provide some initial suggestions about how the EBDM/EBPM process can be improved.
Appendix
Available only for authorised users
Literature
1.
2.
Redd SB: The Influence of Advisors on Foreign Policy Decision Making. Journal of Conflict Resolution. 2002, 46: 335-364. 10.1177/0022002702046003002.
3.
Atkins D, Siegel J, Slutsky J: Making Policy When the Evidence is in Dispute. Health Affairs. 2005, 24: 102-113. 10.1377/hlthaff.24.1.102.PubMed
4.
Clancy CM, Cronin K: Evidence-Based Decision Making: Global Evidence, Local Decisions. Health Affairs. 2005, 24: 151-162. 10.1377/hlthaff.24.1.151.PubMed
5.
Fox DM: Evidence of Evidence-Based Health Policy: The Politics of Systematic Reviews in Coverage Decisions. Health Affairs. 2005, 24: 114-122. 10.1377/hlthaff.24.1.114.PubMed
6.
Isen AM: Positive Affect and Decision Making. Handbook of Emotions. Edited by: Lewis M, Haviland-Jones JM. 2000, New York: The Guilford Press, 417-435. 2
7.
Kuvaas B, Selart M: Effects of Attribute Framing on Cognitive Processing and Evaluation. Organizational Behavior and Human Decision Processes. 2004, 95: 198-207. 10.1016/j.obhdp.2004.08.001.
8.
Simon AF, Fagley NS, Halleran JG: Decision Framing: Moderating Effects of Differences and Cognitive Processing. Journal of Behavioral Decision Making. 2004, 17: 77-93. 10.1002/bdm.463.
9.
Wyer RS, Srull TK: The Processing of Social Stimulus Information: A Conceptual Integration. Person Memory: The Cognitive Basis of Social Perception. Edited by: Hastie R, Ostrom TM, Ebbesen EB, Wyer RS, Hamilton DL, Carlston DE. 1980, Hillsdale: Lawrence Erlbaum Associates, 227-300.
10.
Wyer RS, Srull TK: Human Cognition in its Social Context. Psychological Review. 1986, 93: 322-359. 10.1037/0033-295X.93.3.322.PubMed
11.
Flemming K, Fenton M: Making Sense of Research Evidence to Inform Decision-Making. Clinical Decision-Making and Judgment in Nursing. Edited by: Thompson C, Dowding D. 2002, Toronto: Harcourt Publishers, 110-129.
12.
Murnighan JK, Mowen JC: The Art of High-Stakes Decision Making. 2002, New York: John Wiley and Sons
13.
Nutley SM, Walter I, Davies HTO: Using Evidence: How Research Can Inform Public Services. 2007, The Policy Press
14.
Sanderson I: Making Sense of 'What Works': Evidence Based Policy Making as Instrumental Rationality?. Public Policy and Administration. 2002, 17: 61-75. 10.1177/095207670201700305.
15.
Soumerai SB, Ross-Degnan D, Fortress EE, Walser BL: Determinants of Change in Medicaid Pharmaceutical Cost Sharing: Does Evidence Affect Policy?. The Milbank Quarterly. 1997, 75: 11-34. 10.1111/1468-0009.00043.PubMedPubMedCentral
16.
Decter MB: Four Strong Winds: Understanding the Growing Challenges to Health Care. 2000, Toronto: Stoddart
17.
Goldsteen RL, Goldsteen K, Swan JH, Clemena W: Harry and Louise and Health Care Reform: Romancing Public Opinion. Journal of Health Politics, Policy, and Law. 2001, 26: 1325-1352. 10.1215/03616878-26-6-1325.
18.
Rodwin MA: The Politics of Evidence-Based Medicine. Journal of Health Politics, Policy, and Law. 2001, 26: 439-446. 10.1215/03616878-26-2-439.
19.
Howlett M, Ramesh M: Studying Public Policy: Policy Choices and Policy Subsystems. 2003, Don Mills: Oxford University Press
20.
Lomas J, Fulop N, Gagnon D, Allen P: On Being a Good Listener: Setting priorities for Applied Health Services Research. The Milbank Quarterly. 2003, 81: 363-388. 10.1111/1468-0009.t01-1-00060.PubMedPubMedCentral
21.
Manfredi CP, Maioni A: Courts and Health Policy: Judicial Policy Making and Publicly Funded Health Care in Canada. Journal of Health Politics, Policy, and Law. 2001, 27: 213-240. 10.1215/03616878-27-2-213.
22.
Lavis JN, Ross SE, Hurley JE, Stoddart GL, Woodward C, Abelson J, Giacomini M: Examining the Role of Health Services Research in Public Policymaking. The Milbank Quarterly. 2002, 80: 125-154. 10.1111/1468-0009.00005.PubMedPubMedCentral
23.
Lavis JN, Robertson D, Woodside JM, McLeod CB, Abelson J, Knowledge Transfer Study Group: How Can Research Organizations More Effectively Transfer Research Knowledge to Decision Makers?. The Milbank Quarterly. 2003, 81: 221-245. 10.1111/1468-0009.t01-1-00052.PubMedPubMedCentral
24.
Biller-Adorno N, Lie RK, Meulen RT: Evidence-Based Medicine as an Instrument for Rational Health Policy. Health Care Analysis. 2002, 10: 261-275. 10.1023/A:1022947707243.
25.
Lin V, Gibson B: Evidence-Based Health Policy. 2003, Melbourne: Oxford University Press
26.
Black N: Evidence Based Policy: Proceed With Care. British Medical Journal. 2001, 323: 275-279. 10.1136/bmj.323.7307.275.PubMedPubMedCentral
27.
Sanderson I: Evaluation, Policy Learning and Evidence-Based Policy Making. Public Administration. 2002, 80: 1-22. 10.1111/1467-9299.00292.
28.
Tversky A, Kahneman D: The Framing of Decisions and the Psychology of Choice. Science. 1981, 211: 453-458. 10.1126/science.7455683.PubMed
29.
Weiss C, Bucuvalas MJ: Social Science Research and Decision Making. 1980, New York: Columbia University Press
30.
Jones BD: Politics and the Architecture of Choice: Bounded Rationality and Governance. 2001, Chicago: University of Chicago Press
31.
Sabatier PA: Fostering the Development of Policy Theory. Theories of the Policy Process. Edited by: Sabatier PA. 1999, Boulder: Westview Press, 3-17.
32.
Simon HA: Decision Making and Problem Solving. Decision Making: Alternatives to Rational Choice. Edited by: Zey M. 1992, Newbury Park: Sage Publications, 32-53.
33.
Mulrow CD, Lohr KN: Proof and Policy From Medical Research Evidence. Journal of Health Politics, Policy, and Law. 2001, 26: 249-266. 10.1215/03616878-26-2-249.
34.
Peterson M: Editor's Note - Evidence: Its Meanings in Health Care and Law. Journal of Health Politics, Policy, and Law. 2001, 26: 191-193. 10.1215/03616878-26-2-191.
35.
Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations. The Milbank Quarterly. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.PubMedPubMedCentral
36.
Vos R, Houtepen R, Horstman K: Evidence-Based Medicine and Power Shifts in Health Care Systems. Health Care Analysis. 2002, 10: 319-328. 10.1023/A:1022908025898.PubMed
37.
Dobrow MJ, Goel V, Upshur REG: Evidence-Based Health Policy: Context and Utilization. Social Sciences and Medicine. 2004, 58: 207-217. 10.1016/S0277-9536(03)00166-7.
38.
Jacobson N, Butterill D, Goering P: Consulting as a Strategy for Knowledge Transfer. The Milbank Quarterly. 2005, 83: 299-321. 10.1111/j.1468-0009.2005.00348.x.PubMedPubMedCentral
39.
Gold M: The Changing US Health Care System: Challenges for Responsible Public Policy. The Milbank Quarterly. 1999, 77: 3-37. 10.1111/1468-0009.00123.PubMedPubMedCentral
40.
Walshe K, Rundall TG: Evidence-Based Management: From Theory to Practice in Health Care. The Milbank Quarterly. 2001, 79: 429-457. 10.1111/1468-0009.00214.PubMedPubMedCentral
41.
Lin V: Competing Rationalities: Evidence-Based Health Policy?. Evidence-Based Health Policy. Edited by: Lin V, Gibson B. 2003, Melbourne: Oxford University Press, 3-17.
42.
Willis E, White K: Evidence-Based Medicine, the Medical Profession, and Health Policy. Evidence-Based Health Policy. Edited by: Lin V, Gibson, B. 2003, Melbourne: Oxford University Press, 33-55.
43.
Zarkovich E, Upshur REG: The Virtues of Evidence. Theoretical Medicine. 2002, 23: 403-412. 10.1023/A:1021217908383.
44.
Simon HA: A Behavioral Model of Rational Choice. Quarterly Journal of Economics. 1955, 69: 99-118. 10.2307/1884852.
45.
Maynard RA: Presidential Address - Evidence-Based Decision Making: What Will it Take for the Decision Makers to Care?. Journal of Policy Analysis and Management. 2006, 25: 249-265. 10.1002/pam.20169.
46.
Simon HA: Bounded Rationality and Organizational Learning. Organization Science. 1991, 2: 125-135. 10.1287/orsc.2.1.125.
47.
Kahneman D, Tversky A: Prospect Theory: An Analysis of Decision Under Risk. Econometrica. 1979, 47: 263-291. 10.2307/1914185.
48.
Zey M: Criticisms of Rational Choice Models. Decision Making: Alternatives to Rational Choice Models. Edited by: Zey M. 1992, Newbury Park: Sage Publications, 10-31.
49.
Fernandes R, Simon HA: A Study of How Individuals Solve Complex and Ill-Structured Problems. Policy Sciences. 1999, 32: 225-245. 10.1023/A:1004668303848.
50.
Agosto DE: Bounded Rationality and Satisficing in Young Peoples' Web-Based Decision Making. Journal of the American Society for Information Science and Technology. 2001, 53: 16-27. 10.1002/asi.10024.
51.
Gupta M: A Critical Appraisal of Evidence-Based Medicine: Some Ethical Considerations. Journal of Evaluation in Clinical Practice. 2003, 9: 111-121. 10.1046/j.1365-2753.2003.00382.x.PubMed
52.
Norman G: Examining the Assumptions of Evidence-Based Medicine. Journal of Evaluation in Clinical Practice. 1999, 5: 139-147. 10.1046/j.1365-2753.1999.00197.x.PubMed
53.
Estabrooks CA: Research Utilization and Qualitative Research. The Nature of Qualitative Evidence. Edited by: Morse JM, Swanson J, Kuzel AF. 2001, Thousand Oaks: Sage Publications, 275-298.
54.
Jones BD: Reconceiving Decision-Making in Democratic Politics: Attention, Choice, and Public Policy. 1994, Chicago: University of Chicago Press
55.
Haddow R: Interest Representation and the Canadian State. Canadian Politics. Edited by: Bickerton J, Gagnon A. 1999, Peterborough: Broadview Press, 501-522.
56.
Brooks S, Miljan L: Public Policy in Canada: An Introduction. 2003, Toronto: Oxford University Press
57.
Stone D: Capturing the Political Imagination: Think Tanks and the Policy Process. 1996, Portland: Frank Cass
58.
Lightle JP, Kagel JH, Arkes HR: Information Exchange in Group Decision Making: The Hidden Profile Problem Reconsidered. Management Science. 2009, 55: 568-581. 10.1287/mnsc.1080.0975.
59.
Allison G, Zelikow P: Essence of Decision: Explaining the Cuban Missile Crisis. 1999, New York: Addison-WesleyEducational Publishers Inc
60.
Zey M: Criticisms of Rational Choice Models. Decision Making: Alternatives to Rational Choice Models. Edited by: Zey M. 1992, Newbury Park: Sage Publications, 9-31.
61.
Spitz B, Abramson J: When Health Policy is the Problem: A Report From the Field. Journal of Health Politics, Policy, and Law. 2005, 30: 327-365. 10.1215/03616878-30-3-327.
62.
Johnson RB: Toward a Theoretical Model of Evaluation Utilization. Evaluation and Program Planning. 1998, 21: 93-110. 10.1016/S0149-7189(97)00048-7.
63.
Srull TK, Wyer RS: The Role of Chronic and Temporary Goals in Social Information Processing. Handbook of Motivation and Cognition: Foundations of Social Behavior. Edited by: Sorrentino RM, Higgins ET. 1986, New York: The Guilford Press, 503-549.
64.
Lord RG, Maher KJ: Cognitive Processes in Industrial and Organizational Psychology. International Review of Industrial and Organizational Psychology. Edited by: Cooper CL, Robertson IT. 1989, New York: John Wiley and Sons, 49-91.
65.
Lord RG, Maher KJ: Leadership and Information Processing. 1991, Cambridge: Unwin Hyman Inc
66.
Bazerman MH: Judgment in Managerial Decision Making. 1998, New York: John Wiley and Sons, 4
67.
Slovic P, Monahan J: Probability, Danger, and Coercion: A Study of Risk Perception and Decision Making in Mental Health Law. The Perception of Risk. Edited by: Slovic, P. 2000, Sterling: Earthscan Publications Ltd, 347-36.
68.
Williams S, Zainuba M, Jackson R: Affective Influences on Risk Perceptions and Risk Intentions. Journal of Managerial Psychology. 2003, 18: 126-137. 10.1108/02683940310465027.
69.
Brief AP, Weiss HW: Organizational Behavior: Affect in the Workplace. Annual Review of Psychology. 2002, 53: 279-307. 10.1146/annurev.psych.53.100901.135156.PubMed
70.
Ubel PA, Baron J, Asch DA: Preference for Equity as a Framing Effect. Medical Decision Making. 2002, 21: 180-189.
71.
Levin IP, Schneider SL, Gaeth GJ: All Frames are not Created Equal: A Typology and Critical Analysis of Framing Effects. Organizational Behavior and Human Decision Processes. 1998, 76: 149-188. 10.1006/obhd.1998.2804.PubMed
72.
McElroy T, Seta JJ: Framing Effects: An Analytic-Holistic Perspective. Journal of Experimental Social Psychology. 2003, 39: 610-617. 10.1016/S0022-1031(03)00036-2.
73.
Mittal V, Ross WT: The Impact of Positive and Negative Affect and Issue Framing on Issue Interpretation and Risk Taking. Organizational Behavior and Human Decision Processes. 1998, 76: 298-324. 10.1006/obhd.1998.2808.PubMed
74.
Bless H, Betsch T, Franzen A: Framing the Framing Effect: The Impact of Context Cues on Solutions to the 'Asian Disease' Problem. European Journal of Social Psychology. 1999, 28: 287-291. 10.1002/(SICI)1099-0992(199803/04)28:2<287::AID-EJSP861>3.0.CO;2-U.
75.
Slovic P, Kunreuther H, White G: Decision Processes, Rationality, and Adjustment to Natural Hazards. The Perception of Risk. Edited by: Slovic, P. 2000, Sterling: Earthscan Publications Ltd, 1-31.
76.
Eich E, Schooler JW: Cognition/Emotion Interactions. Cognition and Emotion. Edited by: Eich E, Kihlstrom JF, Bower GH, Forgas JP, Niedenthal PM. 2000, New York: Oxford University Press, 87-168.
77.
Forgas JP, Vargas PT: The Effects of Mood on Social Judgment and Reasoning. Handbook of Emotions. Edited by: Lewis M, Haviland-Jones JM. 2000, New York: The Guilford Press, 350-367. 2
78.
Johnson-Laird PN, Oatley K: Cognitive and Social Construction in Emotions. Handbook of Emotions. Edited by: Lewis M, Haviland-Jones JM. 2000, New York: The Guilford Press, 458-475. 2
79.
Bower GH, Forgas JP: Mood and Social Memory. Handbook of Affect and Social Cognition. Edited by: Forgas JP. 2001, Mahwah: Lawrence Erlbaum Associates, Inc, 95-120.
80.
Clore GL, Gasper K, Garvin E: Affect as Information. Handbook of Affect and Social Cognition. Edited by: Forgas JP. 2001, Mahwah: Lawrence Erlbaum Associates, Inc, 121-144.
81.
George JM: State or Trait: Effects of Positive Mood on Prosocial Behaviors at Work. Journal of Applied Psychology. 1989, 76: 299-307. 10.1037/0021-9010.76.2.299.
82.
George JM: Mood and Absence. Journal of Applied Psychology. 1991, 74: 317-324. 10.1037/0021-9010.74.2.317.
83.
Wright TA, Cropanzano R, Meyer DG: State and Trait Correlates of Job Performance: A Tale of Two Perspectives. Journal of Business and Psychology. 2004, 18: 365-383. 10.1023/B:JOBU.0000016708.22925.72.
84.
Czajka J: The Relation of Positive and Negative Affectivity to Workplace Attitudes. Academy of Management Proceedings. 1990, 201-205.
85.
Cropanzano R, James K, Konovsky MA: Dispositional Affectivity as a Predictor of Work Attitudes and Job Performance. Journal of Organizational Behavior. 1993, 14: 595-606. 10.1002/job.4030140609.
86.
Adolphs R, Damasio AR: The Interaction of Affect and Cognition: A Neurobiological Perspective. Handbook of Affect and Social Cognition. Edited by: Forgas JP. 2001, Mahwah: Lawrence Erlbaum Associates, Inc, 27-49.
87.
Daniels K: Towards Integrating Emotions into Strategic Management Research: Trait Affect and Perceptions of the Strategic Environment. British Journal of Management. 1998, 9: 163-168. 10.1111/1467-8551.00081.
88.
Forgas JP: Affect and Information Processing Strategies: An Interactive Relationship. Feeling and Thinking: The Role of Affect in Social Cognition. Edited by: Forgas JP. 2000, New York: Cambridge University Press, 253-282.
89.
Forgas JP: Mood and Judgment: The Affect Infusion Model (AIM). Psychological Bulletin. 1995, 117: 39-66. 10.1037/0033-2909.117.1.39.PubMed
90.
Forgas JP: Affect, Cognition, and Interpersonal Behavior: The Mediating Role of Processing Strategies. Handbook of Affect and Social Cognition. Edited by: Forgas JP. 2001, Mahwah: Lawrence Erlbaum Associates, Inc, 293-318.
91.
Jundt DK, Hinsz VB: Influences of Positive and Negative Affect on Decisions Involving Judgmental Biases. Social Behavior and Personality. 2002, 30: 45-52. 10.2224/sbp.2002.30.1.45.
92.
Fiedler K: Affective Influences on Social Information Processing. Handbook of Affect and Social Cognition. Edited by: Forgas JP. 2001, Mahwah: Lawrence Erlbaum Associates, Inc, 163-185.
93.
Forgas JP, George JM: Affective Influences on Judgments and Behavior in Organizations: An Information Perspective. Organizational Behavior and Human Decision Processes. 2001, 86: 3-34. 10.1006/obhd.2001.2971.
94.
Slattery JP, Ganster DC: Determinants of Risk Taking in a Dynamic Uncertain Context. Journal of Management. 2002, 28: 89-106. 10.1177/014920630202800106.
95.
Slovic P: Perception of Risk. The Perception of Risk. Edited by: Slovic P. 2000, Sterling: Earthscan Publications Ltd, 220-231.
96.
97.
Kuhn TS: The Structure of Scientific Revolutions. 1996, Chicago: The University of Chicago Press, 3
98.
Kuhn TS: The Nature and Necessity of Scientific Revolutions. Scientific Knowledge: Basic Issues in the Philosophy of Science. Edited by: Kourany JA. 1998, Belmont: Wadsworth Publishing Company, 316-326. 2
99.
Kourany JA: The Validation of Scientific Knowledge. Scientific Knowledge: Basic Issues in the Philosophy of Science. Edited by: Kourany JA. 1998, Belmont: Wadsworth Publishing Company, 153-163. 2
100.
Sackett DL, Rosenberg WMC, Gray JAM, Haynes RB, Richardson WS: Evidence-Based Medicine: What it is and What it isn't. British Medical Journal. 1996, 312: 71-72.PubMedPubMedCentral
101.
Burrell G, Morgan G: Sociological Paradigms and Organizational Analysis. 1979, London: Heinemann Books
102.
Innvaer S, Vist G, Trommald M, Oxman A: Health Policy-Makers' Perceptions of Their Use of Evidence: A Systematic Review. Journal of Health Services Research and Policy. 2002, 7: 239-244. 10.1258/135581902320432778.PubMed
103.
Garvin DA, Roberto MA: What You Don't Know About Making Decisions. Harvard Business Review. 2001, 108-116.
104.
Delbecq AL, Van de Ven AH: A Group Process Model for Problem Identification and Program Planning. Journal of Applied Behavioral Science. 1971, 7: 466-491. 10.1177/002188637100700404.
Metadata
Title
Rationality versus reality: the challenges of evidence-based decision making for health policy makers
Authors
Deirdre McCaughey
Nealia S Bruning
Publication date
01-12-2010
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2010
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-5-39

Other articles of this Issue 1/2010

Implementation Science 1/2010 Go to the issue

Research article

Part I, Patient perspective: activating patients to engage their providers in the use of evidence-based medicine: a qualitative evaluation of the VA Project to Implement Diuretics (VAPID)

Research article

The relationship between baseline Organizational Readiness to Change Assessment subscale scores and implementation of hepatitis prevention services in substance use disorders treatment clinics: a case study

Study protocol

Patient safety in Dutch primary care: a study protocol

Study protocol

Effective continuing professional development for translating shared decision making in primary care: A study protocol

Study protocol

Making sense of health information technology implementation: A qualitative study protocol

Study protocol

The Reinforcing Therapist Performance (RTP) experiment: Study protocol for a cluster randomized trial