Skip to main content
Top
Published in: Medicine, Health Care and Philosophy 1/2020

01-03-2020 | Artificial Intelligence | Scientific Contribution

The right to refuse diagnostics and treatment planning by artificial intelligence

Authors: Thomas Ploug, Søren Holm

Published in: Medicine, Health Care and Philosophy | Issue 1/2020

Login to get access

Abstract

In an analysis of artificially intelligent systems for medical diagnostics and treatment planning we argue that patients should be able to exercise a right to withdraw from AI diagnostics and treatment planning for reasons related to (1) the physician’s role in the patients’ formation of and acting on personal preferences and values, (2) the bias and opacity problem of AI systems, and (3) rational concerns about the future societal effects of introducing AI systems in the health care sector.
Footnotes
1
In this paper we use the term ‘AI systems’ to cover both systems based on ‘symbolic AI’ and systems based on machine learning techniques such as deep learning and neural networks.
 
2
In this paper we use the term ‘physician’. Diagnostic and treatment decisions are also made by many other types of health care professionals, but we are focusing on medical doctors because they are involved in many of these decisions.
 
3
There is a parallel issue raised by AI controlled treatment, e.g. AI controlled surgical robots, but this is outside the scope of this paper.
 
Literature
go back to reference Bedi, G., F. Carrillo, G.A. Cecchi, D.F. Slezak, M. Sigman, N.B. Mota, et al. 2015. Automated Analysis of Free Speech Predicts Psychosis Onset in High-Risk Youths. npj Schizophrenia 1: 15030.CrossRef Bedi, G., F. Carrillo, G.A. Cecchi, D.F. Slezak, M. Sigman, N.B. Mota, et al. 2015. Automated Analysis of Free Speech Predicts Psychosis Onset in High-Risk Youths. npj Schizophrenia 1: 15030.CrossRef
go back to reference Bird, S., S. Barocas, K. Crawford, F. Diaz, H. Wallach. 2016. Exploring or Exploiting? Social and Ethical Implications of Autonomous Experimentation in AI. Rochester: Social Science Research Network. Report No.: ID 2846909. https://papers.ssrn.com/abstract=2846909. Accessed 29 May 2018. Bird, S., S. Barocas, K. Crawford, F. Diaz, H. Wallach. 2016. Exploring or Exploiting? Social and Ethical Implications of Autonomous Experimentation in AI. Rochester: Social Science Research Network. Report No.: ID 2846909. https://​papers.​ssrn.​com/​abstract=​2846909. Accessed 29 May 2018.
go back to reference Bostrom, N. 2014. Superintelligence: Paths, Dangers, Strategies, 352. Oxford, New York: Oxford University Press. Bostrom, N. 2014. Superintelligence: Paths, Dangers, Strategies, 352. Oxford, New York: Oxford University Press.
go back to reference Bostrom, N. 2017. Strategic Implications of Openness in AI Development. Global Policy 8 (2): 135–148.CrossRef Bostrom, N. 2017. Strategic Implications of Openness in AI Development. Global Policy 8 (2): 135–148.CrossRef
go back to reference Bozdag, E. 2013. Bias in Algorithmic Filtering and Personalization. Ethics and Information Technology 15 (3): 209–227.CrossRef Bozdag, E. 2013. Bias in Algorithmic Filtering and Personalization. Ethics and Information Technology 15 (3): 209–227.CrossRef
go back to reference Burrell, J. 2016. How the Machine ‘Thinks’: Understanding Opacity in Machine Learning Algorithms. Big Data & Society 3 (1): 2053951715622512.CrossRef Burrell, J. 2016. How the Machine ‘Thinks’: Understanding Opacity in Machine Learning Algorithms. Big Data & Society 3 (1): 2053951715622512.CrossRef
go back to reference Cabitza, F., R. Rasoini, and G.F. Gensini. 2017. Unintended Consequences of Machine Learning in Medicine. JAMA 318 (6): 517–518.CrossRef Cabitza, F., R. Rasoini, and G.F. Gensini. 2017. Unintended Consequences of Machine Learning in Medicine. JAMA 318 (6): 517–518.CrossRef
go back to reference Calders, T., and S. Verwer. 2010. Three Naive Bayes Approaches for Discrimination-Free Classification. Data Mining and Knowledge Discovery 21 (2): 277–292.CrossRef Calders, T., and S. Verwer. 2010. Three Naive Bayes Approaches for Discrimination-Free Classification. Data Mining and Knowledge Discovery 21 (2): 277–292.CrossRef
go back to reference Dilsizian, S.E., and E.L. Siegel. 2014. Artificial Intelligence in Medicine and Cardiac Imaging: Harnessing Big Data and Advanced Computing to Provide Personalized Medical Diagnosis and Treatment. Current Cardiology Reports 16 (1): 441.CrossRef Dilsizian, S.E., and E.L. Siegel. 2014. Artificial Intelligence in Medicine and Cardiac Imaging: Harnessing Big Data and Advanced Computing to Provide Personalized Medical Diagnosis and Treatment. Current Cardiology Reports 16 (1): 441.CrossRef
go back to reference Dunbar-Jacob, J., and M.K. Mortimer-Stephens. 2001. Treatment Adherence in Chronic Disease. Journal of Clinical Epidemiology 54 (12, Supplement 1): S57–S60.CrossRef Dunbar-Jacob, J., and M.K. Mortimer-Stephens. 2001. Treatment Adherence in Chronic Disease. Journal of Clinical Epidemiology 54 (12, Supplement 1): S57–S60.CrossRef
go back to reference Esteva, A., B. Kuprel, R.A. Novoa, J. Ko, S.M. Swetter, H.M. Blau, et al. 2017. Dermatologist-Level Classification of Skin Cancer with Deep Neural Networks. Nature 542 (7639): 115–118.CrossRef Esteva, A., B. Kuprel, R.A. Novoa, J. Ko, S.M. Swetter, H.M. Blau, et al. 2017. Dermatologist-Level Classification of Skin Cancer with Deep Neural Networks. Nature 542 (7639): 115–118.CrossRef
go back to reference Friedman, B., and H. Nissenbaum. 1996. Bias in Computer Systems. ACM Transactions on Information Systems 14 (3): 330–347.CrossRef Friedman, B., and H. Nissenbaum. 1996. Bias in Computer Systems. ACM Transactions on Information Systems 14 (3): 330–347.CrossRef
go back to reference Goddard, K., A. Roudsari, and J.C. Wyatt. 2012. Automation Bias: A Systematic Review of Frequency, Effect Mediators, and Mitigators. Journal of the American Medical Informatics Association 19 (1): 121–127.CrossRef Goddard, K., A. Roudsari, and J.C. Wyatt. 2012. Automation Bias: A Systematic Review of Frequency, Effect Mediators, and Mitigators. Journal of the American Medical Informatics Association 19 (1): 121–127.CrossRef
go back to reference Goddard, K., A. Roudsari, and J.C. Wyatt. 2014. Automation Bias: Empirical Results Assessing Influencing Factors. International Journal of Medical Informatics 83 (5): 368–375.CrossRef Goddard, K., A. Roudsari, and J.C. Wyatt. 2014. Automation Bias: Empirical Results Assessing Influencing Factors. International Journal of Medical Informatics 83 (5): 368–375.CrossRef
go back to reference Habermas, J. 2018. Inclusion of the Other: Studies in Political Theory, 341. Hoboken: Wiley. Habermas, J. 2018. Inclusion of the Other: Studies in Political Theory, 341. Hoboken: Wiley.
go back to reference Hoff, T. 2011. Deskilling and Adaptation Among Primary Care Physicians Using Two Work Innovations. Health Care Management Review 36 (4): 338–348.CrossRef Hoff, T. 2011. Deskilling and Adaptation Among Primary Care Physicians Using Two Work Innovations. Health Care Management Review 36 (4): 338–348.CrossRef
go back to reference Ipsos, M.O.R.I. 2017. Public Views of Machine Learning. Report Title:92. Ipsos, M.O.R.I. 2017. Public Views of Machine Learning. Report Title:92.
go back to reference Jiang, L., C.C. Yang. 2016. Personalized Recommendation in Online Health Communities with Heterogeneous Network Mining. In 2016 IEEE International Conference on Healthcare Informatics (ICHI), 281–284. Jiang, L., C.C. Yang. 2016. Personalized Recommendation in Online Health Communities with Heterogeneous Network Mining. In 2016 IEEE International Conference on Healthcare Informatics (ICHI), 281–284.
go back to reference Krämer, N.C., and S. Winter. 2008. Impression Management 2.0: The Relationship of Self-esteem, Extraversion, Self-efficacy, and Self-presentation Within Social Networking Sites. Journal of Media Psychology: Theories, Methods, and Applications 20 (3): 106–116.CrossRef Krämer, N.C., and S. Winter. 2008. Impression Management 2.0: The Relationship of Self-esteem, Extraversion, Self-efficacy, and Self-presentation Within Social Networking Sites. Journal of Media Psychology: Theories, Methods, and Applications 20 (3): 106–116.CrossRef
go back to reference Leung, M.K.K., A. Delong, B. Alipanahi, and B.J. Frey. 2016. Machine Learning in Genomic Medicine: A Review of Computational Problems and Data Sets. Proceedings of the IEEE 104 (1): 176–197.CrossRef Leung, M.K.K., A. Delong, B. Alipanahi, and B.J. Frey. 2016. Machine Learning in Genomic Medicine: A Review of Computational Problems and Data Sets. Proceedings of the IEEE 104 (1): 176–197.CrossRef
go back to reference Mittelstadt, B.D., and L. Floridi. 2015. The Ethics of Big Data: Current and Foreseeable Issues in Biomedical Contexts. Science and Engineering Ethics 22 (2): 303–341.CrossRef Mittelstadt, B.D., and L. Floridi. 2015. The Ethics of Big Data: Current and Foreseeable Issues in Biomedical Contexts. Science and Engineering Ethics 22 (2): 303–341.CrossRef
go back to reference Morrell, R.W., D.C. Park, D.P. Kidder, and M. Martin. 1997. Adherence to Antihypertensive Medications Across the Life Span. Gerontologist 37 (5): 609–619.CrossRef Morrell, R.W., D.C. Park, D.P. Kidder, and M. Martin. 1997. Adherence to Antihypertensive Medications Across the Life Span. Gerontologist 37 (5): 609–619.CrossRef
go back to reference Powles, J., and H. Hodson. 2017. Google DeepMind and Healthcare in an Age of Algorithms. Health and Technology 7 (4): 351–367.CrossRef Powles, J., and H. Hodson. 2017. Google DeepMind and Healthcare in an Age of Algorithms. Health and Technology 7 (4): 351–367.CrossRef
go back to reference Rawls, J. 2005. Political Liberalism, 589. New York: Columbia University Press. Rawls, J. 2005. Political Liberalism, 589. New York: Columbia University Press.
go back to reference Schermer, B.W. 2011. The Limits of Privacy in Automated Profiling and Data Mining. Computer Law & Security Review 27 (1): 45–52.CrossRef Schermer, B.W. 2011. The Limits of Privacy in Automated Profiling and Data Mining. Computer Law & Security Review 27 (1): 45–52.CrossRef
go back to reference Stein, N., and K. Brooks. 2017. A Fully Automated Conversational Artificial Intelligence for Weight Loss: Longitudinal Observational Study Among Overweight and Obese Adults. JMIR Diabetes 2 (2): e28.CrossRef Stein, N., and K. Brooks. 2017. A Fully Automated Conversational Artificial Intelligence for Weight Loss: Longitudinal Observational Study Among Overweight and Obese Adults. JMIR Diabetes 2 (2): e28.CrossRef
go back to reference Sunstein, C.R., D. Kahneman, D. Schkade, and I. Ritov. 2002. Predictably Incoherent Judgments. Stanford Law Review 54 (6): 1153–1215.CrossRef Sunstein, C.R., D. Kahneman, D. Schkade, and I. Ritov. 2002. Predictably Incoherent Judgments. Stanford Law Review 54 (6): 1153–1215.CrossRef
go back to reference Thaler, R.H. 2000. From Homo Economicus to Homo Sapiens. The Journal of Economic Perspectives 14 (1): 133–141.CrossRef Thaler, R.H. 2000. From Homo Economicus to Homo Sapiens. The Journal of Economic Perspectives 14 (1): 133–141.CrossRef
go back to reference Tversky, A., and D. Kahneman. 1986. Rational Choice and the Framing of Decisions. The Journal of Business 59 (4): S251–S278.CrossRef Tversky, A., and D. Kahneman. 1986. Rational Choice and the Framing of Decisions. The Journal of Business 59 (4): S251–S278.CrossRef
go back to reference Vellido, A. 2019. Societal Issues Concerning the Application of Artificial Intelligence in Medicine. KDD 5 (1): 11–17. Vellido, A. 2019. Societal Issues Concerning the Application of Artificial Intelligence in Medicine. KDD 5 (1): 11–17.
go back to reference Weng, S.F., J. Reps, J. Kai, J.M. Garibaldi, and N. Qureshi. 2017. Can Machine-Learning Improve Cardiovascular Risk Prediction Using Routine Clinical Data? PLoS ONE 12 (4): e0174944.CrossRef Weng, S.F., J. Reps, J. Kai, J.M. Garibaldi, and N. Qureshi. 2017. Can Machine-Learning Improve Cardiovascular Risk Prediction Using Routine Clinical Data? PLoS ONE 12 (4): e0174944.CrossRef
go back to reference Zarsky, T.Z. 2013. Transparent Predictions. University of Illinois Law Review 2013: 1503. Zarsky, T.Z. 2013. Transparent Predictions. University of Illinois Law Review 2013: 1503.
go back to reference Zarsky, T. 2016. The Trouble with Algorithmic Decisions: An Analytic Road Map to Examine Efficiency and Fairness in Automated and Opaque Decision Making. Science, Technology and Human Values 41 (1): 118–132.CrossRef Zarsky, T. 2016. The Trouble with Algorithmic Decisions: An Analytic Road Map to Examine Efficiency and Fairness in Automated and Opaque Decision Making. Science, Technology and Human Values 41 (1): 118–132.CrossRef
Metadata
Title
The right to refuse diagnostics and treatment planning by artificial intelligence
Authors
Thomas Ploug
Søren Holm
Publication date
01-03-2020
Publisher
Springer Netherlands
Published in
Medicine, Health Care and Philosophy / Issue 1/2020
Print ISSN: 1386-7423
Electronic ISSN: 1572-8633
DOI
https://doi.org/10.1007/s11019-019-09912-8

Other articles of this Issue 1/2020

Medicine, Health Care and Philosophy 1/2020 Go to the issue

Scientific Contribution

Schrödinger’s Fetus