Latent bias and the implementation of artificial intelligence in medicine

被引:109
作者
DeCamp, Matthew [1 ]
Lindvall, Charlotta [2 ,3 ,4 ]
机构
[1] Univ Colorado, Dept Med, Aurora, CO 80045 USA
[2] Dana Farber Canc Inst, Dept Psychosocial Oncol & Palliat Care, Boston, MA 02115 USA
[3] Brigham & Womens Hosp, Dept Med, 75 Francis St, Boston, MA 02115 USA
[4] Harvard Univ Boston, Harvard Med Sch, Boston, MA USA
关键词
artificial intelligence; machine learning; bias; clinical decision support; health informatics; HEALTH;
D O I
10.1093/jamia/ocaa094
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Increasing recognition of biases in artificial intelligence (AI) algorithms has motivated the quest to build fair models, free of biases. However, building fair models may be only half the challenge. A seemingly fair model could involve, directly or indirectly, what we call "latent biases." Just as latent errors are generally described as errors "waiting to happen" in complex systems, latent biases are biases waiting to happen. Here we describe 3 major challenges related to bias in Al algorithms and propose several ways of managing them. There is an urgent need to address latent biases before the widespread implementation of Al algorithms in clinical practice.
引用
收藏
页码:2020 / 2023
页数:4
相关论文
共 15 条
[1]  
[Anonymous], 2019, Deep medicine: how artificial intelligence can make healthcare human again
[2]   Computerization and the future of primary care: A survey of general practitioners in the UK [J].
Blease, Charlotte ;
Bernstein, Michael H. ;
Gaab, Jens ;
Kaptchuk, Ted J. ;
Kossowsky, Joe ;
Mandl, Kenneth D. ;
Davis, Roger B. ;
DesRoches, Catherine M. .
PLOS ONE, 2018, 13 (12)
[3]   Artificial intelligence, bias and clinical safety [J].
Challen, Robert ;
Denny, Joshua ;
Pitt, Martin ;
Gompels, Luke ;
Edwards, Tom ;
Tsaneva-Atanasova, Krasimira .
BMJ QUALITY & SAFETY, 2019, 28 (03) :231-237
[4]   Implementing Machine Learning in Health Care - Addressing Ethical Challenges [J].
Char, Danton S. ;
Shah, Nigam H. ;
Magnus, David .
NEW ENGLAND JOURNAL OF MEDICINE, 2018, 378 (11) :981-983
[5]  
Frost R, 2019, TLS-TIMES LIT SUPPL, P6
[6]   Artificial Intelligence in Health Care A Report From the National Academy of Medicine [J].
Matheny, Michael E. ;
Whicher, Danielle ;
Thadaney Israni, Sonoo .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2020, 323 (06) :509-510
[7]   The medical AI insurgency: what physicians must know about data to practice with intelligent machines [J].
Miller, D. Douglas .
NPJ DIGITAL MEDICINE, 2019, 2 (1)
[8]  
Obermeyer Z., 2020, NEJM Catal Innov Care Deliv, DOI [10.1056/CAT.19.1090, DOI 10.1056/CAT.19.1090]
[9]   Dissecting racial bias in an algorithm used to manage the health of populations [J].
Obermeyer, Ziad ;
Powers, Brian ;
Vogeli, Christine ;
Mullainathan, Sendhil .
SCIENCE, 2019, 366 (6464) :447-+
[10]   Addressing Bias in Artificial Intelligence in Health Care [J].
Parikh, Ravi B. ;
Teeple, Stephanie ;
Navathe, Amol S. .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2019, 322 (24) :2377-2378