A visual analytics system for multi-model comparison on clinical data predictions

被引:22
作者
Li, Yiran [1 ]
Fujiwara, Takanori [1 ]
Choi, Yong K. [2 ]
Kim, Katherine K. [2 ,3 ]
Ma, Kwan-Liu [1 ]
机构
[1] Univ Calif Davis, Dept Comp Sci, Davis, CA 95616 USA
[2] Univ Calif Davis, Betty Irene Moore Sch Nursing, Davis, CA 95616 USA
[3] Univ Calif Davis, Sch Med, Davis, CA 95616 USA
基金
美国国家科学基金会;
关键词
Clinical data; XAI; Tree-based machine learning models; Model consistency; Measures of dependence; Visual analytics; STABILITY; BOUNDS;
D O I
10.1016/j.visinf.2020.04.005
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
There is a growing trend of applying machine learning methods to medical datasets in order to predict patients' future status. Although some of these methods achieve high performance, challenges still exist in comparing and evaluating different models through their interpretable information. Such analytics can help clinicians improve evidence-based medical decision making. In this work, we develop a visual analytics system that compares multiple models' prediction criteria and evaluates their consistency. With our system, users can generate knowledge on different models' inner criteria and how confidently we can rely on each model's prediction for a certain patient. Through a case study of a publicly available clinical dataset, we demonstrate the effectiveness of our visual analytics system to assist clinicians and researchers in comparing and quantitatively evaluating different machine learning methods. (C) 2020 The Author(s). Published by Elsevier B.V. on behalf of Zhejiang University and Zhejiang University Press Co. Ltd.
引用
收藏
页码:122 / 131
页数:10
相关论文
共 53 条
[11]  
DEVROYE L, 1991, NATO ADV SCI I C-MAT, V335, P31
[12]   DISTRIBUTION-FREE PERFORMANCE BOUNDS FOR POTENTIAL FUNCTION RULES [J].
DEVROYE, LP ;
WAGNER, TJ .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1979, 25 (05) :601-604
[13]  
Dorogush A.V., 2018, ARXIVABS181011363 CO
[14]  
Fouad M., 2015, INT J ADV COMP RES, V3, P185
[15]   Greedy function approximation: A gradient boosting machine [J].
Friedman, JH .
ANNALS OF STATISTICS, 2001, 29 (05) :1189-1232
[16]   Supporting Analysis of Dimensionality Reduction Results with Contrastive Learning [J].
Fujiwara, Takanori ;
Kwon, Oh-Hyun ;
Ma, Kwan-Liu .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2020, 26 (01) :45-55
[17]   Prediction of 3-yr cadaveric graft survival based on pre-transplant variables in a large national dataset [J].
Goldfarb-Rumyantzev, AS ;
Scandling, JD ;
Pappas, L ;
Smout, RJ ;
Horn, S .
CLINICAL TRANSPLANTATION, 2003, 17 (06) :485-497
[18]   Visual Progression Analysis of Event Sequence Data [J].
Guo, Shunan ;
Jin, Zhuochen ;
Gotz, David ;
Du, Fan ;
Zha, Hongyuan ;
Cao, Nan .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2019, 25 (01) :417-426
[19]  
Haussler D, 1995, PART 1 OVERVIEW PROB
[20]  
Jin Z., 2019, ACM T COMPUT HEALTHC