Late Fusion Incomplete Multi-View Clustering

被引:302
作者
Liu, Xinwang [1 ]
Zhu, Xinzhong [2 ,3 ]
Li, Miaomiao [4 ]
Wang, Lei [5 ]
Tang, Chang [6 ]
Yin, Jianping [7 ]
Shen, Dinggang [8 ,9 ,10 ]
Wang, Huaimin [1 ]
Gao, Wen [11 ]
机构
[1] Natl Univ Def Technol, Sch Comp, Changsha 410073, Hunan, Peoples R China
[2] Zhejiang Normal Univ, Coll Math Phys & Informat Engn, Jinhua 321004, Zhejiang, Peoples R China
[3] Res Inst Ningbo Cixing Co Ltd, Ningbo 315336, Zhejiang, Peoples R China
[4] Changsha Coll, Dept Comp, Changsha 410073, Hunan, Peoples R China
[5] Univ Wollongong, Sch Comp & Informat Technol, Wollongong, NSW 2522, Australia
[6] China Univ Geosci, Sch Comp Sci, Wuhan 430074, Hubei, Peoples R China
[7] Dongguan Univ Technol, Dongguan 511700, Guangdong, Peoples R China
[8] Univ N Carolina, Dept Radiol, Chapel Hill, NC 27599 USA
[9] Univ N Carolina, BRIC, Chapel Hill, NC 27599 USA
[10] Korea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea
[11] Peking Univ, Sch Elect Engn & Comp Sci, Beijing 100871, Peoples R China
基金
国家重点研发计划;
关键词
Multiple kernel clustering; multiple view learning; incomplete kernel learning;
D O I
10.1109/TPAMI.2018.2879108
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Incomplete multi-view clustering optimally integrates a group of pre-specified incomplete views to improve clustering performance. Among various excellent solutions, multiple kernel k-means with incomplete kernels forms a benchmark, which redefines the incomplete multi-view clustering as a joint optimization problem where the imputation and clustering are alternatively performed until convergence. However, the comparatively intensive computational and storage complexities preclude it from practical applications. To address these issues, we propose Late Fusion Incomplete Multi-view Clustering (LF-IMVC) which effectively and efficiently integrates the incomplete clustering matrices generated by incomplete views. Specifically, our algorithm jointly learns a consensus clustering matrix, imputes each incomplete base matrix, and optimizes the corresponding permutation matrices. We develop a three-step iterative algorithm to solve the resultant optimization problem with linear computational complexity and theoretically prove its convergence. Further, we conduct comprehensive experiments to study the proposed LF-IMVC in terms of clustering accuracy, running time, advantages of late fusion multi-view clustering, evolution of the learned consensus clustering matrix, parameter sensitivity and convergence. As indicated, our algorithm significantly and consistently outperforms some state-of-the-art algorithms with much less running time and memory.
引用
收藏
页码:2410 / 2423
页数:14
相关论文
共 38 条
[1]  
[Anonymous], 2016, P 33 INT C INT C MAC
[2]  
[Anonymous], 2013, P AAAI
[3]  
[Anonymous], 1993, ADV NEURAL INFORM PR
[4]  
[Anonymous], 2017, P IJCAI AUG, DOI DOI 10.24963/IJCAI.2017/396
[5]   Multi-view kernel completion [J].
Bhadra, Sahely ;
Kaski, Samuel ;
Rousu, Juho .
MACHINE LEARNING, 2017, 106 (05) :713-739
[6]   Multi-view clustering [J].
Bickel, S ;
Scheffer, T .
FOURTH IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, 2004, :19-26
[7]   Multiview Clustering: A Late Fusion Approach Using Latent Models [J].
Bruno, Eric ;
Marchand-Maillet, Stephane .
PROCEEDINGS 32ND ANNUAL INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2009, :736-737
[8]   Sparse Multi-View Consistency for Object Segmentation [J].
Djelouah, Abdelaziz ;
Franco, Jean-Sebastien ;
Boyer, Edmond ;
Le Clerc, Francois ;
Perez, Patrick .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (09) :1890-1903
[9]   Multi-View Object Segmentation in Space and Time [J].
Djelouah, Abdelaziz ;
Franco, Jean-Sebastien ;
Boyer, Edmond ;
Le Clerc, Francois ;
Perez, Patrick .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :2640-2647
[10]  
Du L, 2015, PROCEEDINGS OF THE TWENTY-FOURTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI), P3476