GTM: The generative topographic mapping

被引:835
作者
Bishop, CM [1 ]
Svensen, M [1 ]
Williams, CKI [1 ]
机构
[1] Aston Univ, Dept Comp Sci & Appl Math, Neural Comp Res Grp, Birmingham B4 7ET, W Midlands, England
关键词
D O I
10.1162/089976698300017953
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Latent variable models represent the probability density of data in a space of several dimensions in terms of a smaller number of latent, or hidden, variables. A familiar example is factor analysis, which is based on a linear transformation between the latent space and the data space. In this article, we introduce a form of nonlinear latent variable model tailed the generative topographic mapping, for which the parameters of the model can be determined using the expectation-maximization algorithm. GTM provides a principled alternative to the widely used self-organizing map (SOM) of Kohonen (1982) and overcomes most of the significant limitations of the SOM. We demonstrate the performance of the GTM algorithm on a toy problem and on simulated data from now diagnostics for a multiphase oil pipeline.
引用
收藏
页码:215 / 234
页数:20
相关论文
共 27 条
[1]  
[Anonymous], 1979, Multivariate analysis
[2]  
Bishop C. M., 1995, NEURAL NETWORKS PATT
[3]   ANALYSIS OF MULTIPHASE FLOWS USING DUAL-ENERGY GAMMA DENSITOMETRY AND NEURAL NETWORKS [J].
BISHOP, CM ;
JAMES, GD .
NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION A-ACCELERATORS SPECTROMETERS DETECTORS AND ASSOCIATED EQUIPMENT, 1993, 327 (2-3) :580-593
[4]  
Bishop CM, 1996, ADV NEUR IN, V8, P465
[5]  
BISHOP CM, IN PRESS P 5 IEE INT, P64
[6]   VECTOR QUANTIZATION WITH COMPLEXITY COSTS [J].
BUHMANN, J ;
KUHNEL, H .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1993, 39 (04) :1133-1145
[7]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[8]   AN ANALOG APPROACH TO THE TRAVELING SALESMAN PROBLEM USING AN ELASTIC NET METHOD [J].
DURBIN, R ;
WILLSHAW, D .
NATURE, 1987, 326 (6114) :689-691
[9]   SELF-ORGANIZING MAPS - ORDERING, CONVERGENCE PROPERTIES AND ENERGY FUNCTIONS [J].
ERWIN, E ;
OBERMAYER, K ;
SCHULTEN, K .
BIOLOGICAL CYBERNETICS, 1992, 67 (01) :47-55
[10]   PRINCIPAL CURVES [J].
HASTIE, T ;
STUETZLE, W .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1989, 84 (406) :502-516