Dimension reduction in regression without matrix inversion

被引:67
作者
Cook, Dennis [1 ]
Li, Bing
Chiaromonte, Francesca
机构
[1] Univ Minnesota, Sch Stat, Minneapolis, MN 55455 USA
[2] Penn State Univ, Dept Stat, University Pk, PA 16802 USA
关键词
central subspace; Sigma-envelope; singularity of sample covariance;
D O I
10.1093/biomet/asm038
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Regressions in which the fixed number of predictors p exceeds the number of independent observational units n occur in a variety of scientific fields. Sufficient dimension reduction provides a promising approach to such problems, by restricting attention to d < n linear combinations of the original p predictors. However, standard methods of sufficient dimension reduction require inversion of the sample predictor covariance matrix. We propose a method for estimating the central subspace that eliminates the need for such inversion and is applicable regardless of the ( n, p) relationship. Simulations show that our method compares favourably with standard large sample techniques when the latter are applicable. We illustrate our method with a genomics application.
引用
收藏
页码:569 / 584
页数:16
相关论文
共 27 条
[1]  
[Anonymous], 1922, Philosophical Transactions of the Royal Society of London A, DOI [10.1098/rsta.1922.0009, DOI 10.1098/RSTA.1922.0009]
[2]   Corrections to test statistics in principal Hessian directions [J].
Bentler, PM ;
Xie, J .
STATISTICS & PROBABILITY LETTERS, 2000, 47 (04) :381-389
[3]  
Bickel Peter J, 1993, Efficient and adaptive estimation for semiparametric models, V4
[4]   Dimension reduction strategies for analyzing global gene expression data with a response [J].
Chiaromonte, F ;
Martinelli, J .
MATHEMATICAL BIOSCIENCES, 2002, 176 (01) :123-144
[5]  
COOK R. D., 1998, WILEY PROB STAT
[6]   Using intraslice covariances for improved estimation of the central subspace in regression [J].
Cook, RD ;
Ni, LQ .
BIOMETRIKA, 2006, 93 (01) :65-74
[7]   Determining the dimension of iterative Hessian transformation [J].
Cook, RD ;
Bing, L .
ANNALS OF STATISTICS, 2004, 32 (06) :2501-2531
[8]   Sufficient dimension reduction via inverse regression: A minimum discrepancy approach [J].
Cook, RD ;
Ni, LQ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2005, 100 (470) :410-428
[9]   Dimension reduction for conditional mean in regression [J].
Cook, RD ;
Bing, L .
ANNALS OF STATISTICS, 2002, 30 (02) :455-474
[10]  
CORTES C, 1995, MACH LEARN, V20, P273, DOI 10.1023/A:1022627411411