Dimension reduction in regression without matrix inversion

被引:67
作者
Cook, Dennis [1 ]
Li, Bing
Chiaromonte, Francesca
机构
[1] Univ Minnesota, Sch Stat, Minneapolis, MN 55455 USA
[2] Penn State Univ, Dept Stat, University Pk, PA 16802 USA
关键词
central subspace; Sigma-envelope; singularity of sample covariance;
D O I
10.1093/biomet/asm038
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Regressions in which the fixed number of predictors p exceeds the number of independent observational units n occur in a variety of scientific fields. Sufficient dimension reduction provides a promising approach to such problems, by restricting attention to d < n linear combinations of the original p predictors. However, standard methods of sufficient dimension reduction require inversion of the sample predictor covariance matrix. We propose a method for estimating the central subspace that eliminates the need for such inversion and is applicable regardless of the ( n, p) relationship. Simulations show that our method compares favourably with standard large sample techniques when the latter are applicable. We illustrate our method with a genomics application.
引用
收藏
页码:569 / 584
页数:16
相关论文
共 27 条
[11]  
Cristianini N., 2000, Intelligent Data Analysis: An Introduction
[12]   ASYMPTOTICS OF GRAPHICAL PROJECTION PURSUIT [J].
DIACONIS, P ;
FREEDMAN, D .
ANNALS OF STATISTICS, 1984, 12 (03) :793-815
[13]   SLICING REGRESSION - A LINK-FREE REGRESSION METHOD [J].
DUAN, N ;
LI, KC .
ANNALS OF STATISTICS, 1991, 19 (02) :505-530
[14]   Distinguishing regulatory DNA from neutral sites [J].
Elnitski, L ;
Hardison, RC ;
Li, J ;
Yang, S ;
Kolbe, D ;
Eswara, P ;
O'Connor, MJ ;
Schwartz, S ;
Miller, W ;
Chiaromonte, F .
GENOME RESEARCH, 2003, 13 (01) :64-72
[15]  
Fernholz L. T., 1983, MISES CALCULUS STAT
[16]   ON ALMOST LINEARITY OF LOW-DIMENSIONAL PROJECTIONS FROM HIGH-DIMENSIONAL DATA [J].
HALL, P ;
LI, KC .
ANNALS OF STATISTICS, 1993, 21 (02) :867-889
[17]   Classifier technology and the illusion of progress [J].
Hand, David J. .
STATISTICAL SCIENCE, 2006, 21 (01) :1-14
[18]  
HELLAND IS, 1990, SCAND J STAT, V17, P97
[19]   PROJECTION PURSUIT [J].
HUBER, PJ .
ANNALS OF STATISTICS, 1985, 13 (02) :435-475
[20]   Regulatory potential scores from genome-wide three-way alignments of human, mouse, and rat [J].
Kolbe, D ;
Taylor, J ;
Elnitski, L ;
Eswara, P ;
Li, J ;
Miller, W ;
Hardison, R ;
Chiaromonte, F .
GENOME RESEARCH, 2004, 14 (04) :700-707