GEOMETRIZING RATES OF CONVERGENCE .3.

被引:85
作者
DONOHO, DL
LIU, RC
机构
关键词
WHITE NOISE MODEL; DENSITY ESTIMATION; RATES OF CONVERGENCE; MODULUS OF CONTINUITY; MINIMAX RISK; ESTIMATING A BOUNDED NORMAL MEAN; OPTIMAL KERNELS; CONVERGENCE OF EXPERIMENTS; GEODESIC EXPERIMENTS; IBRAGIMOV-HASMINSKII CONSTANT;
D O I
10.1214/aos/1176348115
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We establish upper and lower bounds on the asymptotic minimax risk in estimating (1) a density at a point when the density is known to be decreasing with a Lipschitz condition; (2) a density at a point when the density satisfies a local second-order smoothness (Sacks-Ylvisaker) condition; and (3) the k th derivative of the density at a point, when the density satisfies a local L(p) constraint on the m th derivative. In (1), (2) and (3) the upper and lower bounds differ asymptotically by less than 18%, 24.3% and 25%, respectively. Our bounds on the asymptotic minimax risk come from a simple formula. Let omega(epsilon) denote the modulus of continuity, with respect to Hellinger distance, of the functional to be estimated; in the previous cases this has the form omega(epsilon) = A-epsilon-r(1 + o(1)) for certain constants A and r. Then, in all these cases, the minimax risk is not larger asymptotically than r(r)(1 - r)1-r-omega-2(n-1/2)/4 and is at best a few percent smaller. The modulus of continuity of the functional and hence the geometry of the problem, determine the difficulty of estimation. At a technical level, two interesting aspects of our work are (1) derivation of minimax affine estimates of a linear functional in the white noise model with general convex asymmetric a priori class and (2) the use of Le Cam's theory of convergence of experiments to show that the density model is asymptotically just as hard as the white noise model. At a conceptual level, an interesting aspect of our work is the use of the hardest one-dimensional subproblem heuristic. Our method works because in these cases, the difficulty of the hardest one-dimensional subproblem is essentially equal to the difficulty of the full infinite-dimensional problem.
引用
收藏
页码:668 / 701
页数:34
相关论文
共 29 条
[1]  
Araujo A, 1980, CENTRAL LIMIT THEORE
[2]  
BENTKUS RJ, 1981, DOKL AKAD NAUK SSSR, V258, P1300
[4]  
BORWN LD, 1989, UNPUB SHARPENED INEQ
[5]   A LOWER BOUND FOR THE RISK IN ESTIMATING THE VALUE OF A PROBABILITY DENSITY [J].
BROWN, LD ;
FARRELL, RH .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1990, 85 (412) :1147-1153
[6]   ESTIMATING A BOUNDED NORMAL-MEAN [J].
CASELLA, G ;
STRAWDERMAN, WE .
ANNALS OF STATISTICS, 1981, 9 (04) :870-878
[7]   MINIMAX RISK OVER HYPERRECTANGLES, AND IMPLICATIONS [J].
DONOHO, DL ;
LIU, RC ;
MACGIBBON, B .
ANNALS OF STATISTICS, 1990, 18 (03) :1416-1437
[8]   THE AUTOMATIC ROBUSTNESS OF MINIMUM DISTANCE FUNCTIONALS [J].
DONOHO, DL ;
LIU, RC .
ANNALS OF STATISTICS, 1988, 16 (02) :552-586
[9]  
DONOHO DL, 1987, 137 U CAL DEP STAT T
[10]  
DONOHO DL, 1988, 138 U CAL DEP STAT T