Fisher information inequalities and the central limit theorem

被引:99
作者
Johnson, O
Barron, A
机构
[1] Statslab, Cambridge CB3 0WB, England
[2] Yale Univ, Dept Stat, New Haven, CT 06520 USA
关键词
normal convergence; entropy; Fisher information; Poincare inequalities; rates of convergence;
D O I
10.1007/s00440-004-0344-0
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 [统计学]; 070103 [概率论与数理统计]; 0714 [统计学];
摘要
We give conditions for an O(1/n) rate of convergence of Fisher information and relative entropy in the Central Limit Theorem. We use the theory of projections in L-2 spaces and Poincare inequalities, to provide a better understanding of the decrease in Fisher information implied by results of Barron and Brown. We show that if the standardized Fisher information ever becomes finite then it converges to zero.
引用
收藏
页码:391 / 409
页数:19
相关论文
共 21 条
[1]
[Anonymous], 1998, THEORY POINT ESTIMAT
[2]
[Anonymous], STAT DISTRIBUTIONS S
[3]
Ball K, 2003, DUKE MATH J, V119, P41
[4]
ENTROPY AND THE CENTRAL-LIMIT-THEOREM [J].
BARRON, AR .
ANNALS OF PROBABILITY, 1986, 14 (01) :336-342
[5]
THE CONVOLUTION INEQUALITY FOR ENTROPY POWERS [J].
BLACHMAN, NM .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1965, 11 (02) :267-271
[6]
ON AN INEQUALITY AND A RELATED CHARACTERIZATION OF THE NORMAL-DISTRIBUTION [J].
BOROVKOV, AA ;
UTEV, SA .
THEORY OF PROBABILITY AND ITS APPLICATIONS, 1984, 28 (02) :219-228
[7]
Brown L. D., 1982, STAT PROBABILITY ESS, P141
[8]
INFORMATION INEQUALITIES FOR THE BAYES RISK [J].
BROWN, LD ;
GAJEK, L .
ANNALS OF STATISTICS, 1990, 18 (04) :1578-1594
[9]
ON UPPER AND LOWER BOUNDS FOR THE VARIANCE OF A FUNCTION OF A RANDOM VARIABLE [J].
CACOULLOS, T .
ANNALS OF PROBABILITY, 1982, 10 (03) :799-809
[10]
Casella G., 2021, STAT INFERENCE