Geometric convergence rates for stochastically ordered Markov chains

被引:48
作者
Lund, RB [1 ]
Tweedie, RL [1 ]
机构
[1] COLORADO STATE UNIV,DEPT STAT,FT COLLINS,CO 80523
关键词
total variation; convergence rate; geometric ergodicity; coupling; random walks; queues; storage processes;
D O I
10.1287/moor.21.1.182
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
Let {Phi(n)} be a Markov chain on the state space [0,infinity) that is stochastically ordered in its initial state; that is, a stochastically larger initial state produces a stochastically larger chain at all other times. Examples of such chains include random walks, the number of customers in various queueing systems, and a plethora of storage processes. A large body of recent literature concentrates on establishing geometric ergodicity of {Phi(n)} in total variation; that is, proving the existence of a limiting probability measure pi and a number r > 1 such that [GRAPHICS] for every deterministic initial state Phi(0) = x. We seek to identify the largest r that satisfies this relationship. A dependent sample path coupling and a Foster-Lyapumov drift inequality are used to derive convergence rate bounds; we then show that the bounds obtained are frequently the best possible. Application of the methods to queues and random walks are included.
引用
收藏
页码:182 / 194
页数:13
相关论文
共 18 条
[1]  
[Anonymous], 1992, Stochastic Stability of Markov chains
[2]  
Asmussen S, 2008, APPL PROBABILITY QUE, V51
[3]  
Feller W., 1960, INTRO PROBABILITY TH
[4]  
Lindvall T., 1992, Lectures on the coupling method
[5]   A DAM WITH SEASONAL INPUT [J].
LUND, RB .
JOURNAL OF APPLIED PROBABILITY, 1994, 31 (02) :526-541
[6]  
MENGERSEN KL, 1995, IN PRESS ANN STAT
[7]   COMPUTABLE BOUNDS FOR GEOMETRIC CONVERGENCE RATES OF MARKOV CHAINS [J].
Meyn, Sean P. ;
Tweedie, R. L. .
ANNALS OF APPLIED PROBABILITY, 1994, 4 (04) :981-1011
[8]  
Nummelin E, 1982, Stochastic Processes and Their Applications, V12, P187
[9]  
POPOV N., 1977, SOV MATH DOKL, V18, P676
[10]  
ROBERTS GO, 1994, IN PRESS J ROYAL S B