ENTROPY-LIKE PROXIMAL METHODS IN CONVEX-PROGRAMMING

被引:117
作者
IUSEM, AN [1 ]
SVAITER, BF [1 ]
TEBOULLE, M [1 ]
机构
[1] UNIV MARYLAND,DEPT MATH & STAT,CATONSVILLE,MD 21228
关键词
CONVEX PROGRAMMING PROXIMAL METHODS; CONVEX STATISTICAL DISTANCES; AUGMENTED LAGRANGIANS METHODS; MODIFIED BARRIER FUNCTIONS;
D O I
10.1287/moor.19.4.790
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We study an extension of the proximal method for convex programming, where the quadratic regularization kernel is substituted by a class of convex statistical distances, called phi p-divergences, which are typically entropy-like in farm. After establishing several basic properties of these quasi-distances, we present a convergence analysis of the resulting entropy-like proximal algorithm. Applying this algorithm to the dual of a convex program, we recover a wide class of nonquadratic multiplier methods and prove their convergence.
引用
收藏
页码:790 / 814
页数:25
相关论文
共 27 条
[1]  
ATTOUCH H, 1989, ANAL NONLINEAIRE, V6
[2]   CERTAINTY EQUIVALENTS AND INFORMATION MEASURES - DUALITY AND EXTREMAL PRINCIPLES [J].
BENTAL, A ;
BENISRAEL, A ;
TEBOULLE, M .
JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 1991, 157 (01) :211-236
[3]  
BENTAL A, 1992, SYSTEMS MANAGEMENT S, P275
[4]   OPTIMAL SHORT-TERM SCHEDULING OF LARGE-SCALE POWER-SYSTEMS [J].
BERTSEKAS, DP ;
LAUER, GS ;
SANDELL, NR ;
POSBERGH, TA .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1983, 28 (01) :1-11
[5]   TOWARDS MINIMAL ASSUMPTIONS FOR THE INFIMAL CONVOLUTION REGULARIZATION [J].
BOUGEARD, M ;
PENOT, JP ;
POMMELLET, A .
JOURNAL OF APPROXIMATION THEORY, 1991, 64 (03) :245-270
[6]  
Bregman L M, 1967, USSR COMP MATH MATH, V7, P200, DOI DOI 10.1016/0041-5553(67)90040-7
[7]   PROXIMAL MINIMIZATION ALGORITHM WITH D-FUNCTIONS [J].
CENSOR, Y ;
ZENIOS, SA .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1992, 73 (03) :451-464
[8]   CONVERGENCE ANALYSIS OF A PROXIMAL-LIKE MINIMIZATION ALGORITHM USING BREGMAN FUNCTIONS [J].
Chen, Gong ;
Teboulle, Marc .
SIAM JOURNAL ON OPTIMIZATION, 1993, 3 (03) :538-543
[9]  
CLARKE FH, OPTIMIZATION NONSMOO
[10]  
Csiszar I., 1967, STUDIA SCI MATH HUNG, V2, P299