Towards building a multi-datacenter infrastructure for massive remote sensing image processing

被引:31
作者
Zhang, Wanfeng [1 ,3 ]
Wang, Lizhe [1 ,2 ]
Liu, Dingsheng [1 ]
Song, Weijing [1 ]
Ma, Yan [1 ]
Liu, Peng [1 ]
Chen, Dan [2 ]
机构
[1] Chinese Acad Sci, Ctr Earth Observat & Digital Earth, Beijing, Peoples R China
[2] China Univ Geosci, Sch Comp Sci, Wuhan 430074, Peoples R China
[3] Chinese Acad Sci, Grad Univ, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
data intensive computing; remote sensing image processing; multi-datacenter infrastructure; cloud computing; CLOUD;
D O I
10.1002/cpe.2966
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Earth observation applications are now facing the challenges of managing and processing massive data sets from multiple sources from large-scale distributed data centers (DCs). To solve this research problem, this paper presents an infrastructure of multiple data centers (MDC) for managing and processing massive remote sensing images. The proposed system is built on both groups of distributed DCs/clusters, which are equipped with DC or cluster resource manager. Access security and information service are introduced to support this architecture of MDC. We collaboratively organized the algorithm, and data belonged to the MDC in the manner of workflow. In practice, we succeeded in working out the concrete problems regarding procedures in processing applications collaboratively and transfer the massive remote sensing dataset fast and with stable cross-MDC. On the basis of the previously mentioned research work, we will investigate the platform integration of MDC. Copyright (c) 2012 John Wiley & Sons, Ltd.
引用
收藏
页码:1798 / 1812
页数:15
相关论文
共 25 条
[1]  
Berman F, 2003, GRID COMPUTING MAKIN, V2, P809
[2]   Hybrid modelling and simulation of huge crowd over a hierarchical Grid architecture [J].
Chen, Dan ;
Wang, Lizhe ;
Wu, Xiaomin ;
Chen, Jingying ;
Khan, Samee U. ;
Kolodziej, Joanna ;
Tian, Mingwei ;
Huang, Fang ;
Liu, Wangyang .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2013, 29 (05) :1309-1317
[3]   The Globus Replica Location Service: Design and Experience [J].
Chervenak, Ann L. ;
Schuler, Robert ;
Ripeanu, Matei ;
Amer, Muhammad Ali ;
Bharathi, Shishir ;
Foster, Ian ;
Iamnitchi, Adriana ;
Kesselman, Carl .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2009, 20 (09) :1260-1272
[4]  
Chu KD, 2006, LECT NOTES COMPUT SC, V3947, P289
[5]  
Collins JP, 2010, SCIENCE, V327, P1
[6]  
Foster I, 2002, CHIMERA VIRTUAL DATA
[7]   Condor-G: A Computation Management Agent for Multi-Institutional Grids [J].
James Frey ;
Todd Tannenbaum ;
Miron Livny ;
Ian Foster ;
Steven Tuecke .
Cluster Computing, 2002, 5 (3) :237-246
[8]  
Garzoglio G, 2009, GLOBALLY DISTRIBUTED
[9]  
Goward SN, 1997, PHOTOGRAMM ENG REM S, V63, P887
[10]  
Gray J., 2007, eScience-A transformed scientific method