Dps-MuSyQ: A Distributed Parallel Processing System for Multi-Source Data Synergized Quantitative Remote Sensing Products Producing

Abstract

With the development of earth observation technologies and the construction of earth observation systems, an increasing amount of remote sensing data are being obtained. These provide the datasets required for research on remote sensing monitoring across large areas. To compensate for the shortcomings of global and large-area temporal monitoring data, synergized computing using multi-source remote sensing data can improve the accuracy and temporal resolution of remote sensing monitoring. However, remote sensing data are drawn from multiple sources and multiple scales, and have a complex structure and large volume; in addition, the nested system architecture of multi-source synergized remote sensing products makes the design of large-scale multi-source synergized remote sensing monitoring systems difficult. In this paper, we describe the design and implementation of a distributed parallel processing system for multi-source data synergized quantitative remote sensing based on a distributed cluster platform. The system integrates the algorithms normalizing more than 30 kinds of data sources and producing 40 quantitative remote sensing products. The system also connects a number of centers for satellite data, serves for several applications, and implements dynamic expansion integration for highly efficient quantitative remote sensing products. The system has produced approximately 50 TB of quantitative remote sensing products, and the application of these data to agriculture, forestry, the environment, and water conservation has resulted in very positive effects.