Dynamic dataflow driven service composition mechanism for astronomy data processing

Abstract

Although some relatively mature products and systems about Dynamic service composition are proposed, their manipulations are mostly not trivial and intuitive for the common users. Therefore, this paper proposes a dataflow driven dynamic service composition architecture aiming at astronomy applications, to simplify the requirements for users to compose a service. The architecture utilizes Dataflow Driven conception to discover an Original Topology Graph, which includes the final composite service with the shortest length and good parallel structure, and uses a Converse Composition algorithm to ascertain the final result quickly. This architecture is applied in the PMGrid prototype for astronomy data processing, and the experiment results show the architecture satisfies the parallelism and asynchrony in distributed system, avoids manual errors, increases the service configuring efficiency, provides the composite service with better structure to increase the executing parallelism, and finally improve the scientific discovery. © 2007 IEEE.