Quality assurance for big data application-issues, challenges, and needs

Abstract

With the fast advance of big data technology and analytics solutions, building high-quality big data computing services in different application domains is becoming a very hot research and application topic among academic and industry communities, and government agencies. Therefore, big data based applications are widely-used currently, such as recommendation, predication, and decision system. Nevertheless, there are increasing quality problems resulting in erroneous testing costs in enterprises and businesses. Current research work seldom discusses how to effectively validate big data applications to assure system quality. This paper focuses on big data system validation and quality assurance, and includes informative discussions about essential quality parameters, primary focuses, and validation process. Moreover, the paper discusses potential testing methods for big data application systems. Furthermore, the primary issues, challenges, and needs in testing big data application are presented.