Mobile Apps Performance Testing as a Service for Parallel Test Execution and Automatic Test Result Analysis

Abstract

Now-a-days, numerous mobile apps are developed daily that influence the lives of people worldwide. Mobile apps are implemented within a limited time and budget. This is to keep up with the rapid business growth and to gain a competitive advantage in the market. Performance testing is a crucial activity that evaluates the behavior of the application under test (AUT) under various workloads. Performance testing in the domain of mobile app development is still a manual and time-consuming activity. As a negative consequence, performance testing is ignored during the development of many mobile apps. Thus, mobile apps may suffer from weak performance that badly affects the user experience. Therefore, cloud technology is introduced as a solution that emerges in the domain of software testing. Based on this technology, software testing is provided as a service (TaaS) that leverages cloud-based resources. This overcomes the testing issues and achieves high test quality. In this paper, a cloud-based testing as a service architecture is proposed for performance testing of mobile apps. The proposed performance testing as a service (P-TaaS) adopts efficient approaches for automating the entire process. Efficient approaches for test case generation, parallel test execution, and test results analysis are introduced. The proposed test case generation approach applies model-based testing (MBT) technique that generates test cases automatically from the AUT’s specification models and artifacts. The proposed P-TaaS lessens the testing time and satisfies the fast time-to-release constraint of mobile apps. Additionally, the proposed P-TaaS maximizes resource utilization, and allows continuous resource monitoring.