A novel data quality assessment framework for vehicular network testbeds

Abstract

Big data technique is considered as a powerful tool to exploit all the potential of the Internet of Things and the smart cities. The development of internet of Vehicles (IoV) and wireless communication technologies have boosted diverse applications related to smart cities and Cyber-Physical Systems, but the data quality of vehicular sensors is an important issue due to the high-speed mobile wireless communication environment and physical sensor noise. This paper presents our experiences for big data analytics based on a vehicular network testbed, in terms of sensors data management, multi-dimension data fusion and data quality assessment for the vehicular sensor data. The proposed data quality assessment framework consist of feature extraction based on multi-sensor data fusion and multi-level wavelet transform, as well as a semi-supervised learning based classification algorithm. The comparison experiment shows that the proposed framework and approaches can extract feasible features and solve the unbalanced label problems, which achieve a better assessment effect.