Redundancy elimination of big sensor data using bayesian networks

Abstract

In the era of big data and Internet of things, massive sensor data are gathered with Internet of things. Quantity of data captured by sensor network are considered to contain highly useful and valuable information. However, since sensor data are usually correlated in time and space, not all the gathered data are valuable for further processing and analysis. Preprocessing is necessary for eliminating the redundancy in gathered massive sensor data. In this paper, approaches based on static Bayesian network (SBN) and dynamic Bayesian network (DBN) are proposed for preprocessing big sensor data, especially for redundancy elimination. Static sensor data redundancy detection algorithm (SSDRDA) for eliminating redundant data in static data sets and real-time sensor data redundancy detection algorithm (RSDRDA) for eliminating redundant sensor data in real-time are proposed. Experimental results show that the proposed algorithms are feasible and effective.