Variation-oriented data filtering for improvement in model complexity of air pollutant prediction model

Abstract

Accurate prediction models for air pollutants are crucial for forecast and health alarm to local inhabitants. In recent literature, discrete wavelet transform (DWT) was employed to decompose a series of air pollutant levels, followed by modeling using support vector machine (SVM). This combination of DWT and SVM was reported to produce a more accurate prediction model for air pollutants by investigating different levels of frequency bands. However, DWT has a significant demand in model complexity, namely, the training time and the model size of the prediction model. In this paper, a new method called variation-oriented filtering (VF) is proposed to remove the data with low variation, which can be considered as noise to a prediction model. By VF, the noise and the size of the series of air pollutant levels can be reduced simultaneously and hence so are the training time and model size. The SO(sulfur dioxide) level in Macau was selected as a test case. Experimental results show that VF can effectively and efficiently reduce the model complexity with improvement in predictive accuracy. © 2014 Chi Man Vong et al.