A new method of power grid huge data pre-processing

Abstract

When data mining to power grid huge data, the size and complexity of data would leads to reduce efficiency. So it is necessary to pre-processing the original power grid huge data. Combining rough set theory and database technology, a power grid huge data pre-processing method was proposed based on attribute reduction in this paper. This method could delete a large number of redundant data, and reduced the search space of data mining methods. Simulation results show the higher efficiency of this method compared classical pre-processing method based rough set. © 2011 Published by Elsevier Ltd.