A structured data preprocessing method based on hybrid encoding

Abstract

With the rapid development of civil aviation transportation industry, the passenger throughput in civil aviation is increasing, while the problem of flight delays is becoming more and more serious. For flight delay prediction under big data, deep learning methods can be applied to make high-precision predictions. Since data preprocessing is one of the most important parts, the method based on hybrid encoding is proposed in this paper. Firstly, the flight and meteorological data are fused with the associated primary key, Since weather data has a greater impact on flight delay. Then, the fused data is encoded according to different data types. Min-Max encoding is used for continuous features, and CatBoost encoding is adopted for discrete features respectively. Finally, the data set which has been preprocessed can be put into the deep convolutional neural network ResNet to verify the effect. The experimental results show that the prediction accuracy rate of flight delay level can reach 94.02% on the structured data set after hybrid encoding.