A Comparative Simulation Study of Classical and Machine Learning Techniques for Forecasting Time Series Data

Abstract

This manuscript presents a simulation comparison of statistical classical methods and machine learning algorithms for time series forecasting notably the ARIMA model, K-Nearest Neighbors (KNN), The Support Vector Regression (SVR), and Long-Short Term Memory (LSTM). The performance of the models was evaluated using different metrics especially Mean Squared Error (MSE), Mean Absolute Error (MAE), Median Absolute Error (Median AE), and Root Mean Squared Error (RMSE). The results of the simulations approve that the KNN and LSTM algorithms have better accuracy than the others models’ forecasting notably in the medium and long term. Hence, in the medium and long term, ML models are so powerful on big datasets. However, Machine learning architectures outperform ARIMA for shorter-term predictions. Thus, ARIMA is most appropriate in the case of univariate small data sets, where deep learning algorithms are not yet at their best.