Evaluation procedures for forecasting with spatiotemporal data

17Citations
Citations of this article
24Readers
Mendeley users who have this article in their library.

Abstract

The increasing use of sensor networks has led to an ever larger number of available spa-tiotemporal datasets. Forecasting applications using this type of data are frequently motivated by important domains such as environmental monitoring. Being able to properly assess the performance of different forecasting approaches is fundamental to achieve progress. However, traditional performance estimation procedures, such as cross-validation, face challenges due to the implicit dependence between observations in spatiotemporal datasets. In this paper, we empirically compare several variants of cross-validation (CV) and out-of-sample (OOS) performance estimation proce-dures, using both artificially generated and real-world spatiotemporal datasets. Our results show both CV and OOS reporting useful estimates, but they suggest that blocking data in space and/or in time may be useful in mitigating CV’s bias to underestimate error. Overall, our study shows the importance of considering data dependencies when estimating the performance of spatiotemporal forecasting models.

Cite

CITATION STYLE

APA

Oliveira, M., Torgo, L., & Costa, V. S. (2021). Evaluation procedures for forecasting with spatiotemporal data. Mathematics, 9(6). https://doi.org/10.3390/math9060691

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free