TS-QUAD: A Smaller Elastic Ensemble for Time Series Classification with No Reduction in Accuracy

Abstract

The Elastic Ensemble (EE) is a time series classification (TSC) ensemble that includes eleven nearest neighbour (NN) classifiers that use variations of eight elastic distance measures. While EE offers an accurate solution for TSC in the time domain, its relatively slow run-time is a weakness. This has led to new algorithms, such as Proximity Forest and TS-CHIEF, that have iterated on the design of EE by taking the same elastic measures and incorporating them into tree-based ensembles. These enhancements were implemented successfully and led to faster and more accurate time domain classifiers and, as such, development on the original EE algorithm subsided. However, in this work we make the simple hypothesis that the original design of EE contains distance measures that capture the same discriminatory features, and as such, the ensemble includes redundant classifiers. If this were true, EE could perform to the same level in terms of accuracy with significantly less computation. If proven true this would have interesting implications to the design of algorithms such as Proximity Forest and TS-CHIEF that are based on the original EE implementation. To investigate this, we form a simple categorisation of the distance measures within EE and form four groups. We take one measure from each group, building an ensemble of four 1-NN classifiers that we call TS-QUAD: the Time Series QUARtet of distance-based classifiers. We demonstrate that this ensemble is able to match EE in terms of accuracy over 10 resamples of 85 datasets while containing fewer than 50% of the original EE constituents, implying that other elastic distance-based TSC ensembles could benefit from the design philosophy of TS-QUAD.