Speeding-up a convolutional neural network by connecting an SVM network

Abstract

Deep neural networks yield positive object detection results in aerial imaging. To deal with the massive computational time required, we propose to connect an SVM Network to the different feature maps of a CNN. After the training of this SVM Network, we use an activation path to cross the network in a predefined order. We stop the crossing as quickly as possible. This early exit from the CNN allows us to reduce the computational burden. Experimental results are obtained for an industrial application in urban object detection. We show that potentially the computation cost could be reduced by 98%. Additionally, performance is slightly improved; for example, for a 55% recall, precision increases by 5%.