Resource-efficient pet dog sound events classification using LSTM-FCN based on time-series data

20Citations
Citations of this article
45Readers
Mendeley users who have this article in their library.

Abstract

The use of IoT (Internet of Things) technology for the management of pet dogs left alone at home is increasing. This includes tasks such as automatic feeding, operation of play equipment, and location detection. Classification of the vocalizations of pet dogs using information from a sound sensor is an important method to analyze the behavior or emotions of dogs that are left alone. These sounds should be acquired by attaching the IoT sound sensor to the dog, and then classifying the sound events (e.g., barking, growling, howling, and whining). However, sound sensors tend to transmit large amounts of data and consume considerable amounts of power, which presents issues in the case of resource-constrained IoT sensor devices. In this paper, we propose a way to classify pet dog sound events and improve resource efficiency without significant degradation of accuracy. To achieve this, we only acquire the intensity data of sounds by using a relatively resource-efficient noise sensor. This presents issues as well, since it is difficult to achieve sufficient classification accuracy using only intensity data due to the loss of information from the sound events. To address this problem and avoid significant degradation of classification accuracy, we apply long short-term memory-fully convolutional network (LSTM-FCN), which is a deep learning method, to analyze time-series data, and exploit bicubic interpolation. Based on experimental results, the proposed method based on noise sensors (i.e., Shapelet and LSTM-FCN for time-series) was found to improve energy efficiency by 10 times without significant degradation of accuracy compared to typical methods based on sound sensors (i.e., mel-frequency cepstrum coefficient (MFCC), spectrogram, and mel-spectrum for feature extraction, and support vector machine (SVM) and k-nearest neighbor (K-NN) for classification).

References Powered by Scopus

Predicting transmembrane protein topology with a hidden Markov model: Application to complete genomes

10262Citations
N/AReaders
Get full text

Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification

1229Citations
N/AReaders
Get full text

LSTM Fully Convolutional Networks for Time Series Classification

1099Citations
N/AReaders
Get full text

Cited by Powered by Scopus

Insights into lstm fully convolutional networks for time series classification

161Citations
N/AReaders
Get full text

Bidirectional LSTM-RNN-based hybrid deep learning frameworks for univariate time series classification

58Citations
N/AReaders
Get full text

Surgical skill levels: Classification and analysis using deep neural network model and motion signals

56Citations
N/AReaders
Get full text

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Cite

CITATION STYLE

APA

Kim, Y., Sa, J., Chung, Y., Park, D., & Lee, S. (2018). Resource-efficient pet dog sound events classification using LSTM-FCN based on time-series data. Sensors (Switzerland), 18(11). https://doi.org/10.3390/s18114019

Readers' Seniority

Tooltip

PhD / Post grad / Masters / Doc 14

67%

Researcher 5

24%

Professor / Associate Prof. 1

5%

Lecturer / Post doc 1

5%

Readers' Discipline

Tooltip

Computer Science 10

56%

Medicine and Dentistry 3

17%

Psychology 3

17%

Agricultural and Biological Sciences 2

11%

Save time finding and organizing research with Mendeley

Sign up for free