Reference Free Incremental Deep Learning Model Applied for Camera-Based Respiration Monitoring

Abstract

The article describes a reference and training set free incrementally trained deep learning algorithm for camera-based respiration monitoring systems. The algorithm uses a model based discriminator to find salient areas having respiration like periodic motion. It stores the first principle component of the found waveforms into two slowly growing set along with negative, uncorrelated motion patterns. Using these samples, it trains a deep neural network classifier incrementally to recognize respiration from sudden and motion intensive situations. The classifier had no forgetting mechanism and it is able to adapt quickly the changing respiration patterns and conditions. The algorithm has been validated in a total of 24 hours diverse recording captured in the neonatal intensive care unit (NICU) of the $\text{I}^{st}$ Dept. of Pediatrics and, II. Dept. of Obstetrics and Gynecology, Semmelweis University, Budapest, Hungary and in the COHFACE publicly available dataset of adult subjects. The clinical data set evaluation resulted in mean absolute error (MAE) 6.9 and root mean squared error (RMSE) of 9.8 breaths per minute, respectively, the MAE was below 5 breaths per minute for over 50% of the time. The algorithm was assessed in the COHFACE dataset of adult subjects as well with respiration estimation MAE and RMSE values of 0.95 and 1.7 breaths per minute.