Interactive Classification Using Spectrograms and Audio Glyphs

Abstract

Figure 1.(A) Interactive spectrogram and (B) audio glyph-both views (A) and (B) show the same preprocessed supposed audio sample of a pipit call. (A) shows an interactive spectrogram and (B) an audio glyph that maps the spectral roll-off of the audio sample to a global linear color scale.Three different bird calls (1-3) are visible in the spectrogram and the audio glyph.The VAST Challenge 2018 aims to clarify the situation of the Rose-Crested Blue Pipit's population in the Boonsong Lekagul Wildlife Preserve. We propose an interactive spectrogram and a representative novel audio glyph to support the classification of bird calls. The second visualization of our system helps to identify spatio-Temporal patterns of bird species in the preserve. Using the system, we are able to solve the Mini Challenge 1 (MC1) tasks to classify claimed pipit calls and detect multiple spatio-Temporal migratory patterns in the preserve. We find evidence that the pipit population is declining, but we can not identify any clear evidence that the accused company is responsible for the decrease of the pipit population.