Weakly-Supervised Temporal Action Localization by Inferring Salient Snippet-Feature

5Citations
Citations of this article
5Readers
Mendeley users who have this article in their library.

Abstract

Weakly-supervised temporal action localization aims to locate action regions and identify action categories in untrimmed videos simultaneously by taking only video-level labels as the supervision. Pseudo label generation is a promising strategy to solve the challenging problem, but the current methods ignore the natural temporal structure of the video that can provide rich information to assist such a generation process. In this paper, we propose a novel weakly-supervised temporal action localization method by inferring salient snippet-feature. First, we design a saliency inference module that exploits the variation relationship between temporal neighbor snippets to discover salient snippet-features, which can reflect the significant dynamic change in the video. Secondly, we introduce a boundary refinement module that enhances salient snippet-features through the information interaction unit. Then, a discrimination enhancement module is introduced to enhance the discriminative nature of snippet-features. Finally, we adopt the refined snippet-features to produce high-fidelity pseudo labels, which could be used to supervise the training of the action localization network. Extensive experiments on two publicly available datasets, i.e., THUMOS14 and ActivityNet v1.3, demonstrate our proposed method achieves significant improvements compared to the state-of-the-art methods. Our source code is available at https://github.com/wuli55555/ISSF.

Cite

CITATION STYLE

APA

Yun, W., Qi, M., Wang, C., & Ma, H. (2024). Weakly-Supervised Temporal Action Localization by Inferring Salient Snippet-Feature. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 38, pp. 6908–6916). Association for the Advancement of Artificial Intelligence. https://doi.org/10.1609/aaai.v38i7.28516

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free