Pay Attention via Quantization: Enhancing Explainability of Neural Networks via Quantized Activation

2Citations
Citations of this article
8Readers
Mendeley users who have this article in their library.

Abstract

Modern deep learning algorithms comprise highly complex artificial neural networks, making it extremely difficult for humans to track their inference processes. As the social implementation of deep learning progresses, the human and economic losses caused by inference errors are becoming increasingly problematic, making it necessary to develop methods to explain the basis for the decisions of deep learning algorithms. Although an attention mechanism-based method to visualize the regions that contribute to steering angle prediction in an automated driving task has been proposed, its explanatory capability is low. In this paper, we focus on the fact that the importance of each bit in the activation value of a network is biased (i.e., the sign and exponent bits are weighted more heavily than the mantissa bits), which has been overlooked in previous studies. Specifically, this paper quantizes network activations, encouraging important information to be aggregated to the sign bit. Further, we introduce an attention mechanism restricted to the sign bit to improve the explanatory power. Our numerical experiment using the Udacity dataset revealed that the proposed method achieves a 1.14× higher area under curve (AUC) in terms of the deletion metric.

Cite

CITATION STYLE

APA

Tashiro, Y., & Awano, H. (2023). Pay Attention via Quantization: Enhancing Explainability of Neural Networks via Quantized Activation. IEEE Access, 11, 34431–34439. https://doi.org/10.1109/ACCESS.2023.3264855

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free