Criss-Cross Attention Based Multi-level Fusion Network for Gastric Intestinal Metaplasia Segmentation

Abstract

In this paper, we propose a novel criss-cross attention based multi-level fusion network to segment gastric intestinal metaplasia from narrow-band endoscopic images. Our network is composed of two sub-networks including criss-cross attention based feature fusion encoder and feature activation map guided multi-level decoder. The former one learns representative deep features by imposing attention on features of multiple receptive fields. The latter one segments gastric intestinal metaplasia regions by using the feature activation map scheme to enhance the importance of decoder features and avoid overfitting. As shown in the experimental results, our method outperforms state-of-the-art semantic segmentation methods on a novel challenging endoscopic image dataset. The source code is available at https://github.com/nchucvml/CCA-MFNet.