Brain tumour segmentation framework with deep nuanced reasoning and Swin-T

Abstract

Tumour medical image segmentation plays a crucial role in clinical imaging diagnosis. Existing research has achieved good results, enabling the segmentation of three tumour regions in MRI brain tumour images. Existing models have limited focus on the brain tumour areas, and the long-term dependency of features is weakened as the network depth increases, resulting in blurred edge segmentation of the targets. Additionally, considering the excellent segmentation performance of the Swin Transformer(Swin-T) network, its network structure and parameters are relatively large. To address these limitations, this paper proposes a brain tumour segmentation framework with deep nuanced reasoning and Swin-T. It is mainly composed of the backbone hybrid network (BHN) and the deep micro texture extraction module (DMTE). The BHN combines the Swin-T stage with a new downsampling transition module called dual path feature reasoning (DPFR). The entire network framework is designed to extract global and local features from multi-modal data, enabling it to capture and analyze deep texture features in multi-modal images. It provides significant optimization over the Swin-T network structure. Experimental results on the BraTS dataset demonstrate that the proposed method outperforms other state-of-the-art models in terms of segmentation performance. The corresponding source codes are available at https://github.com/CurbUni/Brain-Tumor-Segmentation-Framework-with-Deep-Nuanced-Reasoning-and-Swin-T.