Enhancing the Accuracy of Lymph-Node-Metastasis Prediction in Gynecologic Malignancies Using Multimodal Federated Learning: Integrating CT, MRI, and PET/CT

Abstract

Gynecological malignancies, particularly lymph node metastasis, have presented a diagnostic challenge, even with traditional imaging techniques such as CT, MRI, and PET/CT. This study was conceived to explore and, subsequently, to bridge this diagnostic gap through a more holistic and innovative approach. By developing a comprehensive framework that integrates both non-image data and detailed MRI image analyses, this study harnessed the capabilities of a multimodal federated-learning model. Employing a composite neural network within a federated-learning environment, this study adeptly merged diverse data sources to enhance prediction accuracy. This was further complemented by a sophisticated deep convolutional neural network with an enhanced U-NET architecture for meticulous MRI image processing. Traditional imaging yielded sensitivities ranging from 32.63% to 57.69%. In contrast, the federated-learning model, without incorporating image data, achieved an impressive sensitivity of approximately 0.9231, which soared to 0.9412 with the integration of MRI data. Such advancements underscore the significant potential of this approach, suggesting that federated learning, especially when combined with MRI assessment data, can revolutionize lymph-node-metastasis detection in gynecological malignancies. This paves the way for more precise patient care, potentially transforming the current diagnostic paradigm and resulting in improved patient outcomes.