Joint intensity fusion image synthesis applied to multiple sclerosis lesion segmentation

Abstract

We propose a new approach to Multiple Sclerosis lesion segmentation that utilizes synthesized images. A new method of image synthesis is considered: joint intensity fusion (JIF). JIF synthesizes an image from a library of deformably registered and intensity normalized atlases. Each location in the synthesized image is a weighted average of the registered atlases; atlas weights vary spatially. The weights are determined using the joint label fusion (JLF) framework. The primary methodological contribution is the application of JLF to MRI signal directly rather than labels. Synthesized images are then used as additional features in a lesion segmentation task using the OASIS classifier, a logistic regression model on intensities from multiple modalities. The addition of JIF synthesized images improved the Dice-Sorensen coefficient (relative to manually drawn gold standards) of lesion segmentations over the standard model segmentations by 0.0462 ± 0.0050 (mean ± standard deviation) at optimal threshold over all subjects and 10 separate training/testing folds.