An Ideal Big Data Architectural Analysis for Medical Image Data Classification or Clustering Using the Map-Reduce Frame Work

Abstract

In the present day scenario, where huge volumes of data are being generated from various sources, as such storing and processing these data using traditional systems is a big challenge. The majority of data is of unstructured; hence necessary architectures should be designed to meet the continuous challenges. Among the possible solutions for the big data problem, one of the best solutions to address the huge volumes of unstructured data was Hadoop. In the medical field, huge volumes of clinical image data are resulting from the respective hardware tools. The necessary methods that are required to store, analyze, process and classification of these medical images can be done with map-reduce architecture using the Hadoop framework thereby reduces the computational time for the overall processing as the mapper will perform parallel processing. This paper includes a detailed review of Hadoop and its components. The main motive of this work is to deal with the medical image data using an efficient architecture such that automatic clustering or classification of images will be done within the architecture itself. The clustering of these medical images for future predictions and diagnosis for the disease is essential. In the map-reduce architecture, along with the map and reduce phases, the usage of combiners and partitioners will improve the efficiency of medical image processing for clustering the image data. The other responsibilities of this paper are to review the recent works in the image data clustering along with the state of art techniques for image classification. The clustered medical images will be used for automatic predictions and diagnosis of various patient diseases by applying Convolution Neural Network (CNN) techniques on top of the clustered or classified images.