Design of effective indexing technique in hadoop-based database

Abstract

The recent rapid increase in the amount of data to be processed has led to the increased use of dispersed parallel processing of large-scale data analysis using open-source Hadoop’s MapReduce framework. The large-data processing method proposed by Google and Hadoop which implemented this are representative dispersed parallel processing methods, and the data are dispersedly saved on the HDFS(Hadoop Distributed File System). Such HDFS uses its own indexing technique when it comes to searching specific values from the saved files. Techniques that use conventional index, however, leads to problems like reduced search performance by not considering update and saving index in the disc. Therefore, the paper proposes effective DB indexing technique on Hadoop-based database.