Big data application technology: An overview

Abstract

Huge volumes of data are being created by business and individual activity. Anyone can't help paying attention to "Big data". Big data is defined as datasets whose size is beyond the ability of typical database software tools to capture, store, manage, and analyze. In this paper, first, we will take a brief look at the infrastructure technologies to handle data that are high-volume, high-velocity, and/or high-variety. It includes Hadoop, NoSQL, CEP, and so on. Then, we will overview data mining techniques such as classification, association, sequence, and clustering that identify repeated and useful patterns in big data. Obstacles to big data application are also described. © 2013 The Institute of Electrical Engineers of Japan.