On deploying and executing data-intensive code on SMart Autonomous Storage (SmAS) disks

Abstract

There is an increasing demand for storage capacity and storage throughput, driven largely by new data types such as video data and satellite images as well as by the growing use of the Internet and the web that generate and transmit rapidly evolving datasets. Thus, there is a need for storage architectures that scale the processing power with the growing size of the datasets. In this paper, we present the SmAS system that employs network attached disks with processing capabilities. In the SmAS system, users can deploy and execute code at the disk. Application code is written in a stream-based language that enforces code security and bounds the code’s memory requirements. The SmAS operating system at the disk provides basic support for process scheduling and memory management. We present an initial implementation of the system and report performance results that validate our approach for data-intensive applications.