N2SkyC: User Friendly and Efficient Neural Network Simulation Fostering Cloud Containers

Abstract

Sky computing is a new computing paradigm leveraging resources of multiple Cloud providers to create a large scale distributed infrastructure. N2Sky is a research initiative promising a framework for the utilization of Neural Networks as services across many Clouds. This involves a number of challenges ranging from the provision, discovery and utilization of services to the management, monitoring, metering and accounting of the infrastructure. Cloud Container technology offers fast deployment, good portability, and high resource efficiency to run large-scale and distributed systems. In recent years, container-based virtualization for applications has gained immense popularity. This paper presents the new N2SkyC system, a framework for the utilization of Neural Networks as services, aiming for higher flexibility, portability, dynamic orchestration, and performance by fostering microservices and Cloud container technology.