A New Frontier of AI: On-Device AI Training and Personalization

1Citations
Citations of this article
7Readers
Mendeley users who have this article in their library.

Abstract

Modern consumer electronic devices have started executing deep learning-based intelligence services on devices, not cloud servers, to keep personal data on devices and to reduce network and cloud costs. We find such a trend as the opportunity to personalize intelligence services by updating neural networks with user data without exposing the data out of devices: on-device training. However, the limited resources of devices incurs significant difficulties. We propose a light-weight on-device training framework, NNTrainer, which provides highly memory-efficient neural network training techniques and proactive swapping based on fine-grained execution order analysis for neural networks. Moreover, its optimizations do not sacrifice accuracy and are transparent to training algorithms; thus, prior algorithmic studies may be implemented on top of NNTrainer. The evaluations show that NNTrainer can reduce memory consumption down to 1/20 (saving 95%!) and effectively personalizes intelligence services on devices. NNTrainer is cross-platform and practical open-source software, which is being deployed to millions of mobile devices.

Cite

CITATION STYLE

APA

Moon, J., Lee, H., Chu, J., Park, D., Hong, S., Seo, H., … Ham, M. (2024). A New Frontier of AI: On-Device AI Training and Personalization. In ACM International Conference Proceeding Series (pp. 323–333). Association for Computing Machinery. https://doi.org/10.1145/3639477.3639716

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free