Relaxation method of convolutional neural networks for natural language processing

Abstract

Deep learning has developed into one of the most powerful methods in the machine learning field. In particular, convolutional neural networks (CNNs) have been applied not only to image recognition tasks but also to natural language processing (NLP). To reuse older deep learning models, transfer learning techniques have been widely used in the image recognition field. However, there has been little research on transfer learning in NLP. In this paper, we propose a novel transfer learning model based on a relaxation method of CNNs for NLP. The effectiveness of the proposed method is verified using computer simulations, taking a film review score recognition task as an example.