Conversion of Japanese slang into standard Japanese considering sensibility

Abstract

With the recent spread of communication using social media, exchanging opinions each other on web has become more common irrespective of age and sex. On the other hand, a problem called as “Internet flaming” often occurs along with the increase of social network service users. One of the reasons might be that the users do not recognize meanings/intentions/emotions expressed by other users’ words. In this study, we focused on slangs (Internet slangs) that are often used on SNS but are not registered in dictionaries, then tried to convert them into standard words. We also intended to output more appropriate candidates by considering not only semantic similarity but also affective similarity. The proposed method conducts filtering and re-ranking over the semantically similar candidates obtained based on distributed representations to detect the inappropriate candidates as standard word by focusing on two points: (1) features of slang/standard word and (2) affective similarity between the inputted word and the candidate words. In the evaluation experiment, the proposed method obtained a higher MRR than the baseline method.