Word level language identification on code-mixed english-bodo text

Abstract

Since social media has become an active part of one's life, people express their views freely in mixed informal languages on such platforms. So, in a multi-lingual country like India, it becomes really difficult for conventional language detectors to identify such languages. This paper mainly aims to detect the language at word level where the code mixed text can be in English-Bodo-Assamese. The data for the same is collected from some related Facebook pages and various classification algorithms are used to predict and compare the accuracy with which the detection is done.