Automatic language identification using Multivariate analysis

Abstract

Identifying the language of an e-text is complicated by the existence of a number of character sets for a single language. We present a language identification system that uses the Multivariate Analysis (MVA) for dimensionality reduction and classification. We compare its performance with existing schemes viz., the N-grams and compression. © Springer-Verlag Berlin Heidelberg 2005.