Research on text representation method based on improved TF-IDF

Abstract

According to the different importance degree between feature and text, this paper proposes a method of improved traditional TF-IDF algorithm according to the position information of the words and the ability to distinguish the texts, and proposes a text representation method based on improved TF-IDF and the corresponding word vector calculation method. Finally, the effectiveness of the method is proved by experiments.