Comparison of NB and SVM in Sentiment Analysis of Cyberbullying using Feature Selection

Abstract

In the past few decades, the internet has become an inseparable part of human life. It provides ease of access and permeates almost every aspect of human existence. One of the internet platforms that is widely used by people around the world is social media. Apart from being spoiled with the convenience and efficiency offered by social media to support daily life, it has gained popularity among a wide audience. This has positive implications when utilized effectively, but it cannot be denied that there are negative consequences if not utilized properly. One such consequence is the prevalence of cyberbullying activities on social media. Cyberbullying has become a major concern for the public and social media users, prompting researchers to leverage information technology in developing technologies that can identify the elements of cyberbullying, particularly on social media platforms. Sentiment analysis has been employed by researchers to identify the components of cyberbullying in online platforms. Sentiment analysis involves the application of natural language processing techniques and text analysis to identify and extract subjective information from text. This study aims to compare the Naive Bayes algorithm and the Support Vector Machine algorithm, while utilizing feature selection, specifically chi-square, to enhance the accuracy of both algorithms in classifying Instagram comments. The experimental results indicate that the Multinomial Naive Bayes (MNB) algorithm outperforms the Support Vector Machine (SVM) algorithm, achieving an accuracy of 83.85% without feature selection and 90.77% with feature selection. Meanwhile, SVM achieves an accuracy of 82.31% without feature selection and 90% with feature selection. Evaluation through the confusion matrix and classification report reveals that MNB exhibits better precision and recall rates compared to SVM in identifying bullying and non-bullying classes. The use of feature selection enhances the performance of both algorithms in classifying Instagram comments related to cyberbullying.