A Human–AI Collaborative Pipeline for Decision Support in Urban Development Projects Based on Large-Scale Social Media Text Analysis

Abstract

The rapid growth of digital communication platforms has generated vast volumes of user-generated textual data and digital footprints, creating growing demand for scalable artificial intelligence systems capable of supporting evidence-based decision-making. This study proposes and evaluates a human–AI collaborative analytical pipeline for multi-class sentiment and aggression analysis of large-scale social media data (N = 15,064 messages) related to an urban infrastructure project. The proposed framework integrates standard NLP preprocessing, machine learning-based classifiers, temporal aggregation, and controlled large language model (LLM)-assisted classification within a structured analytical workflow that incorporates expert validation and oversight. A stratified manual validation procedure (n = 301) demonstrated substantial inter-annotator agreement (κ = 0.70) and stable multi-class classification accuracy (80%). The results indicate that combining sentiment polarity and aggression detection as complementary linguistic indicators improves sensitivity to shifts in discourse dynamics and enables early identification of emerging social tension. The study demonstrates the potential of human–AI collaborative analytical frameworks for transparent, interpretable, and predictive large-scale social media analysis in decision-support contexts.