Optimizing Secure Multi-User ISAC Systems With STAR-RIS: A Deep Reinforcement Learning Approach for 6G Networks

Abstract

The rapid evolution of wireless communication technologies and the increasing demand for multi-functional systems have led to the emergence of integrated sensing and communication (ISAC) as a key enabler for future 6G networks. Simultaneously transmitting and reflecting reconfigurable intelligent surfaces (STAR-RISs) have recently garnered significant attention for their ability to enhance signal coverage and improve system efficiency. This paper investigates a STAR-RIS-assisted ISAC system designed to secure communication for multiple legitimate users (LUs) while safeguarding against multiple eavesdroppers (Eves). By jointly optimizing the base station (BS) transmit beamforming, STAR-RIS transmission and reflection coefficients, and receive filters, the proposed framework aims to maximize the long-term average secrecy rate for all LUs. Constraints are imposed to ensure minimum echo signal-to-noise ratios (SNRs) for sensing and meet the achievable rate requirements of LUs. To address the inherent complexity of this non-convex problem, two deep reinforcement learning (DRL) algorithms are proposed. Numerical results demonstrate that the proposed system achieves significant improvements in secrecy rate compared to conventional RIS setups. This work provides a scalable and efficient approach for secure multi-user ISAC systems, making it highly relevant for future 6G networks, smart cities, and IoT applications.