Flexible Job Shop Scheduling with Job Precedence Constraints: A Deep Reinforcement Learning Approach

Abstract

The flexible job shop scheduling problem with job precedence constraints (FJSP-JPC) is highly relevant in industrial production scenarios involving assembly operations. Traditional methods, such as mathematical programming and meta-heuristics, often struggle with scalability and efficiency when solving large instances. We propose a deep reinforcement learning (DRL) approach to minimize makespan in FJSP-JPC. The proposed method employs a heterogeneous disjunctive graph to represent the system state and a multi-head graph attention network for feature extraction. An actor–critic framework, trained using proximal policy optimization (PPO), is adopted to make operation sequencing and machine assignment decisions. The effectiveness of the proposed method is validated through comparisons with several classic dispatching rules and a state-of-the-art DRL approach. Additionally, the contributions of key mechanisms, such as information diffusion, node features, and action space, are analyzed through a full factorial design of experiments.