Social Learning-Enhanced Deep Reinforcement Learning Through Behavioral Observation

Full abstract

Read the full abstract

In this study, we present a novel adaptive algorithm, social learning-enhanced deep reinforcement learning (SLDRL), which integrates social learning mechanisms into deep reinforcement learning (DRL) to improve agent performance in both discrete and continuous state-space environments. The proposed hybrid control architecture enables agents to autonomously decide when and how to exploit socially acquired behaviors, balancing social learning with individual exploration through an entropy-based intrinsic motivation mechanism. The framework incorporates online imitation and enactment mechanisms that allow agents to observe and selectively reuse behavioral sequences acquired from other agents during training. We evaluate SLDRL in a sparse-reward discrete grid-based foraging task and in the dense-reward continuous-state/discrete-action CartPole problem. In both domains, SLDRL agents outperform baseline DRL agents, achieving faster learning and higher cumulative rewards. The results show that socially acquired behaviors are utilized adaptively throughout training, with the balance between imitation and individual learning emerging dynamically according to the structure of the environment and the agent’s experience. Comparisons with a behavioral cloning baseline further indicate that selectively integrating observed behaviors can yield more robust long-term learning than direct imitation of demonstration trajectories. Overall, the results demonstrate that SLDRL can effectively leverage online social learning in diverse environments.