Deep learning-based vehicle trajectory prediction based on generative adversarial network for autonomous driving applications

Chih Chung Hsu, Li Wei Kang*, Shih Yu Chen, I. Shan Wang, Ching Hao Hong, Chuan Yu Chang

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review


Autonomous vehicles need to continuously navigate complex traffic environments by efficiently analyzing the surrounding scene, understanding the behavior of other traffic agents, and predicting their future trajectories. The primary objective is to draw up a safe motion and reduce the reaction time for possibly imminent hazards. The main problem addressed in this paper is to explore the movement patterns of surrounding traffic-agents and accurately predict their future trajectories for assisting the vehicle to make a reasonable decision. Traditional trajectory prediction modules require explicit coordinate information to model the interaction between the autonomous car and its surrounding vehicles. However, it is hard to know the real coordinate of surrounding vehicles in real-world scenarios without communications between vehicles. A GAN (generative adversarial network)-based deep learning framework is presented in this paper for predicting the trajectories of surrounding vehicles of an autonomous vehicle in an RGB image sequence without explicit coordinate annotation to solve this problem. To automatically predict the trajectory from RGB image sequences, a coordinate augmentation module and a coordinate stabilization module are proposed to extract the historical trajectory from an image sequence. Meanwhile, the self-attention mechanism is also proposed to improve the social pooling module for better capturing the context information of trajectories of surrounding vehicles. Experimental results are demonstrated that the proposed method is effective and efficient.

Original languageEnglish
JournalMultimedia Tools and Applications
Publication statusAccepted/In press - 2022


  • Autonomous vehicles
  • Deep learning
  • Deep social learning networks
  • Generative adversarial networks
  • Self-driving cars
  • Vehicle trajectory

ASJC Scopus subject areas

  • Software
  • Media Technology
  • Hardware and Architecture
  • Computer Networks and Communications


Dive into the research topics of 'Deep learning-based vehicle trajectory prediction based on generative adversarial network for autonomous driving applications'. Together they form a unique fingerprint.

Cite this