Research Article
Enhancing eco-driving strategies: integrating IDM prior knowledge into the TD3 reinforcement learning framework for connected vehicles
Chain | Vol., Issue 2, 2026 |
pp. 245-266
Developing low-carbon transportation is crucial for ecological conservation and energy
security. This paper addresses eco-driving challenges in connected vehicles by proposing
a model-guided deep reinforcement learning framework to enhance the practicality and
reliability of eco-driving strategies. Integrating model-guided and data-driven approaches,
the method first designs a speed guidance algorithm based on the Intelligent Driver
Model (IDM), which flexibly adjusts driving conservatism through parameter tuning.
Subsequently, a reinforcement learning framework based on the Twin Delayed Deep Deterministic
Policy Gradient (TD3) is proposed. The reference speed generated by the IDM is embedded
into the state space as prior knowledge to guide the agent toward rapid convergence
during training. This strategy significantly optimizes vehicle energy consumption
while strictly ensuring driving safety and having minimal impact on travel efficiency.
Experimental results demonstrate that compared to baseline methods and traditional
deep reinforcement learning strategies, the proposed approach achieves superior performance
in energy savings, driving smoothness, and traffic continuity. It achieves an average
energy savings rate of 7.96% with only a 0.44% increase in travel time, validating
its effectiveness and practicality for eco-driving tasks.
DOI: 10.23919/CHAIN.2026.000008 Cited: 0 Download: 4
