Sampled-data control for dynamic programming of continuous-time system, which can facilitate to implement control actions under networked environments, is rarely considered in most existing works. In order to address this issue, an event-triggered dynamic programming sampling control (ET-DPSC) approach is investigated for networked path-following control of autonomous vehicles. The first goal is to establish the sampled-data-based event-triggered path-following control model using Hamilton–Jacobi–Bellman equation. Secondly, the asymptotic stability criterion in an input-to-state sense should be tackled by exploiting Lyapunov theory and input delay approach. As a third goal, the sampled-data controller based on dynamic programming method should be synthesized. Compared to most existing ADP-based control strategies, the proposed ET-DPSC approach not only guarantees the stability of path-following control but also provides significant benefits for control implementation under communication-constrained environments. In addition, Zeno behavior is naturally excluded by using periodic discrete-time sampling control fashion. At last, Simulink and CarSim joint simulations are conducted to show effectiveness of the proposed ET-DPSC scheme by comparing with linear quadratic regulation without considering input delay.

1. [1] S. Zhang, C. Markos, and J. J. Q. Yu, “Autonomous vehicle intelligent system: Joint ride-sharing and parcel delivery strategy,” IEEE Trans. on Intelligent Transportation Systems, Vol.23, No.10, pp. 18466-18477, 2022. https://doi.org/10.1109/TITS.2022.3162609
2. [2] H. U. Ahmed, Y. Huang, P. Lu, and R. Bridgelall, “Technology developments and impacts of connected and autonomous vehicles: An overview,” Smart Cities, Vol.5, No.1, pp. 382-404, 2022. https://doi.org/10.3390/smartcities5010022
3. [3] X. Li, F. Dunkin, and J. Dezert, “Multi-source information fusion: Progress and future,” Chinese J. of Aeronautics, Vol.37, No.7, pp. 24-58, 2024. https://doi.org/10.1016/j.cja.2023.12.009
4. [4] J. Liu et al., “Multi-kernel online reinforcement learning for path tracking control of intelligent vehicles,” IEEE Trans. on Systems, Man, and Cybernetics: Systems, Vol.51, No.11, pp. 6962-6975, 2021. https://doi.org/10.1109/TSMC.2020.2966631
5. [5] B. Zhao and D. Liu, “Event-triggered decentralized tracking control of modular reconfigurable robots through adaptive dynamic programming,” IEEE Trans. on Industrial Electronics, Vol.67, No.4, pp. 3054-3064, 2020. https://doi.org/10.1109/TIE.2019.2914571
6. [6] D. Liu, S. Xue, B. Zhao, B. Luo, and Q. Wei, “Adaptive dynamic programming for control: A survey and recent advances,” IEEE Trans. on Systems, Man, and Cybernetics: Systems, Vol.51, No.1, pp. 142-160, 2021. https://doi.org/10.1109/TSMC.2020.3042876
7. [7] H. Wang et al., “Path tracking control of an autonomous vehicle with model-free adaptive dynamic programming and RBF neural network disturbance compensation,” Proc. of the Institution of Mechanical Engineers, Part D: J. of Automobile Engineering, Vol.236, No.5, pp. 825-841, 2022. https://doi.org/10.1177/09544070211033835
8. [8] P. Zhao et al., “Design of a control system for an autonomous vehicle based on adaptive-PID,” Int. J. of Advanced Robotic Systems, Vol.9, No.2, Article No.44, 2012. https://doi.org/10.5772/51314
9. [9] C. Zhang et al., “A novel fuzzy observer-based steering control approach for path tracking in autonomous vehicles,” IEEE Trans. on Fuzzy Systems, Vol.27, No.2, pp. 278-290, 2019. https://doi.org/10.1109/TFUZZ.2018.2856187
10. [10] H. Gao, Z. Kan, and K. Li, “Robust lateral trajectory following control of unmanned vehicle based on model predictive control,” IEEE/ASME Trans. on Mechatronics, Vol.27, No.3, pp. 1278-1287, 2022. https://doi.org/10.1109/TMECH.2021.3087605
11. [11] J. Ni, J. Hu, and C. Xiang, “Robust control in diagonal move steer mode and experiment on an X-by-wire UGV,” IEEE/ASME Trans. on Mechatronics, Vol.24, No.2, pp. 572-584, 2019. https://doi.org/10.1109/TMECH.2019.2892489
12. [12] F. L. Lewis and D. Vrabie, “Reinforcement learning and adaptive dynamic programming for feedback control,” IEEE Circuits and Systems Magazine, Vol.9, No.3, pp. 32-50, 2009. https://doi.org/10.1109/MCAS.2009.933854
13. [13] J. J. Murray, C. J. Cox, G. G. Lendaris, and R. Saeks, “Adaptive dynamic programming,” IEEE Trans. on Systems, Man, and Cybernetics, Part C (Applications and Reviews), Vol.32, No.2, pp. 140-153, 2002. https://doi.org/10.1109/TSMCC.2002.801727
14. [14] X. Ge, S. Xiao, Q.-L. Han, X.-M. Zhang, and D. Ding, “Dynamic event-triggered scheduling and platooning control co-design for automated vehicles over vehicular ad-hoc networks,” IEEE/CAA J. of Automatica Sinica, Vol.9, No.1, pp. 31-46, 2022. https://doi.org/10.1109/JAS.2021.1004060
15. [15] H.-T. Sun, C. Peng, and F. Ding, “Self-discipline predictive control of autonomous vehicles against denial of service attacks,” Asian J. of Control, Vol.24, No.6, pp. 3538-3551, 2022. https://doi.org/10.1002/asjc.2749
16. [16] H. Fang et al., “Robust tracking control for magnetic wheeled mobile robots using adaptive dynamic programming,” ISA Trans., Vol.128, Part A, pp. 123-132, 2022. https://doi.org/10.1016/j.isatra.2021.10.017
17. [17] F. Lin, “Robust control design: An optimal control approach,” John Wiley & Sons, Inc., 2007.
18. [18] K. Liu, A. Selivanov, and E. Fridman, “Survey on time-delay approach to networked control,” Annual Reviews in Control, Vol.48, pp. 57-79, 2019. https://doi.org/10.1016/j.arcontrol.2019.06.005
19. [19] E. Fridman, A. Seuret, and J.-P. Richard, “Robust sampled-data stabilization of linear systems: An input delay approach,” Automatica, Vol.40, No.8, pp. 1441-1446, 2004. https://doi.org/10.1016/j.automatica.2004.03.003
20. [20] M. Lv, Z. Peng, D. Wang, and Q.-L. Han, “Event-triggered cooperative path following of autonomous surface vehicles over wireless network with experiment results,” IEEE Trans. on Industrial Electronics, Vol.69, No.11, pp. 11479-11489, 2022. https://doi.org/10.1109/TIE.2021.3120442
21. [21] C. Peng and T. C. Yang, “Event-triggered communication and H_∞ control co-design for networked control systems,” Automatica, Vol.49, No.5, pp. 1326-1332, 2013. https://doi.org/10.1016/j.automatica.2013.01.038
22. [22] A. Eqtami, D. V. Dimarogonas, and K. J. Kyriakopoulos, “Event-triggered control for discrete-time systems,” Proc. of the 2010 American Control Conf., pp. 4719-4724, 2010. https://doi.org/10.1109/ACC.2010.5531089
23. [23] F. Viadero-Monasterio, A.-T. Nguyen, J. Lauber, M. J. L. Boada, and B. L. Boada, “Event-triggered robust path tracking control considering roll stability under network-induced delays for autonomous vehicles,” IEEE Trans. on Intelligent Transportation Systems, Vol.24, No.12, pp. 14743-14756, 2023. https://doi.org/10.1109/TITS.2023.3321415
24. [24] C. Mu, K. Wang, and Z. Ni, “Adaptive learning and sampled-control for nonlinear game systems using dynamic event-triggering strategy,” IEEE Trans. on Neural Networks and Learning Systems, Vol.33, No.9, pp. 4437-4450, 2022. https://doi.org/10.1109/TNNLS.2021.3057438
25. [25] X. Zhong and H. He, “An event-triggered ADP control approach for continuous-time system with unknown internal states,” IEEE Trans. on Cybernetics, Vol.47, No.3, pp. 683-694, 2017. https://doi.org/10.1109/TCYB.2016.2523878
26. [26] Y. Yang et al., “Event-triggered ADP control of a class of non-affine continuous-time nonlinear systems using output information,” Neurocomputing, Vol.378, pp. 304-314, 2020. https://doi.org/10.1016/j.neucom.2019.08.097
27. [27] R. Rajamani, “Vehicle Dynamics and Control, 2nd Edition,” Springer, 2012. https://doi.org/10.1007/978-1-4614-1433-9
28. [28] W. P. M. H. Heemels, K. H. Johansson, and P. Tabuada, “An introduction to event-triggered and self-triggered control,” 2012 IEEE 51st IEEE Conf. on Decision and Control, pp. 3270-3285, 2012. https://doi.org/10.1109/CDC.2012.6425820
29. [29] K. Liu, E. Fridman, and L. Hetel, “Network-based control via a novel analysis of hybrid systems with time-varying delays,” 2012 IEEE 51st IEEE Conf. on Decision and Control, pp. 3886-3891, 2012. https://doi.org/10.1109/CDC.2012.6426725
30. [30] Y. Yang, X.-M. Zhang, W. He, Q.-L. Han, and C. Peng, “Position-based synchronization of networked harmonic oscillators with asynchronous sampling and communication delays,” IEEE Trans. on Cybernetics, Vol.51, No.8, pp. 4337-4347, 2021. https://doi.org/10.1109/TCYB.2019.2922984