A journal of IEEE and CAA , publishes high-quality papers in English on original theoretical/experimental research and development in all areas of automation
Volume 1 Issue 3
Jul.  2014

IEEE/CAA Journal of Automatica Sinica

  • JCR Impact Factor: 6.171, Top 11% (SCI Q1)
    CiteScore: 11.2, Top 5% (Q1)
    Google Scholar h5-index: 51, TOP 8
Turn off MathJax
Article Contents
Kyriakos G. Vamvoudakis, "Event-Triggered Optimal Adaptive Control Algorithm for Continuous-Time Nonlinear Systems," IEEE/CAA J. of Autom. Sinica, vol. 1, no. 3, pp. 282-293, 2014.
Citation: Kyriakos G. Vamvoudakis, "Event-Triggered Optimal Adaptive Control Algorithm for Continuous-Time Nonlinear Systems," IEEE/CAA J. of Autom. Sinica, vol. 1, no. 3, pp. 282-293, 2014.

Event-Triggered Optimal Adaptive Control Algorithm for Continuous-Time Nonlinear Systems

  • This paper proposes a novel optimal adaptive eventtriggered control algorithm for nonlinear continuous-time systems. The goal is to reduce the controller updates, by sampling the state only when an event is triggered to maintain stability and optimality. The online algorithm is implemented based on an actor/critic neural network structure. A critic neural network is used to approximate the cost and an actor neural network is used to approximate the optimal event-triggered controller. Since in the algorithm proposed there are dynamics that exhibit continuous evolutions described by ordinary differential equations and instantaneous jumps or impulses, we will use an impulsive system approach. A Lyapunov stability proof ensures that the closed-loop system is asymptotically stable. Finally, we illustrate the effectiveness of the proposed solution compared to a timetriggered controller.


  • loading
  • [1]
    Heemels W P M H, Donkers M C F, Teel A R. Periodic event-triggered control for linear systems. IEEE Transactions on Automatic Control, 2013, 58(4): 847-861
    Lemmon M D. Event-triggered feedback in control, estimation, and optimization,. Networked Control Systems vol. 405: Lecture Notes in Control and Information Sciences. Heidelberg: Springer-Verlag, 2010. 293-358
    Tabuada P. Event-triggered real-time scheduling of stabilizing control tasks. IEEE Transactions on Automatic Control, 2007, 52(9): 1680-1685
    Lewis F L, Vrabie D, Vamvoudakis K G. Reinforcement learning and feedback control: using natural decision methods to design optimal adaptive controllers. IEEE Control Systems, 2012, 32(6): 76-105
    Haddad W M, Chellaboina V, Nersesov S G. Impulsive and Hybrid Dynamical Systems: Stability, Dissipativity, and Control. Princeton, NJ: Princeton University Press, 2006.
    Hespanha J P, Liberzon D, Teel A R. Lyapunov conditions for inputto-state stability of impulsive systems. Automatica, 2008, 44(11): 2735-2744
    Naghshtabrizi P, Hespanha J P, Teel A R. Exponential stability of impulsive systems with application to uncertain sampled-data systems. Systems and Control Letters, 2008, 57(5): 378-385
    Donkers M C F, Heemels W P M H. Output-based event-triggered control with guaranteed L1-gain and improved and decentralised event-triggering. IEEE Transactions on Automatic Control, 2012, 57(6): 1362-1376
    Wang X, Lemmon M D. On event design in event-triggered feedback systems. Automatica, 2012, 47(10): 2319-2322
    Demir O, Lunze J. Cooperative control of multi-agent systems with event-based communication. In: Proceedings of the 2012 American Control Conference. Montreal, QC: IEEE, 2012. 4504-4509
    Lehman D, Lunze J. Event-based control with communication delays. In: Proceedings of the 2011 IFAC World Congress. Milano, Italy: IFAC, 2011. 3262-3267
    Molin A, Hirche S. Suboptimal event-based control of linear systems over lossy channels estimation and control of networked systems. In: Proceedings of the 2nd IFAC Workshop on Distributed Estimation and Control in Networked Systems. Palace, France: IFAC, 2010. 55-60
    Garcia E, Antsaklis P J. Model-based event-triggered control with timevarying network delays. In: Proceedings of the 50th IEEE Conference on Decision and Control and European Control Conference. Orlando, FL: IEEE, 2011. 1650-1655
    Lewis F L, Syrmos V L. Optimal Control. New York: John Wiley, 1995.
    Barradas B, de Jesús J, Gommans T M P, Heemels M. Self-triggered MPC for constrained linear systems and quadratic costs. In: Proceedings of the 2012 IFAC Conference on Nonlinear Model Predictive Control. Leeuwenhorst, Netherlands: IFAC, 2012. 342-348
    Ioannou P A, Fidan B. Adaptive Control Tutorial. Advances in design and control, SIAM (PA), 2006.
    Loría A. Explicit convergence rates for MRAC-type systems. Automatica, 2004, 40(8): 1465-1468
    Loría A, Panteley E. Uniform exponential stability of linear time-varying systems: revisited. Systems and Control Letters, 2003, 47(1): 13-24
    Panteley E, Loria A, Teel A. Relaxed persistency of excitation for uniform asymptotic stability. IEEE Transactions on Automatic Control, 2001, 46(12): 1874-1886
    Polycarpou M, Farrell J, Sharma M. On-line approximation control of uncertain nonlinear systems: issues with control input saturation. In: Proceedings of the 2003 American Control Conference. Denver, CO: IEEE, 2003: 543-548
    Khalil H K. Nonlinear Systems. New Jersey: Prentice Hall, 2002.
    Vamvoudakis K G, Lewis F L. Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem. Automatica, 2010, 46(5): 878-888
    Vrabie D, Vamvoudakis K G, Lewis F L. Optimal adaptive control and differential games by reinforcement learning principles. Control Engineering Series. New York: IET Press, 2012.
    Stevens B, Lewis F L. Aircraft Control and Simulation (Second Edition). New Jersey: John Willey, 2003.
    Nevistić V, Primbs J A. Constrained Nonlinear Optimal Control: A Converse HJB Approach, Technical Memorandum No. CIT-CDS 96-021, 1996.


    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Article Metrics

    Article views (1195) PDF downloads(16) Cited by()


    DownLoad:  Full-Size Img  PowerPoint