• Jun 14, 2017 News!Vol.6, No.3 has been indexed by EI(Inspec)!   [Click]
  • May 03, 2016 News!Vol.5, No.5 has been indexed by EI(Inspec)!   [Click]
  • May 03, 2016 News!Vol.5, No.4 has been indexed by EI(Inspec)!   [Click]
General Information
    • ISSN: 2010-3700
    • Frequency: Bimonthly
    • DOI: 10.18178/IJMLC
    • Editor-in-Chief: Dr. Lin Huang
    • Executive Editor:  Ms. Cherry L. Chen
    • Abstracing/Indexing: Engineering & Technology Digital Library, Google Scholar, Crossref, ProQuest, Electronic Journals Library, DOAJ and EI (INSPEC, IET).
    • E-mail: ijmlc@ejournal.net
Editor-in-chief
Dr. Lin Huang
Metropolitan State University of Denver, USA
It's my honor to take on the position of editor in chief of IJMLC. We encourage authors to submit papers concerning any branch of machine learning and computing.
IJMLC 2016 Vol.6(3): 172-178 ISSN: 2010-3700
DOI: 10.18178/ijmlc.2016.6.3.594

Policy Iteration Based Optimal Control for Partially Unknown Nonlinear Systems via Semi-parametric Regression Model

Jingliang Sun, Chunsheng Liu, and Nian Liu
Abstract—This paper presents a novel online learning algorithm, in an actor-critic structure, to find state-feedback optimal controllers for partially unknown nonlinear systems. The algorithm converges online to the optimal solution under the condition of initial stabilizing controller. It is derived from integral reinforcement learning (IRL) technique, and makes use of semi-parametric regression model (SPRM) to approximate the optimal controller and the optimal cost function of a control dynamic system. The convergence to the optimal controller is proven, and the stability of the closed-loop nonlinear system is also guaranteed. The feasibility of the proposed learning algorithm is demonstrated in simulation on two example systems.

Index Terms—Policy iteration, optimal control, actor-critic structure, SPRM, nonlinear systems.

The authors are with the Automation Department, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016 China (e-mail: sunjingliangac@163.com. liuchsh@nuaa.edu.cn, liunian@nuaa.edu.cn).

[PDF]

Cite: Jingliang Sun, Chunsheng Liu, and Nian Liu, "Policy Iteration Based Optimal Control for Partially Unknown Nonlinear Systems via Semi-parametric Regression Model," International Journal of Machine Learning and Computing vol. 6, no. 3, pp. 172-178, 2016.

Copyright © 2008-2015. International Journal of Machine Learning and Computing. All rights reserved.
E-mail: ijmlc@ejournal.net