Skip to main content
Log in

Gradient-flow approach for computing a nonlinear-quadratic optimal-output feedback gain matrix

  • Contributed Papers
  • Published:
Journal of Optimization Theory and Applications Aims and scope Submit manuscript

Abstract

In this paper, an approach is proposed for solving a nonlinear-quadratic optimal regulator problem with linear static state feedback and infinite planning horizon. For such a problem, approximate problems are introduced and considered, which are obtained by combining a finite-horizon problem with an infinite-horizon linear problem in a certain way. A gradient-flow based algorithm is derived for these approximate problems. It is shown that an optimal solution to the original problem can be found as the limit of a sequence of solutions to the approximate problems. Several important properties are obtained. For illustration, two numerical examples are presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Gonzalez, S., andMiele, A.,Sequential Gradient-Restoration Algorithm for Optimal Control Problems with General Boundary Conditions, Journal of Optimization Theory and Applications, Vol. 26, pp. 395–425, 1978.

    Article  Google Scholar 

  2. Hasdorff, L.,Gradient Optimization and Nonlinear Control, John Wiley and Sons, New York, New York, 1976.

    Google Scholar 

  3. Miele, A., Damoulakis, N., Cloutier, J. R., andTietze, J. L.,Sequential Gradient-Restoration Algorithm for Optimal Control Problems with Nondifferential Constraints, Journal of Optimization Theory and Applications, Vol. 13, pp. 218–255, 1974.

    Article  Google Scholar 

  4. Miele, A., andWang, T.,Primal-Dual Properties of Sequential Gradient-Restoration Algorithms for Optimal Control Problems, Part 1: Basic Problem, Integral Methods in Science and Engineering, Edited by F. R. Payneet al., Hemisphere Publishing Corporation, Washington, DC, pp. 577–607, 1986.

    Google Scholar 

  5. Miele, A., andWang, T.,Primal-Dual Properties of Sequential Gradient-Restoration Algorithms for Optimal Control Problems, Part 2: General Problem, Journal of Mathematical Analysis and Applications, Vol. 119, pp. 21–545, 1986.

    Article  Google Scholar 

  6. Polak, E., andMayne, D. Q.,A Feasible Direction Algorithm for Optimal Control Problems with Control and Terminal Constraints IEEE Transactions on Automatic Control, Vol. 22, pp. 741–751, 1975.

    Article  Google Scholar 

  7. Sirisena, H. R., andChou, F. S.,Convergence of Control Parametrization Ritz Method for Nonlinear Optimal Control Problems, Journal of Optimization Theory and Applications, Vol. 29, pp. 369–382, 1979.

    Article  Google Scholar 

  8. Sakawa, Y.,On Local Convergence of an Algorithm for Optimal Control, Numerical Functional Analysis and Optimization, Vol. 3, pp. 301–319, 1981.

    Google Scholar 

  9. Teo, K. L., Goh, C. J., andWong, K. H.,A Unified Computational Approach to Optimal Control Problems, Longman Scientific and Technical, Essex, England, 1991.

    Google Scholar 

  10. Teo, K. L., andJennings, L. S.,Nonlinear Optimal Control Problems with Continuous State Inequality Constraints, Journal of Optimization Theory and Applications, Vol. 63, pp. 1–22, 1989.

    Article  Google Scholar 

  11. Teo, K. L., andWong, K. H.,Nonlinear Constrained Optimal Control Problems, Journal of Australian Mathematical Society, Series B, Vol. 3, pp. 122–144, 1992.

    Google Scholar 

  12. Jennings, L. S., Fisher, M. E., Teo, K. L., andGoh, C. J.,MISER3: Solving Optimal Control Problems, An Update, Advances in Engineering Software, Vol. 13, pp. 190–196, 1991.

    Article  Google Scholar 

  13. Ahmed, N. U.,Elements of Finite-Dimensional Systems and Control Theory, Longman Scientific and Technical, Essex, England, 1988.

    Google Scholar 

  14. Bryson, A. Y., Jr., andHo, Y. C.,Applied Optimal Control, Hemisphere, Washington, DC, 1975.

    Google Scholar 

  15. Cesari, L.,Optimization: Theory and Applications, Springer Verlag, New York, New York, 1983.

    Google Scholar 

  16. Biswas, S. K., andAhmed, N. U.,Optimal Feedback Control of Power Systems Governed by Nonlinear Dynamics, Optimal Control Applications and Methods, Vol. 7, pp. 289–303, 1986.

    Google Scholar 

  17. Teo, K. L., Fisher, M. E., andMoore, J. B.,A Suboptimal Feedback Stabilizing Controller for a Class of Nonlinear Regulator Problems, Applied Mathematics and Computation, Vol. 59, pp. 1–17, 1993.

    Article  MathSciNet  Google Scholar 

  18. Yan, W. Y., Teo, K. L., andMoore, J. B.,A Gradient Flow Approach to Computing LQ Optimal Output Feedback Gains, Optimal Control Applications and Methods, Vol. 15, pp. 67–75, 1994.

    MathSciNet  Google Scholar 

  19. Vincent, T. L., Goh, B. S., andTeo, K. L.,Trajectory-Following Algorithms for Min-Max Optimization Problems, Journal of Optimization Theory and Applications, Vol. 75, pp. 501–519, 1992.

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

Communicated by T. L. Vincent

This project was partially supported by a research grant from the Australian Research Council.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Teo, K.L., Wong, K.H. & Yan, W.Y. Gradient-flow approach for computing a nonlinear-quadratic optimal-output feedback gain matrix. J Optim Theory Appl 85, 75–96 (1995). https://doi.org/10.1007/BF02192300

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02192300

Key Words

Navigation