1.

Record Nr.

UNINA9910674355703321

Autore

Hernández-Lerma O (Onésimo)

Titolo

An Introduction to Optimal Control Theory : The Dynamic Programming Approach / / by Onésimo Hernández-Lerma, Leonardo R. Laura-Guarachi, Saul Mendoza-Palacios, David González-Sánchez

Pubbl/distr/stampa

Cham : , : Springer International Publishing : , : Imprint : Springer, , 2023

ISBN

3-031-21139-1

Edizione

[1st ed. 2023.]

Descrizione fisica

1 online resource (279 pages)

Collana

Texts in Applied Mathematics, , 2196-9949 ; ; 76

Disciplina

515.642

Soggetti

Stochastic processes

Stochastic models

Stochastic Systems and Control

Stochastic Modelling

Lingua di pubblicazione

Inglese

Formato

Materiale a stampa

Livello bibliografico

Monografia

Nota di bibliografia

Includes bibliographical references (pages 263-270) and index.

Nota di contenuto

Introduction: optimal control problems-. Discrete-time deterministic systems -- Discrete-time stochastic control systems -- Continuous-time deterministic systems -- Continuous-time Markov control processes -- Controlled diffusion processes -- Appendices -- Bibliography -- Index.

Sommario/riassunto

This book introduces optimal control problems for large families of deterministic and stochastic systems with discrete or continuous time parameter. These families include most of the systems studied in many disciplines, including Economics, Engineering, Operations Research, and Management Science, among many others. The main objective is to give a concise, systematic, and reasonably self contained presentation of some key topics in optimal control theory. To this end, most of the analyses are based on the dynamic programming (DP) technique. This technique is applicable to almost all control problems that appear in theory and applications. They include, for instance, finite and infinite horizon control problems in which the underlying dynamic system follows either a deterministic or stochastic difference or differential equation. In the infinite horizon case, it also uses DP to study undiscounted problems, such as the ergodic or long-run average cost.



After a general introduction to control problems, the book covers the topic dividing into four parts with different dynamical systems: control of discrete-time deterministic systems, discrete-time stochastic systems, ordinary differential equations, and finally a general continuous-time MCP with applications for stochastic differential equations. The first and second part should be accessible to undergraduate students with some knowledge of elementary calculus, linear algebra, and some concepts from probability theory (random variables, expectations, and so forth). Whereas the third and fourth part would be appropriate for advanced undergraduates or graduate students who have a working knowledge of mathematical analysis (derivatives, integrals, ...) and stochastic processes.