In this work, we analyze the consequences that the so-called turnpike property has on the long-time behavior of the value function corresponding to a finite-dimensional linear-quadratic optimal control problem with general terminal cost and constrained controls.
We prove that, when the time horizon TTT tends to infinity, the value function asymptotically behaves as W(x)+c T+λW(x) + c\, T + \lambda W(x)+cT+λ, and we provide a control interpretation of each of these three terms, making clear the link with the turnpike property.
As a by-product, we obtain the long-time behavior of the solution to the associated Hamilton-Jacobi-Bellman equation in a case where the Hamiltonian is not coercive in the momentum variable. As a result of independent interest, we provide a new turnpike result for the linear-quadratic optimal control problem with constrained control. As a main feature, our turnpike result applies to the case when the steady optimum may saturate the control constraints. This prevented us from proving the turnpike property with an exponential rate, which is well-known to hold for the unconstrained case.
In this work, we analyze the consequences that the so-called turnpike property has on the long-time behavior of the value function corresponding to an optimal control problem. As a by-product, we obtain the long-time behavior of the solution to the associated Hamilton-Jacobi-Bellman equation.
In order to carry out our study, we use the setting of a finite-dimensional linear-quadratic optimal control problem, for which the turnpike property is well understood. We prove that, when the time horizon T tends to infinity, the value function converges to a travelling-front like solution of the form W(x) + c T + λ. In addition, we provide a control interpretation of each of these three terms in the spirit of the turnpike theory. Finally, we compare this asymptotic decomposition with the existing results on long-time behavior for Hamilton-Jacobi equations. We stress that in our case, the Hamiltonian is not coercive in the momentum variable, a case rarely considered in the classical literature about Hamilton-Jacobi equations.