Open Access

Optimal Control Problem for Uncertain Linear Systems with Multiple Input Delays

Journal of Uncertainty Analysis and Applications20164:5

DOI: 10.1186/s40467-016-0048-x

Received: 1 July 2016

Accepted: 19 September 2016

Published: 6 October 2016


Based on the concept of uncertain process, uncertain linear systems with multiple input delays are considered in this paper. An optimal problem for such systems is introduced and solved by using the equation of optimality and maximum principle. Finally, an example is given to show how to solve an uncertain optimal control model with time-delay.


Optimal control Uncertain system Input delay


The delay system was first proposed in the eighteenth century. Until the twentieth century, with the maximum principle and dynamic programming theory, delay system attracted significant interest from many researchers. In recent decades, the study of time-delay systems had a great development not only in theory but also in applications. Optimal control problems of linear time-delay systems were discussed in Basin [1] and Eller et al. [2]. Stochastic control problems with delay were studied by Bauer and Rieder [3] and Larssen and Risebro [4]. A set of infinite-dimensional differential equations could model the dynamic systems which have multiple input delays. Hamiltonian function can be used to solve the control problems with delay [5]. Moreover, the phenomenon of systems with multiple input delays are ubiquitous. It widely exists in communications. With the rapid development of information and technology, multi-input time-delay systems become a research hot spot.

In the real world, we will encounter a lot of indeterminacy; these phenomena cannot be explained by random events, such as high speed, about 50 kg. This fact prompted researchers to create a new mathematical tool. Liu [6] found an uncertainty theory through introducing an uncertain measure based on normality, self-duality, countable subadditivity, and product measure axioms. Based on an uncertain variable, uncertain process, and canonical process, Liu [7] presented uncertain differential equation. It aims to describe the evolution of dynamic uncertain systems and has widely applied in finance so far. Liu [8] assumed the stock price follows a time-homogenous uncertain differential equation and proposed the first uncertain stock model. Ji and Zhou [9] proved the existence and uniqueness of a multi-dimensional uncertain differential equation. Based on the uncertain differential equation, in 2010, Zhu [10] presented an equation of optimality for an uncertain optimal control problem by using dynamic programming. This equation plays a significant role in solving uncertain optimal control problems. It has been applied to uncertain bang-bang control problems by Xu and Zhu [11] and uncertain time-delay systems control problem by Chen and Zhu [12].

In this paper, we will introduce an uncertain linear system with multiple input delays and propose an optimal control problem subject to this system. The organization of the paper is as follows. In the “Preliminary” section, some basic concepts are reviewed. In the “Problem Statement” section, an uncertain linear system with multiple input delays is formulated, and the optimal control is derived in the problem by using the equation of optimality. In the “Example” section, we will give a numerical example of uncertain linear systems with multiple input delays to illustrate the result obtained in the previous section.


Some concepts about uncertain measure, uncertain variable, and uncertain process can be found in Liu [6]. In convenience, we give some useful concepts. Let Γ be a nonempty set and L be a σ-algebra over Γ. The set function M defined on the σ-algebra L is called an uncertain measure if it satisfies the three axioms: M{Γ}=1; M{Λ}+M{Λ c }=1 for any event ΛL; and \(M\left \{\bigcup ^{\infty }_{i=1}\Lambda _{i}\right \}\leq \sum ^{\infty }_{i=1}M\{\Lambda _{i}\}\) for every countable sequence of events {Λ i }L. Then, the triplet (Γ,L,M) is called an uncertainty space. An uncertain variable is a measurable function from an uncertainty space (Γ,L,M) to the set R of real numbers, and an uncertain vector is a measurable function from an uncertainty space to R n . The uncertainty distribution Φ: R→[0,1] of an uncertain variable ξ is defined by Φ(x)=M{ξx} for any real number x. An uncertain process is a measurable function from V×(Γ,L,M) to the set of real numbers where V is an index set.

Definition 1

(Liu [8]) The uncertain variables ξ 1,ξ 2,ξ m are said to be independent if \(M\{\bigcap ^{m}_{i=1}(\xi _{i}\in B_{i})\}=\min _{1\leq i\leq m}M\{\xi _{i}\in B_{i}\}\) for any Borel sets B 1,B 2,B m of real numbers.

Definition 2

(Liu [6]) The expected value of an uncertain variable ξ is defined by
$$E[\xi]=\int^{+\infty}_{0}M\{\xi\geq r\}dr-\int^{0}_{-\infty}M\{\xi\leq r\}dr, $$
provided that at least one of the two integrals is finite.

For any numbers a and b, E[a ξ+b η]=a E[ξ]+b E[η] if ξ and η are independent uncertain variables.

Definition 3

(Liu [8]) An uncertain process C t is said to be a canonical process if (i) C 0=0 and almost all sample paths are Lipschitz continuous; (ii) C t has stationary and independent increments; (iii) every increment C s+t C s is a normal uncertain variable with expected value 0 and variance t 2, denoted by \(C_{s+t}-C_{s}\thicksim N(0,t)\), whose distribution is
$$\Phi(x)=\left(1+\exp\left(\frac{-\pi x}{\sqrt{3} t}\right)\right)^{-1}, x\in R. $$

Definition 4

(Liu [8]) Let X t be an uncertain process and C t be a canonical process. For any partition of closed interval [a,b] with a=t 1<t 2<<t k+1=b, the mesh is written as =max1≤ik t i+1t i . Then, uncertain integral of X t with respect to C t is
$${\int^{b}_{a}} X_{t} {dC}_{t}={\lim\limits_{\triangle\rightarrow 0}}\sum_{i=1}^{k} X_{t_{i}}\cdot\left(C_{t_{i+1}}-C_{t_{i}}\right), $$
provided that the limit exists almost surely and is finite.

Definition 5

(Liu [8]) Suppose C t is a canonical process, and f and g are two functions. Then,
$$ {dX}_{t}=f(t,X_{t})dt+g(t,X_{t}){dC}_{t}, $$

is called an uncertain differential equation. A solution is an uncertain process X t that satisfies (1) identically in t.


The uncertain differential Eq. (1) is equivalent to the uncertain integral equation
$$X_{s}=X_{0}+{\int^{s}_{0}} f(t,X_{t})dt+{\int^{s}_{0}} g(t,X_{t}){dC}_{t}. $$

Problem Statement

Consider an uncertain linear system with multiple time-delays in the control input
$$ {dX}_{s}=\left(a_{0}(s)+a_{1}(s)X_{s}+\sum_{i=1}^{p} B_{i}(s)u(s-h_{i})\right)ds+b(s){dC}_{s}, $$

with the initial condition X(t 0)=X 0, where t 0 is the initial time. Here, X s is the state vector of n dimension, u s is the control vector of m dimension; h i >0(i=1,,p) are positive time-delays; h= max{h 1,,h p } is the maximum delay shift; and \(C_{s}=(C_{s_{1}},C_{s_{2}},\cdots,C_{s_{p}})\phantom {\dot {i}\!}\), where \(C_{s_{1}},C_{s_{2}},\cdots,C_{s_{p}}\phantom {\dot {i}\!}\) are independent canonical process. And a 0(s),a 1(s),b(s), and B i (s)(i=1,2,,p) are piecewise continuous matrix functions of appropriate dimensions.

The quadratic cost function to be maximized is defined as follows:
$$ J(t,X_{t})=\sup_{u\in U}E\left(\frac{1}{2}{\int_{t}^{T}}(u_{s}^{\tau} R(s) u_{s}+X_{s}^{\tau} L(s) X_{s})ds+X_{T}^{\tau}\Psi_{T} X_{T}\right), $$

where R(s) is positive definite, Ψ T ,L(s) are nonnegative definite symmetric matrices, and T>0 is a time moment.

The optimal control problem is to find the control u (t)(t[t 0,T]) that maximizes the criterion J(t,x) along with the trajectory x (t)(t[t 0,T]), generated upon substituting u (t) into the state Eq. (2).

Theorem 1

Let C t be a canonical process, u 1t be an n×n integrable uncertain process, and u 2t and v 2t be two n-dimensional integrable uncertain processes. Then, the n-dimensional linear uncertain differential equation
$$ {dX}_{t}=\left(u_{1t}X_{t}+u_{2t}\right)dt+v_{2t}{dC}_{t}, $$
has a solution
$$ X_{t}=U_{t}\left(X_{0}+{\int^{t}_{0}}U_{s}^{-1}u_{2s}ds+{\int_{0}^{t}}U_{s}^{-1}v_{2s}{dC}_{s}\right), $$
$$U_{t}=\exp\left({\int_{0}^{t}}u_{1s}ds\right). $$


At first, we define two uncertain processes U t and V t via uncertain differential equations,
$${dU}_{t}=u_{1t}U_{t}dt, \; {dV}_{t}=U^{-1}_{t}u_{2t}dt+U^{-1}_{t}v_{2t}{dC}_{t}. $$
It follows from the integration by parts that
$$d(U_{t}V_{t})=U_{t}{dV}_{t}+{dU}_{t}\cdot V_{t}=(u_{1t}U_{t}V_{t}+u_{2t})dt+(v_{2t}){dC}_{t}. $$
That is, the uncertain process X t =U t V t is a solution of the uncertain differential Eq. (4). Write U t as
$$U_{t}=\sum^{\infty}_{n=0}\frac{1}{n!}\left({\int^{t}_{0}} u_{1s}ds\right)^{n}\cdot U_{0}. $$
Taking differentiation operations on both sides, we have
$${dU}_{t}=\!\sum^{\infty}_{n=1}\frac{u_{1t}}{(n-1)!}\left({\int^{t}_{0}} u_{1s}ds\right)^{n-1}dt\cdot U_{0} =u_{1t}\sum^{\infty}_{n=0}\frac{1}{n!}\left({\int^{t}_{0}} u_{1s}ds\right)^{n}\cdot U_{0} dt=u_{1t}U_{t}dt. $$
Thus, the solution of uncertain differential equation d U t =u 1t U t d t is
$$U_{t}=\sum^{\infty}_{n=0}\frac{1}{n!}\left({\int^{t}_{0}} u_{1s}ds\right)^{n}\cdot U_{0}=\exp\left({\int_{0}^{t}}u_{1s}ds\right)\cdot U_{0}. $$
In addition, we have
$$V_{t}=V_{0}+{\int_{0}^{t}}U^{-1}_{s}u_{2s}ds+{\int_{0}^{t}}U^{-1}_{s}v_{2s}{dC}_{s}. $$

Taking U 0=I and V 0=X 0, we get the solution (5). The theorem is proved. □

Theorem 2

The solution to the optimal control problem for the uncertain linear system with input delay (2) and the quadratic criterion (3) are given as follows. The optimal control law for tt 0 is given by
$$u^{*}(t)=-R^{-1}(t)\sum_{i=1}^{p} B_{i}(t)M_{i}(t)(P(t)x+Q(t)), $$
where P(t) satisfies
$$ \left\{ \begin{array}{l} {\dot{P}(t)}=-\frac{1}{2}\sum\limits_{i=1}^{p} M_{i}^{\tau}(t)B_{i}^{\tau}(t)P^{\tau}(t)R^{-1}(t)P(t)\sum\limits_{i=1}^{p}B_{i}(t)M_{i}(t)+L(t)+a_{1}(t)P(t)\\ P(T)=2 \Psi, \end{array} \right. $$
and Q(t) is a solution of the following differential equation
$$ {}\left\{\! \begin{array}{l} {\dot{Q}(t)}=-\sum\limits_{i=1}^{p}M_{i}^{\tau}(t)B_{i}^{\tau}(t) P(t)R^{-1}(t)Q(t)\sum\limits_{i=1}^{p}B_{i}(t)M_{i}(t)+a_{0}(t)P(t)+a_{1}(t)Q(t)\\ Q(T)=0, \end{array} \right. $$
where \(M_{i}(t)=\exp (-\int _{t-h_{i}}^{t} a_{1}(s)ds)\). The optimal value for tt 0 is given by
$$J(t,x)=\frac{1}{2}x^{\tau} P(t)x+Q(t)x+K(t), $$
$$ \begin{aligned} K(t)=&{\int_{t}^{T}}\bigg\{-\frac{1}{2}\sum_{i=1}^{p} M_{i}^{\tau}(s)B_{i}^{\tau}(s) Q(s)^{\tau} R^{-1}(s)Q(s)\sum_{i=1}^{p}B_{i}(s)M_{i}(s)+a_{0}(t)Q(s)\bigg\}ds. \end{aligned} $$


Using the equation of optimality in Zhu [10] for the optimal control problems (2) and (3), we get
$$ {}\begin{aligned} -J_{t}(t,X_{t})=\sup_{u\in U}\left\{\frac{1}{2}(u_{t}^{\tau} R(t)u_{t}+X_{t}^{\tau} L(t)X_{t})+J_{x}^{\tau} a_{0}(t)+J_{x}^{\tau} a_{1}(t)X_{t} +J_{x}^{\tau}\sum_{i=1}^{p} B_{i}(t)u_{t-h_{i}}\right\}. \end{aligned} $$
$$g(u_{t})=\frac{1}{2}(u_{t}^{\tau} R(t)u_{t}+X_{t}^{\tau} L(t)X_{t})+J_{x}^{\tau} a_{0}(t)+J_{x}^{\tau} a_{1}(t)X_{t}+J_{x}^{\tau}\sum_{i=1}^{p} B_{i}(t)u_{t-h_{i}}. $$
Setting \(\frac {\partial g(u_{t})}{\partial u_{t}}=0\) yields
$$R(t)u_{t}+\sum_{i=1}^{p} M_{i}^{\tau}(t) B_{i}^{\tau}(t)J_{x}=0, $$
where \(M_{i}(t)=\frac {\partial u_{t-h_{i}}}{\partial u_{t}}\). Hence,
$$ u_{t}^{*}=-R^{-1}(t)\sum_{i=1}^{p}M_{i}^{\tau}(t) B_{i}^{\tau}(t)J_{x}. $$
By Eq. (9), we have
$$ -J_{t}=\frac{1}{2}\Big(u_{t}^{*\tau} R(t)u_{t}^{*}+X_{t}^{\tau} L(t)X_{t}\Big)+J_{x}^{\tau}\left(a_{0}(t)+a_{1}(t)X_{t}+\sum_{i=1}^{p} B_{i}(t)u_{t-h_{i}}^{*}\right). $$
Since \(J(T,X_{T})=X_{T}^{\tau }\Psi X_{T}\), we guess
$$J(t,x)=\frac{1}{2}x^{\tau} P(t)x+Q(t)x+K(t). $$
$$ J_{t}=\frac{1}{2}x^{\tau} \dot{P}(t)x+{\dot{Q}(t)}x+{\dot{K}(t)}, $$
$$ J_{x}=P(t)x+Q(t). $$
Substituting Eqs. (10) and (13) into Eq. (11) yields
$$ {}\begin{aligned} -&J_{t}(t,X_{t})=x^{\tau}\left\{\!-\frac{1}{2}\sum_{i=1}^{p} M_{i}^{\tau}(t)B_{i}^{\tau}(t)P^{\tau}(t)R^{-1}(t)P(t)\sum_{i=1}^{p}B_{i}(t)M_{i}(t)+L(t)+a_{1}(t)P(t)\right\}x\\ &+\left\{-\sum_{i=1}^{p}M_{i}^{\tau}(t)B_{i}^{\tau}(t) P(t)R^{-1}(t)Q(t)\sum_{i=1}^{p}B_{i}(t)M_{i}(t)+a_{0}(t)P(t)+a_{1}(t)Q(t)\right\}x\\ &-\frac{1}{2}\sum_{i=1}^{p} M_{i}^{\tau}(t)B_{i}^{\tau}(t) Q(t)^{\tau} R^{-1}(t)Q(t)\sum_{i=1}^{p}B_{i}(t)M_{i}(t)+a_{0}(t)Q(t). \end{aligned} $$
By Eqs. (12) and (14), we get
$$ {}\left\{ \begin{array}{l} {\dot{P}(t)}=-\frac{1}{2}\sum\limits_{i=1}^{p} M_{i}^{\tau}(t)B_{i}^{\tau}(t)P^{\tau}(t)R^{-1}(t)P(t)\sum\limits_{i=1}^{p}B_{i}(t)M_{i}(t)+L(t)+a_{1}(t)P(t)\\ {\dot{Q}(t)}=-\sum\limits_{i=1}^{p}M_{i}^{\tau}(t)B_{i}^{\tau}(t) P(t)R^{-1}(t)Q(t)\sum\limits_{i=1}^{p}B_{i}(t)M_{i}(t)+a_{0}(t)P(t)+a_{1}(t)Q(t), \end{array} \right. $$
$$ \dot{K}(t)= -\frac{1}{2}\sum_{i=1}^{p} M_{i}^{\tau}(t)B_{i}^{\tau}(t) Q(t)^{\tau} R^{-1}(t)Q(t)\sum_{i=1}^{p}B_{i}(t)M_{i}(t)+a_{0}(t)Q(t). $$
Since \(J(T,x)=\frac {1}{2}x^{\tau } P(T)x+Q(T)x+K(T)=x^{\tau }\Psi _{T} x\), we have P(T)=2Ψ T ,Q(T)=0, and K(T)=0. By Eq. (15), we obtain Eqs. (6) and (7). By Eq. (16), Eq. (8) holds. Therefore,
$$J(t,x)=\frac{1}{2}x^{\tau} P(t)x+Q(t)x+K(t) $$
is the optimal value of the uncertain linear system with input delay Eq. (2) and the quadratic criterion Eq. (3), and
$$ u_{t}^{*}=-R^{-1}(t)M_{i}^{\tau}(t)\sum_{i=1}^{p} B_{i}^{\tau}(t)(P(t)x+Q(t)). $$
Let us find the value of matrices M i (t) for this problem. Substituting the optimal control law Eq. (17) into the Eq. (2) gives
$$ \begin{aligned} {dX}_{s}&= \left\{-\sum_{i=1}^{p} B_{i}(s)R^{-1}(s-h_{i})M_{i}^{\tau}(s-h_{i})\sum_{i=1}^{p} B_{i}^{\tau}(s-h_{i})\left(P(s-h_{i})X_{s-h_{i}}\right.\right.\\ &\left.\qquad+ Q(s-h_{i})\big)+a_{0}(s)+a_{1}(s)X_{s}{\vphantom{\sum_{i=1}^{p}}}\right\}ds+b(s){dC}_{s}. \end{aligned} $$
The multi-dimensional uncertain differential Eq. (18) is equivalent to the multi-dimensional uncertain integral equation
$$ {}\begin{aligned} &X_{t}=U(r,t)\left\{-{\int^{t}_{r}}U(t,s)^{-1}\left\{\sum^{p}_{i=1}B_{i}(s)R(s-h_{i})^{-1}M_{i}^{\tau}(s-h_{i})\sum^{p}_{i=1}B_{i}^{\tau}(s-h_{i})\right.\right.\\ &\qquad\qquad\quad\left.\left.\Big(P(s-h_{i})X+Q(s-h_{i})\Big)+a_{0}(s){\vphantom{\sum^{p}_{i=1}B_{i}}}\right\}ds+{\int^{t}_{r}} U(t,s)^{-1}b(s){dC}_{s}+X_{r}\right\}, \end{aligned} $$
where t,rt 0, and
$$U(r,t)=\exp\left(-{\int^{t}_{r}} a_{1}(s)ds\right), $$
and we know
$$U(t-h_{i},t)=\exp\left(-\int_{t-h_{i}}^{t} a_{1}(s)ds\right). $$
Since the integral terms in the right-hand side of Eq. (19) do not explicitly depend on u t ,
$$\partial x_{t}/\partial u_{t}=U(r,t)\partial x_{r}/\partial u_{t}. $$
It can be converted to
$$\partial u_{t}/\partial x_{t}=(\partial u_{t}/\partial x_{r})U(t,r). $$
Hence, the equality
$${Tu}_{t}=K_{1}U(r,t)K_{2}x_{r} $$
holds, where TR n×m and K 1,K 2R n×n can be selected the same for any t,rt 0. Writing the last equality for \(x_{t+h_{i}},h_{i}>0\), we have
$${Tu}_{t+h_{i}}=K_{1}U(r,t+h_{i})K_{2}x_{r}. $$
$$\left(\partial ({Tu}_{t})/\partial {Tu}_{t+h_{i}}\right)=U(r,t)(U(r,t+h_{i}))^{-1}=U(t+h_{i},t), $$
which leads to
$$\left(\partial ({Tu}_{t})/\partial u_{t+h_{i}}\right)=U(t+h_{i},t)T. $$
Now setting T=B i (t) and using th i instead of t yields
$$ B_{i}(t)\left(\partial u_{t-h_{i}}/\partial u_{t}\right)=B_{i}(t)M_{i}(t)=U(t,t-h_{i})B_{i}(t) =\exp\left(-\int_{t-h_{i}}^{t} a_{1}(s)ds\right)B_{i}(t), $$

for tt 0+h i .

$$M_{i}(t)=\exp\left(-\int_{t-h_{i}}^{t} a_{1}(s)ds\right). $$

The theorem is proved. □


We consider the following example of uncertain linear systems with multiple time-delays in the control input
$$ \left\{ \begin{array}{l} J(0,X_{0})=\sup_{u\in U}E\Big(\frac{1}{2}{\int_{0}^{2}}({u_{s}^{2}}+{X_{s}^{2}})ds+{X_{T}^{2}}\Big),\\ subject~to \\ {dX}_{t}=(X_{t}+u_{t-0.1}+u_{t})dt+{dC}_{t},t\in [0,2]\\ u_{t}=0, t\in [-0.1,0]\\ X_{0}=1.\\ \end{array} \right. $$
We have a 0(t)=0,a 1(t)=1,B(t)=1,b 0(t)=0,b 1(t)=1,R(t)=1,L(t)=1,and Ψ(T)=1. So, we get M 1= exp(−0.1) and M 2(t)=1. By Theorem 3.1, the function Q(t) satisfies
$$ \left\{ \begin{array}{l} \frac{dQ(t)}{dt}=-\Big(1+\exp(-0.1)\Big)^{2}P(t)Q(t)+Q(t)\\ Q(2)=0. \end{array} \right. $$
Thus, Q(t)=0 for t[0,2], and then K(t)=0 for t[0,2]. So, we get that the optimal control \(u^{*}_{t}\) is
$$u^{*}_{t}=-\Big(1+\exp (-0.1)\Big)P(t)x, $$
and the optimal value is \(J(0,X_{0})=\frac {1}{2}P(0){X_{0}^{2}}\), and P(t) satisfies
$$ \left\{ \begin{array}{l} \frac{dP(t)}{dt}=-(1+\exp(-0.1))^{2}P(t)^{2}+2P(t)+2\\ P(2)=2. \end{array} \right. $$
Now, we consider the numerical solution of this model. Let S=t 0,t 1,t 200 be an average partition of [0,2](i.e., 0=t 0<t 1<<t 200=2), and Δ t=0.01. Thus,
$$\Delta X_{t}=\left(X_{t}+u^{*}_{t-0.1}+u^{*}_{t}\right)\Delta t+\Delta C_{t}. $$
Since Δ C t is a normal uncertain variable with expected value 0 and variance Δ t 2, the distribution function is \(\Phi (x)=\left (1+\exp \left (-\frac {\pi x}{\sqrt {3}\Delta t}\right)\right)^{-1}\), xR. So, we maybe can get a sample point \(\tilde {c_{t}}\) of Δ C t from \(\tilde {c_{t}}=\Phi ^{-1}(\text {rand}(0,1))\) that \(\tilde {c_{t}}=\frac {\sqrt {3}\Delta t}{-\pi }\ln \left (\frac {1}{\text {rand}(0,1)}-1\right)\). Thus, x t and u t may be given by the following iterative equations:
$$u_{t_{j}}=-(1+\exp(-0.1))P(t_{j})x_{t_{j}}, $$
$$x_{t_{j+1}}=x_{t_{j}}+(x_{t}+u_{t_{j}-0.1}+u_{t_{j}})\Delta t+\frac{\sqrt{3}\Delta t}{-\pi}\ln\left(\frac{1}{\text{rand}(0,1)}-1\right), $$
for j=0,1,2,,200, and \(u_{t_{j}-0.1}=0\), where t j [0,0.1]. The numerical solution P(t j ) of (23) is provided by
$$P(t_{j-1})=P(t_{j})-\left(-(1+\exp(-0.1))^{2}P(t_{j})^{2}+2P(t_{j})+2\right)\Delta t, $$
for j=200,199,,2,1 with P(t 200)=2.
Therefore, the optimal value of the example is J(0,X 0)=1.067544, and the optimal controls and corresponding states are obtained in Table 1 and Figs. 1 and 2.
Fig. 1

Optimal control with time

Fig. 2

Corresponding state with time

Table 1

Numerical solutions


































































































In this paper, an optimal control problem for uncertain linear systems with multiple input delays was investigated. By using uncertain optimality equation and uncertain differential equation, then the optimal control of this problem was obtained. Finally, an example was used to illustrate the result of uncertain optimal control.



This work is supported by the National Natural Science Foundation of China (No. 61273009, No. 61673011).

Authors’ contributions

YJ carried out the study in the paper and drafted the first version of the manuscript. YJ and YZ designed the framework together. HY and YZ revised the first version of the manuscript. All authors read and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License(, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Authors’ Affiliations

School of Science, Nanjing University of Science and Technology
School of Science, Nanjing Forestry University


  1. Basin, M: Optimal control problems for time-delay systems, 380, 131–173. Springer, Berlin (2008).Google Scholar
  2. Eller, D, Aggarwal, JK, Banks, H: Optimal control of linear time-delay systems. IEEE Trans. Autom. Control. 14(6), 678–687 (1970).MathSciNetView ArticleGoogle Scholar
  3. Bauer, H, Rieder, U: Stochastic control problems with delay. Math. Methods Oper. Res. 62(3), 411–427 (2005).MathSciNetView ArticleMATHGoogle Scholar
  4. Larssen, B, Risebro, N: When are HJB-equation for control problems with stochastic delay equation finite dimensional?Stoch. Anal. Appl. 21, 643–671 (2003).MathSciNetView ArticleMATHGoogle Scholar
  5. Yong, J, Zhou, X: Stochastic controls: Hamiltonian systems and HJB equations. Springer, New York (1999).View ArticleMATHGoogle Scholar
  6. Liu, B: Uncertainty theory. 2nd ed. Springer-Verlag, Berlin (2007).View ArticleMATHGoogle Scholar
  7. Liu, B: Fuzzy process, hybrid process and uncertain process. Journal of Uncertain Systems. 2(1), 3–16 (2008).Google Scholar
  8. Liu, B: Some research problems in uncertainty theory. J Uncertain Syst. 3(1), 3–10 (2009).Google Scholar
  9. Ji, X, Zhou, J: Multi-dimensional uncertain differential equation: existence and uniqueness of solution. Fuzzy Optim. Decis. Making. 14(4), 477–491 (2015).MathSciNetView ArticleGoogle Scholar
  10. Zhu, Y: Uncertain optimal control with application to a portfolio selection model. Cybern. Syst. Int. J. 41(7), 535–547 (2010).View ArticleMATHGoogle Scholar
  11. Xu, X, Zhu, Y: Uncertain bang-bang control for continues time model. Cybern. Syst. Int. J. 43(6), 515–527 (2012).MathSciNetView ArticleMATHGoogle Scholar
  12. Chen, R, Zhu, Y: An optimal control model for uncertain systems with time-delay. J. Oper. Res. Soc. Jpn. 4(2013), 243–256.


© The Author(s) 2016