# Uncertain differential games with application to capitalism

- Xiangfeng Yang
^{1}and - Jinwu Gao
^{1}Email author

**1**:17

https://doi.org/10.1186/2195-5468-1-17

© Yang and Gao; licensee Springer. 2013

**Received: **24 October 2013

**Accepted: **28 November 2013

**Published: **23 December 2013

## Abstract

### Abstract

Uncertainty theory provides us an alternative for modeling human uncertainty without the scope of probability theory. In a dynamic game, the system dynamics often has noise by human disturbance and can be described by an uncertain differential equation. In order to investigate such a problem, an uncertain differential game model and its solution concept of feedback Nash equilibrium is proposed in this paper. Moreover, a sufficient condition is established to guarantee a feedback Nash equilibrium of the game. As an application, the capitalism problem is analyzed by uncertain differential game. The results show that uncertain differential game is a powerful tool for dealing with dynamic game.

## Keywords

## Introduction

As a collection of mathematical models of conflict and cooperation between rational decision makers, game theory [1] has been proven useful in many fields such as economics, management science, and sociology. According to the moves of players made simultaneously or over a number of time periods, games fall into two categories: static game and dynamic game. Extensive game [1, 2], which gives an explicit description of the sequential structure of game actions, is essentially a discrete dynamic game. When the system state is continuous over time and the system dynamics can be described by a differential equation, dynamic game has evolved into the differential game.

The origin of differential game could be traced to the pioneering work of Rufus Isaacs, who modeled missile versus enemy aircraft pursuit schemes in terms of state and control variables. His famous book *Differential Games*
[3] marked the birth of the differential game. Soon afterwards, much further work springed up in the field of differential game. In 1964, Berkovitz [4] proposed a variational approach to differential game. In 1966, Pontryagin [5] solved the differential game in open-loop solution in terms of the maximum principle. In 1967, Leitmann and Mon [6] investigated some geometric aspects of differential game. In 1971, Friedman [7] introduced discrete approximation sequence methods to establish the values of differential game and existence of saddle point. His work laid a solid mathematical foundation for differential game theory.

As an effective means to represent conflict situation, differential game theory is widely applied, particularly in the area of military confrontations. However, in real-word applications, the state evolution is often affected by the interference of noise. The noise may be added to the players’ observations of the system state or to the state equation itself. In order to model the noise, there exist two mathematical systems. One is probability theory (Kolmogorov [8]), and the other is uncertainty theory (Liu [9]). Probability is interpreted as a frequency that requires enough historical data for probabilistic reasoning, while uncertainty is interpreted as personal belief degree that is from domain experts for lack of samples.

When noise is modeled by the Wiener process and system evolution can be described by a stochastic differential equation, the differential game will evolve into stochastic differential game. Thanks to Fleming [10] for his important work in stochastic control, a spectrum of stochastic differential game was proposed for analyzing differential game in stochastic situations. Since then, stochastic differential game has been discussed by many researchers. For instance, Basar [11] considered quadratic stochastic differential game. Clemhout and Wan [12] proposed dynamic common property resources and environment problems. Kaitala [13] gave equilibrium solution in stochastic resource management game under imperfect information. Jørgensen and Yeung [14] investigated a common property fishery problem in stochastic differential game model.

Sometimes, no samples are available to estimate the probability distribution. For such situation, we have no choice but to invite some domain experts to evaluate the belief degree that each event will occur. Perhaps some people would like to regard the belief degree as subjective probability or fuzzy concept, but it is usually inappropriate because both probability theory and fuzzy set theory may lead to counter-intuitive results in this case (see [15]). In order to rationally deal with belief degrees, uncertainty theory was founded in 2007 by Liu [9] and subsequently studied by many researchers. Nowadays, uncertainty theory has become a branch of axiomatic mathematics for modeling human uncertainty.

In 2008, Liu [16] proposed the concept of uncertain process for describing dynamic uncertain systems. Moreover, Liu [17] designed a Lipschitz continuous uncertain process with stationary and independent normal uncertain increments, which is called the canonical Liu process now. Chen and Ralescu [18] defined and discussed the Liu process and uncertain calculus. When the noise of system state evolution can be described by the Liu process, Liu [16] introduced uncertain differential equation. Chen and Liu [19] gave an existence and uniqueness theorem for an uncertain differential equation under linear growth and Lipschitz continuous condition. Yao and Chen [20] proposed a numerical method to solve uncertain differential equation. Besides, Yao [21] studied the integral of solution to uncertain differential equation. As an application of uncertain differential equation, Liu [22] presented a paradox of stochastic finance theory which showed that the real stock price was impossible to follow any Ito’s stochastic differential equation, and suggested a new uncertain finance theory which was described by an uncertain differential equation. Based on uncertainty theory and uncertain differential equation, Zhu [23] introduced uncertain optimal control and gave Zhu’s equation of optimality by means of uncertain differential equation. Due to his pioneering work, this paper aims to initialize a spectrum of uncertain differential game when the system dynamics of game is described by an uncertain differential equation.

The rest of this paper is organized as follows: Firstly, we briefly review some basic results of uncertainty theory in the section ‘Preliminaries.’ Secondly, we use an uncertain differential equation to describe the system dynamics of differential game in the section ‘Uncertain differential games’ and present an uncertain differential game model. Moreover, we define feedback Nash equilibrium strategies as the solution of the uncertain differential game and construct a sufficient condition for a feedback Nash equilibrium. Thirdly, we apply the uncertain differential game to capitalism in the section‘An uncertain differential game of capitalism.’ In the capitalism, the government will tax less than the full amount of the payoff accrued to the firm, which will post a positive rate of investment. By comparison, we show that the uncertain differential game is an efficient means to solve the problem of capitalism.

## Preliminaries

In this section, we will introduce some basic results in uncertainty theory.

**Definition 1.** (Liu [9]) Let ℒ be a *σ*-algebra on a nonempty set *Γ*. A set function ℳ : ℒ → [ 0,1] is called an uncertain measure if it satisfies the following axioms:

**Axiom 1.** *(Normality Axiom)* ℳ {Γ} = 1 *for the universal set* Γ*.*

**Axiom 2.** *(Duality Axiom)* ℳ {Λ} + ℳ {Λ^{
c
}} = 1 *for any event* Λ*.*

**Axiom 3.**

*(Subadditivity Axiom) For every countable sequence of events*Λ

_{1},Λ

_{2}, …,

*we have*

Besides, in order to provide the operational law, Liu [17] defined the product uncertain measure on the product *σ*-algebra ℒ as follows.

**Axiom 4.**

*(Product Axiom) Let*(Γ

_{ k },ℒ

_{ k },ℳ

_{ k })

*be uncertainty spaces for*

*k*= 1,2,….

*The product uncertain measure ℳ is an uncertain measure satisfying*

*where* Λ_{
k
}are arbitrarily chosen events from ℒ_{
k
}for *k* = 1,2,…, *respectively.*

**Definition 2.**(Liu [9]) An uncertain variable is a function from an uncertainty space (

*Γ*,ℒ,ℳ) to the set of real numbers such that for any Borel set B of real numbers, the set

is an event.

*Φ*:ℜ→[ 0,1] of an uncertain variable

*ξ*is defined as

An uncertainty distribution *Φ* (·) is said to be regular if its inverse function *Φ*^{-1} (*α*) exists and is unique for each *α* ∈ (0,1), and *Φ*^{-1} (·) is called the inverse uncertainty distribution of *ξ*.

**Definition 3.**(Liu [17]) The uncertain variables

*ξ*

_{1},

*ξ*

_{2},…,

*ξ*

_{ m }are said to be independent if

for any Borel sets *B*
_{1},*B*
_{2},…,*B*
_{
m
} of real numbers.

**Definition 4.**(Liu [9]) Let

*ξ*be an uncertain variable. Then, the expected value of

*ξ*is defined by

provided that at least one of the two integrals is finite.

*ξ*is a regular uncertain variable with uncertainty distribution

*Φ*(

*x*), then the expected value may be calculated by

Based on the uncertainty space, Liu introduced the concepts of uncertain process, canonical Liu process, uncertain differential equation, etc.

**Definition 5.**(Liu [16]) Let

*T*be an index set and let (

*Γ*,ℒ,ℳ) be an uncertainty space. An uncertain process is a measurable function from

*T*× (

*Γ*,ℒ,ℳ) to the set of real numbers, i.e., for each

*t*∈

*T*and any Borel set

*B*,

is an event.

**Definition 6.**(Liu [16]) An uncertain process

*X*

_{ t }is said to have independent increments if

are independent uncertain variables where *t*
_{0} is the initial time and *t*
_{1},*t*
_{2},…,*t*
_{
k
} are any times with *t*
_{0} < *t*
_{1} < … < *t*
_{
k
}.

**Definition 7.** (Liu [16]) An uncertain process *X*
_{
t
} is said to have stationary increments if, for any given *t* > 0, the increments *X*
_{
s+t
}- *X*
_{
s
} are identically distributed uncertain variables for all *s* > 0.

**Definition 8.**(Liu [17]) An uncertain process

*C*

_{ t }is said to be a canonical Liu process if

- (i)
*C*_{0}= 0 and almost all sample paths are Lipschitz continuous. - (ii)
*C*_{ t }has stationary and independent increments. - (iii)Every increment
*C*_{ s+t }-*C*_{ s }is a normal uncertain variable with expected value 0 and variance*t*^{2}, whose uncertainty distribution is$\Phi \left(x\right)={\left(1+\text{exp}\left(\frac{-\pi x}{\sqrt{3}t}\right)\right)}^{-1},\phantom{\rule{1em}{0ex}}x\in \mathfrak{R.}$

**Definition 9.**(Chen and Ralescu [18]) Let

*C*

_{ t }be a canonical Liu process and let

*Z*

_{ t }be an uncertain process. If there exist two uncertain processes

*μ*

_{ t }and

*σ*

_{ t }such that

*t*≥ 0, then

*Z*

_{ t }is called a Liu process with drift

*μ*

_{ t }and diffusion

*σ*

_{ t }. Furthermore,

*Z*

_{ t }has an uncertain differential

**Theorem 1.**(Liu [17]) (Fundamental Theorem of Uncertain Calculus)

*Let h(t,c) be a continuously differentiable function. Then, Z*

_{ t }=

*h(t,C*

_{ t })

*is a Liu process and has an uncertain differential*

Based on the Liu process, the following concept of uncertain differential equation was introduced by Liu [16].

**Definition 10.**(Liu [16]) Suppose

*C*

_{ t }is a canonical Liu process, and

*f*and

*g*are some given functions. Then,

is called an uncertain differential equation. A solution is a Liu process *X*
_{
t
} that satisfies (1) identically in *t*.

Chen and Liu [19] presented an existence and uniqueness theorem for an uncertain differential equation.

**Definition 11.**(Chen and Liu [19]) The uncertain differential equation

*f*(

*t*,

*x*) and

*g*(

*t*,

*x*) satisfy the linear growth condition

for some constant *L*. Moreover, the solution is sample continuous.

By means of uncertain differential equation, Zhu [23] introduced uncertain optimal control and gave an equation of optimality.

**Definition 12.**(Zhu [23]) Assume that

*R*is the return function and

*W*is the function of terminal reward. If we want to maximize the expected return on [ 0,

*T*] using an optimal control, then we have the following optimal control model:

where *t* ∈ [ 0,*T*] and *x* (*t*) = *x*.

**Theorem 2.**(Zhu [23]) (Zhu’s Equation of Optimality)

*Let J(t,x) be twice differentiable on*[ 0,

*T*] ×

*R, then we have*

*J*

_{ t }(

*t*,

*x*) and

*J*

_{ x }(

*t*,

*x*) are the partial derivatives of

*J*(

*t*,

*x*) with respect to

*t*and

*x*, respectively. Note that the boundary condition is

## Uncertain differential games

Differential game is a class of decision problem under which the evolution of the state is described by a differential equation, the players act throughout a time interval [ *t*
_{0},*T*] and want to maximize the payoff.

*n*-person differential game model, the player

*i*optimize his objective

where *T* > *t*
_{0} ≥0, *x* (*t*) ∈ ℜ^{
m
} denotes the state variable of the game, *u*
_{
i
} ∈ *U*
_{
i
}(*U*
_{
i
}is a compact metric space) is the control variable of player *i*, and the initial state *x*
_{0} is given.

The function *R*
_{
i
}(*t*,*x*,*u*
_{1},*u*
_{2},…,*u*
_{
n
}) is a transient payoff function of player *i* at time *t*, *W*
_{
i
}(·) is a terminal reward function of player *i* at terminal time *T*, and *f* (*t*,*x*,*u*
_{1},*u*
_{2},…,*u*
_{
n
}) is a vector function. All functions mentioned are differentiable.

*n*objective functions

where ${E}_{{t}_{0}}$ denotes the expectation operator performed at time *t*
_{0} and the canonical Liu process *C*
_{
t
} defined on an uncertainty space (*Γ*,ℒ,ℳ) is *Θ*-dimension.

*f*(·) and

*σ*(·). Suppose

have continuous partial derivatives and satisfy the linear growth condition and Lipschitz condition.

*x*(

*t*) at every moment

*t*∈ [

*t*

_{0},

*T*] and constructs his strategy in the game (4)-(5) as an admissible feedback control of the following type:

A feedback Nash equilibrium of the uncertain differential game (4)-(5) can be defined as follows.

**Definition 13.**A set of strategies $\left\{{u}_{1}^{\ast}\right(s,x),{u}_{2}^{\ast}(s,x),\dots ,{u}_{n}^{\ast}(s,x\left)\right\}$ is called a feedback Nash equilibrium for the

*n*-person uncertain differential game (4)-(5), and {

*x*

^{∗}(

*s*),

*t*≤

*s*≤

*T*} is the corresponding state trajectory, if there exist real-valued functions

*V*

^{ i }(

*t*,

*x*) : [

*t*

_{0},

*T*] × ℜ

^{ m }→ ℜ, satisfying the following relations for each

*i*∈

*N*:

*t*,

*T*] :

The feature of the definition of feedback Nash equilibrium is that if an *n*-pair $\left\{{u}_{i}^{\ast}\right(s,x);i\in N\}$ provides a feedback Nash equilibrium to *n*-person uncertain differential game (4)-(5) with duration [*t*
_{0},*T*], its restriction to the time interval [ *t*,*T*] provides a feedback Nash equilibrium to the same differential game (4)-(5) defined on the shorter time interval [ *t*,*T*], with the initial state taken as *x* (*t*), and this being so for all *t* ∈ [ *t*
_{0},*T*]. Feedback Nash equilibrium depends only on the time variable *t* and the current value of the state *x*(*t*), but not on memory (including the initial state *x*
_{0}).

Next, we give sufficient conditions guaranteeing the $\left\{{u}_{i}^{\ast}\right(t,x);i\in N\}$ is a feedback Nash equilibrium for the game (4)-(5).

**Theorem 3.**

*An n-tuple of strategies*$\left\{{u}_{i}^{\ast}\right(t,x);i\in N\}$

*provides a feedback Nash equilibrium to the n-person uncertain differential game (4)-(5) if there exist real-valued functions V*

^{ i }(

*t*,

*x*) : [

*t*

_{0},

*T*] × ℜ

^{ m }→ ℜ,

*i*∈

*N*,

*satisfying the partial differential equations*

*Proof*. This result follows readily from the definition of feedback Nash equilibrium and from Theorem 2, since by fixing all players’ strategies, except the *i* th one’s, at their equilibrium choices, we arrive at an uncertain optimal control problem of the type covered by Theorem 2.

## An uncertain differential game of capitalism

Let us return to one of the classical problems: capitalism, considering an uncertain differential game of capitalism where the capital accumulation process may be subjected to uncertainties such as environmental disasters (the global financial crisis). In brief, the state trajectory is represented by the uncertain differential equation.

Consider an uncertain differential game of capitalism with two players, a government and a representative firm. The government represents the workers, while the firm represents the capitalist.

The economy has a neoclassical production function *y* = *f* (*k*); it satisfies *f*^{′} (*k*) > 0, *f*^{′′} (*k*) < 0, $\underset{k\to 0}{\text{lim}}{f}^{\prime}\left(k\right)=\infty ,\underset{k\to \infty}{\text{lim}}{f}^{\prime}\left(k\right)=0$. The labor force receives an income equal to its marginal product *f* (*k*) - *kf*^{′} (*k*), while the firm derives a rent equivalent to its marginal product *f*^{′} (*k*), where *k* is capital per labor.

where *t* ∈ [ 0,*T*], *K* is the capital, *L* is the labor, *s* is the investment rate controlled by the firm, *X* denotes the total social transfer within the government’s control, and *δ* is the depreciation rate.

where *n* is the expected rate of labor, *σ* is the instantaneous variance, and *C* is a one-dimensional canonical Liu process.

where *x* = *X*/*L* represents the social transfer per labor with the government’s control. This is the state trajectory uncertain different equation, and the initial state *k* (0) is fixed, equal to *k*
_{0}.

*f*(

*k*) +

*k*

*f*

^{′}(

*k*) ≤

*x*≤

*f*

^{′}(

*k*). Then, the government’s objective functional can be written as

where *ρ* is a positive discount rate and *E* denotes the expectation operator performed at time 0.

where *x* is the social transfer (the government may be tax or subsidize the firm) and *s* is the investment controlled by the firm.

To summarize, we have defined an uncertain differential game model of capitalism by (8)-(10).

The control $(\stackrel{\u0304}{x},\stackrel{\u0304}{s})$ in the uncertain differential game of capitalism is a feedback Nash equilibrium in the sense that they are functions of current time *t* and current state *k*.

*x*(·) and Equation 12 with respect to

*s*(·) yield

For the government, let *J*^{
G
}(*t*,*k*) = *e*^{ - ρ t
}
*Ak*^{2}. Hence, ${J}_{t}^{G}(t,k)=-\rho {e}^{-\rho t}A{k}^{2}$ and ${J}_{k}^{G}(t,k)=2\mathit{\text{Ak}}{e}^{-\rho t}$.

*A*which is given by

Similarly for the firm, we let *J*^{
F
}(*t*,*k*) = *e*^{- ρ t
}
*Bk*^{2}. Thus, ${J}_{t}^{F}(t,k)=-\rho {e}^{-\rho t}B{k}^{2}$ and ${J}_{k}^{F}(t,k)=2\mathit{\text{Bk}}{e}^{-\rho t}$.

*B*which is given by

**Proposition 1.**

*The feedback Nash equilibrium for capitalism is given by*

*Proof*. It is easily obtained by the above equation.

**Lemma 1.**

*If the following inequality holds:*

then $\stackrel{\u0304}{s}$ is non-negative.

*Proof*. Because investment rate $\stackrel{\u0304}{s}$ satisfies constraint $0\le \stackrel{\u0304}{s}\le 1$, we can easily obtain this condition.

We say *δ* + *n* is the effective depreciation rate of capital per labor, and the upper and lower bounds of the effective depreciation rate of capital per labor are given from Lemma 1.

In the deterministic game of capitalism, the payoff of the firm is completely taxed away, and the firm stops investing completely, which is a very extreme and unrealistic solution. However, in the uncertain differential game of capitalism, the government will tax less than the full amount of the payoff accrued to the firm, which will post a positive rate of investment.

## Concluding remarks

In this paper, we investigated an uncertain differential game based on the uncertain optimal control. The state dynamics is an uncertain differential equation involving a Liu process. Moreover, we proposed the definition of feedback Nash equilibrium strategies as the solution of the uncertain differential game, and a sufficient condition provided a way to find feedback equilibrium was constructed. Finally, we applied the uncertain differential game to capitalism problem. In the capitalism, the government will tax less than the full amount of the payoff accrued to the firm, which will post a positive rate of investment.

Meanwhile, this work initiated a spectrum of uncertain differential games. Therefore, there are lots of things for further research. At least, one may consider zero-sum uncertain differential games, linear-quadratic uncertain differential games, and uncertain differential games with asymmetric information. Furthermore, one may study the application of uncertain differential games such as common property fishery problem, natural resources extraction, and military confrontation.

## Declarations

### Acknowledgements

This work was supported by the National Natural Science Foundation of China (grant nos. 61074193 and 61374082).

## Authors’ Affiliations

## References

- Von Neumann J, Morgenstern D:
*The Theory of Games in Economic Behavior*. Wiley, New York; 1944.Google Scholar - Kuhn HW:
**Extensive games.***Proc. Natl. Acad. Sci. U.S.A*1950,**36**(10):570–576. 10.1073/pnas.36.10.570Google Scholar - Isaacs R:
*Differential Games*. Wiley, New York; 1965.Google Scholar - Berkovitz LD:
*A Variational Approach to Differential Games*. Princeton University Press, Princeton; 1964.Google Scholar - Pontryagin LS:
**On the theory of differential games.***Uspekhi Mat. Nauk*1966,**21:**219–274.Google Scholar - Leitmann G, Mon G:
**Some geometric aspects of differential games.***J. Astronaut. Sci*1967,**14:**56.MathSciNetGoogle Scholar - Friedman A:
*Differential Games*. Wiley, New York; 1971.Google Scholar - Kolmogorov AN:
*Grundbegriffe der Wahrscheinlichkeitsrechnung*. Springer, Berlin; 1933.Google Scholar - Liu B:
*Uncertainty Theory*. Springer-Verlag, Berlin; 2007.Google Scholar - Fleming WH:
**Optimal continuous-parameter stochastic control.***SIAM Rev*1969,**11:**470–509. 10.1137/1011086MathSciNetGoogle Scholar - Basar T:
**Existence of unique equilibrium solutions in nonzero-sum stochastic differential games.**In*Roxin, EO, Liu, PT, Sternberg, R (eds.) Differential Games Control Theory II*. Marcel Dekker, New York; 1977.Google Scholar - Clemhout S, Wan HY:
**Dynamic common-property resources and environment problems.***J. Optimiz. Theory App*1985,**46:**471–481. 10.1007/BF00939152MathSciNetGoogle Scholar - Kaitala V:
**Equilibria in stochastic resource management game under imperfect information.***Eur. J. Oper. Res*1993,**71:**439–453. 10.1016/0377-2217(93)90351-MGoogle Scholar - Jørgensen S, Yeung DWK:
**Stochastic differential game model of a common property fishery.***J. Optimiz. Theory App*1996,**99:**391–403.Google Scholar - Liu B:
**Why is there a need for uncertainty theory.***J. Uncertain Syst*2012,**6**(1):3–10.Google Scholar - Liu B:
**Fuzzy process, hybrid process and uncertain process.***J. Uncertain Syst*2008,**2**(1):3–16.Google Scholar - Liu B:
**Some research problems in uncertainty theory.***J. Uncertain Syst*2009,**3**(1):3–10.Google Scholar - Chen X, Ralescu DA:
**Liu process and uncertain calculus.***J. Uncertainty Anal. Appl*2013,**1:**3. 10.1186/2195-5468-1-3Google Scholar - Chen X, Liu B:
**Existence and uniqueness theorem for uncertain differential equations.***Fuzzy Optim. Decis. Mak*2010,**9**(1):69–81. 10.1007/s10700-010-9073-2MathSciNetGoogle Scholar - Yao K, Chen X:
**A numerical method for solving uncertain differential equations.***J. Intell. and Fuzzy Syst.*2013,**25**(3):825–832.MathSciNetGoogle Scholar - Yao K:
**Extreme values and integral of solution of uncertain differential equation.***J. Uncertainty Anal. Appl*2013,**1:**2. 10.1186/2195-5468-1-2Google Scholar - Liu B:
**Toward uncertain finance theory.***J. Uncertainty Anal. Appl*2013,**1:**1. 10.1186/2195-5468-1-1Google Scholar - Zhu Y:
**Uncertain optimal control with application to a portfolio selection model.***Cybernet. Syst*2010,**41**(7):535–547. 10.1080/01969722.2010.511552Google Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License(http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.