# br In this paper we introduce stochastic

In this paper, we introduce stochastic noises into the model of continuous androgen deprivation therapy to study how white noises and the different competitive intensities of Staurosporine affect the dynamics of tumor and treatment strategy. In Section 2, the mathematical model is formulated. The mathematical results for the global convergence of the model without noise perturbation is stated in Section 3. Section 4 focuses on deriving the threshold conditions between the extinction and the persistence of AD cells and AI cells, which reveal how stochastic noise and the competitive coe cients influence the relapse of tumor. The su cient conditions for the existence of stationary distribution are also derived. In Section 5, numer-ical simulations are carried out to compare the treatment results under different values of e cacy of hormone therapy and investigate the influences of stochastic noises on the development of tumor cells and treatment strategy. Section 6 presents the discussions of this paper.

2. The model system

The model is formulated on the basis of the model in [37]. Let X1 and X2 be the concentrations of androgen-dependent cells and androgen-independent cells respectively, and let A be the concentration of androgen in the blood. To separate the influence of stochastic noise from immune response, we don’t include the state variables of immune cells and cytokines related to immunotherapy in [37]. Inspired by Tanaka et al. [42], we incorporate the stochastic perturbations into the model of [37]. Furthermore, we introduce the different competition intensities between AD cells and AI cells into the model because of the biological data from [16,48]. Let us focus our attention on the treatment of continuous androgen suppression (CAS). Then our model is described by

K

A

where a0 is the normal androgen concentration, γ is the androgen clearance and production rate, and u is the e cacy of CAS therapy. Unlike IAS therapy, we assume that u is a positive constant, which becomes reasonable if drugs are more frequently administrated or through an intravenous injection [19,20,37]. In addition, we assume 0 < u < 1 because in practice, the LHRH agonist (drug) could reduce testosterone (resp. DHT) by 60% (resp. 95%) [10,21]. Note that the e cacy u of CAS therapy can be adjusted by the dosage.

All the parameters in system (2.1) are positive. The biological meanings of parameters in the last two equations of (2.1) are interpreted as follows. First, r1 and d1 denote the growth rate and death rate of AD cells respectively, r2 is the

net growth rate of AI cells, α and β are the positive competition coe cients between two types of tumor cells, and K is the carrying capacity of these cells. Second, it is assumed that the mutation rate of AD cells (resp. death of AD cells) is androgen-dependent and increases to its maximum m1u (resp. d1u) when the androgen reaches its minimum A∗ = a0 (1 − u), where m1 is the irreversible mutation rate from AD cells to AI cells. Finally, Bi(t), i = 1, 2 are independent Brownian motions; σ 1 and σ 2 denote the intensities of the white noises, respectively.

We point out the major differences between model (2.1) and the model of Rutter and Kuang [37]. Model (2.1) includes the stochastic perturbations in tumor dynamics and allow for distinct competitive coe cients between sensitive tumor cells and resistant tumor cells, whereas immunotherapy is combined with continuous androgen suppression in Rutter and Kuang

[37] to determine whether tumor elimination is possible under a combination of these two treatments. If the mutation rate from AI cells to AD cells in [37] is ignored α = β = 1, and σ1 = σ2 = 0, then Rutter and Kuang’s model [37] without immunotherapy is reduced to system (2.1).

Note that the evolution of androgen dynamics is very fast compared to that of cancer cells and thus reaches the equi-librium point in a much shorter time than that of cancer cells. Thus, we let androgen go to the steady state A∗ = a0 (1 − u) and then system (2.1) is reduced to

K

K

In what follows, we focus the mathematical analysis and numerical simulations on the system (2.2). We will begin with the analysis for the system (2.2) without stochastic perturbation, which presents the complete classifications for global convergence of the model. Then we turn to the full model (2.2) to derive the threshold conditions for the persistence and extinction of tumor cells.

3. Analysis of deterministic model

As a preliminary analysis, in this section we consider model (2.2) in the absence of stochastic noise. Let σ1 = σ2 = 0 in
(2.2) to reduce the model to the following deterministic system:

dt