Control the population of free viruses in nonlinear uncertain HIV system using Q-learning
- PDF / 1,373,352 Bytes
- 11 Pages / 595.276 x 790.866 pts Page_size
- 28 Downloads / 162 Views
ORIGINAL ARTICLE
Control the population of free viruses in nonlinear uncertain HIV system using Q-learning Hossein Gholizade‑Narm1 · Amin Noori1,2
Received: 3 February 2015 / Accepted: 18 January 2017 © Springer-Verlag Berlin Heidelberg 2017
Abstract This paper surveys a new method to reduce the infected cells and free virus particles (virions) via a nonlinear HIV model. Three scenarios are considered for control performance evaluation. At first, the system and initial conditions are considered known completely. In the second case, the initial conditions are taken randomly. In the third scenario, in addition to uncertainty in initial condition, an additive noise is taken into account. The optimal control method is used to design an effective drug-schedule to reduce the number of infected cells and free virions with and without uncertainty. By using the Q-learning algorithm, which is the most applicable algorithm in reinforcement learning, the drug delivery rate is obtained off-line. Since Q-learning is a model-free algorithm, it is expected that the performance of the control in the presence of uncertainty does not change significantly. Simulation results confirm that the proposed control method has a good performance and high functionality in controlling the free virions for both certain and uncertain HIV models. Keywords Uncertain system dynamics · Drug therapy · Human immunodeficiency virus · Q-learning algorithm · Reinforcement learning
* Hossein Gholizade‑Narm [email protected] Amin Noori [email protected] 1
Department of Control Engineering, Shahrood University of Technology, Shahrood, Iran
2
Sadjad University of Technology, Mashhad, Iran
1 Introduction Acquired immune deficiency syndrome (AIDS) is caused by human immunodeficiency virus (HIV) [1]. It is a retrovirus which is able to make deoxyribonucleic acid (DNA) by its own core called ribonucleic acid (RNA). HIV protein coat sticks to the protein in the plasma membrane of a T-lymphocyte (CD4 T-helper cell). There are two kinds of T-lymphocyte: CD4 T-helper cell and T-killer cell. Precursor cytotoxic T lymphocytes (CTL) cells can be differentiated into T-killer cell (effector CTL) and CD4 T-helper cells. Consequently, the enzyme of virus makes the cell to produce DNA from the viral RNA. This DNA enters the nucleus of T-lymphocyte (CD4 T-helper cell) and integrated into the chromosome of the host cell. Moreover, the most important role of T-killer cell is the destroying infected CD4 cells which cause new viruses be born. The Genes representing the HIV virus are permanently in the nucleus and can be dormant for many years; however, they may be activated by an infection. Viral protein and viral RNA are made as a result of an infection. Therefore, the immune system becomes such weak that many diseases can successfully invade the weakened body [2, 3]. Around 30 years ago, HIV has begun to be an epidemic disease [4] and tremendous effort has been dedicated to the treatment of HIV [5]. Treatment of patients infected by the HIV has raised
Data Loading...
