UPM Institutional Repository

Collision prediction based q-learning for mobile robot navigation in unknown dynamic environments


Citation

Findi, Ahmed H. M. and Marhaban, Mohammad Hamiruce and Raja Ahmad, Raja Mohd Kamil and Hassan, Mohd Khair (2017) Collision prediction based q-learning for mobile robot navigation in unknown dynamic environments. Journal of Computational and Theoretical Nanoscience, 14 (6). 2873 - 2885. ISSN 1546-1955; ESSN: 1546-1963

Abstract

Q-learning (QL) approach is constantly used for mobile robot (MR) navigation in unknown dynamic environment because of its simplicity and well-developed theory. However, its salient downside is the curse of dimensionality problem, where it incurs a huge computational power and memory requirement. This problem is aggravated in complex environments. In this paper, a collision prediction based QL (CPQL) scheme is presented to MR navigation in a dynamic environment based on collision prediction between the robot and a group of static and dynamic obstacles. In the proposed scheme, a novel definition of environment states is presented to apply QL to unknown dynamic environments with compact state space, satisfactory robot turning angles, and adequate speed gradation. The key feature of the proposed CPQL scheme pertains to constructing a state—action pair based on two factors. The first factor is the region of predicting the position of collision between the robot and an obstacle, and the second is the region of the obstacle related to robot position. Simulation analysis and results show the superiority of CPQL in terms of learning convergence, obstacle avoidance, and smooth navigation path compared with state-of-the-art MR navigation schemes. Hence, CPQL proves its authenticity and suitability for real-time navigation in complex and dynamic environments.


Download File

[img]
Preview
Text (Abstract)
Collision prediction based q-learning for mobile robot navigation in unknown dynamic environments.pdf

Download (99kB) | Preview

Additional Metadata

Item Type: Article
Divisions: Faculty of Engineering
DOI Number: https://doi.org/10.1166/jctn.2017.6589
Publisher: American Scientific Publishers
Keywords: Mobile robot navigation; Reinforcement learning; Unknown dynamic environment
Depositing User: Ms. Nida Hidayati Ghazali
Date Deposited: 31 Oct 2018 04:30
Last Modified: 31 Oct 2018 04:30
Altmetrics: http://www.altmetric.com/details.php?domain=psasir.upm.edu.my&doi=10.1166/jctn.2017.6589
URI: http://psasir.upm.edu.my/id/eprint/61142
Statistic Details: View Download Statistic

Actions (login required)

View Item View Item