The emergence of the massive Internet of Things (IoT) ecosystem is changing human lifestyles. The Internet of Things still relies on human assistance and has unacceptable response times for analyzing big data, and still faces significant challenges. Therefore, it is very necessary to create a new framework and algorithm to solve the specific problems of fast Internet of Things. Reinforcement learning and deep reinforcement learning (DRL) approaches have the ability to make decisions, but traditional modeling and training methods are time-consuming and limit their applications. To overcome this problem, this article proposes a reinforcement learning method suitable for the Internet of Things. In this way, we propose a feature selection method based on ant colony optimization (ACO). Since the heuristic functions affect the decision-making process of ACO during the search process, the use of heuristic learning method can help the algorithm to search the search space better. Finally, as a case study of IoT, the proposed method is applied to traffic light control, with the aim of reducing traffic congestion in smart city intersections. Experimental results show that the proposed method can learn better actions in a shorter execution time compared to traditional approaches.
Hassan Nataj Solhdar M. Improving search for deep reinforcement learning with ant colony optimization. C4I Journal 2023; 7 (2) :1-11 URL: http://ic4i-journal.ir/article-1-395-en.html