Faizan Rasheed
Research Subjects
Faizan Rasheed has a total of 8 co-authors. Here are the top co-authors by number of shared publications:
- Celimuge Wu
University of Electro-Communications, Tokyo, Japan
1 shared publication - Daniel Polani
Adaptive Systems Research Group University of Hertfordshire
1 shared publication Kok-Lim Alvin Yau
1 shared publication- Kok-Lim Alvin Yau
Lee Kong Chian Faculty of Engineering and Science, Universiti Tunku Abdul Rahman, Kajang, Malaysia
1 shared publication - Nicola Catenacci Volpi
Adaptive Systems Research Group University of Hertfordshire
1 shared publication - Rafidah Md Noor
Universiti Malaya
1 shared publication
Latest Publications
- Open Access
- 9 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 28-36
Leveraging Empowerment to Model Tool Use in Reinforcement Learning
Intrinsic motivation plays a key role in learning how to use tools, a fundamental aspect of human cultural evolution and child development that remains largely unexplored within the context of Reinforcement Learning (RL). This paper introduces “object empowerment” as a novel concept within this realm, showing its role as information-theoretic intrinsic motivation that underpins tool discovery and usage. Using empowerment, we propose a new general framework to model the utilization of tools within RL. We explore how maximizing empowerment can expedite the RL of tasks involving tools, highlighting its capacity to solve the challenge posed by sparse reward signals. By employing object empowerment as an intrinsically motivated regulariser, we guide the RL agent in simple grid-worlds towards states beneficial for learning how to master tools for efficient task completion. We will show how object empowerment can be used to measure and compare the effectiveness of different tools in handling an object. Our findings indicate efficient strategies to learn tool use and insights into the integration and modeling of tool control in the context of RL.
- 9 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 28-36
Open AccessLeveraging Empowerment to Model Tool Use in Reinforcement Learning
Intrinsic motivation plays a key role in learning how to use tools, a fundamental aspect of human cultural evolution and child development that remains largely unexplored within the context of Reinforcement Learning (RL). This paper introduces “object empowerment” as a novel concept within this realm, showing its role as information-theoretic intrinsic motivation that underpins tool discovery and usage. Using empowerment, we propose a new general framework to model the utilization of tools within RL. We explore how maximizing empowerment can expedite the RL of tasks involving tools, highlighting its capacity to solve the challenge posed by sparse reward signals. By employing object empowerment as an intrinsically motivated regulariser, we guide the RL agent in simple grid-worlds towards states beneficial for learning how to master tools for efficient task completion. We will show how object empowerment can be used to measure and compare the effectiveness of different tools in handling an object. Our findings indicate efficient strategies to learn tool use and insights into the integration and modeling of tool control in the context of RL.
- Top Cited PapersOpen Access
- 27 October 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 208016-208044
Deep Reinforcement Learning for Traffic Signal Control: A Review
Traffic congestion is a complex, vexing, and growing issue day by day in most urban areas worldwide. The integration of the newly emerging deep learning approach and the traditional reinforcement learning approach has created an advanced approach called deep reinforcement learning (DRL) that has shown promising results in solving high-dimensional and complex problems, including traffic congestion. This article presents a review of the attributes of traffic signal control (TSC), as well as DRL architectures and methods applied to TSC, which helps to understand how DRL has been applied to address traffic congestion and achieve performance enhancement. The review also covers simulation platforms, a complexity analysis, as well as guidelines and design considerations for the application of DRL to TSC. Finally, this article presents open issues and new research areas with the objective to spark new interest in this research field. To the best of our knowledge, this is the first review article that focuses on the application of DRL to TSC.
- 27 October 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 208016-208044
Top Cited PapersOpen AccessDeep Reinforcement Learning for Traffic Signal Control: A Review
Traffic congestion is a complex, vexing, and growing issue day by day in most urban areas worldwide. The integration of the newly emerging deep learning approach and the traditional reinforcement learning approach has created an advanced approach called deep reinforcement learning (DRL) that has shown promising results in solving high-dimensional and complex problems, including traffic congestion. This article presents a review of the attributes of traffic signal control (TSC), as well as DRL architectures and methods applied to TSC, which helps to understand how DRL has been applied to address traffic congestion and achieve performance enhancement. The review also covers simulation platforms, a complexity analysis, as well as guidelines and design considerations for the application of DRL to TSC. Finally, this article presents open issues and new research areas with the objective to spark new interest in this research field. To the best of our knowledge, this is the first review article that focuses on the application of DRL to TSC.
- 1 August 2020
- Published by Elsevier in Future Generation Computer Systems
- Vol. 109, 431-445
Deep reinforcement learning for traffic signal control under disturbances: A case study on Sunway city, Malaysia
- 1 August 2020
- Published by Elsevier in Future Generation Computer Systems
- Vol. 109, 431-445
Deep reinforcement learning for traffic signal control under disturbances: A case study on Sunway city, Malaysia