Peter Farkas
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Peter Farkas has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
- Szilárd Aradi
Department of Control for Transportation and Vehicle Systems, Faculty of Transportation Engineering and Vehicle Engineering, Budapest University of Technology and Economics, Budapest, Hungary
4 shared publications - Tamás Bécsi
Department of Control for Transportation and Vehicle Systems, Faculty of Transportation Engineering and Vehicle Engineering, Budapest University of Technology and Economics, Budapest, Hungary
3 shared publications - Bence Török
Hun-Ren Sztaki, Kende utca 13-17, H-1111 Budapest, Hungary
1 shared publication Laszlo Szoke
Department of Control for Transportation and Vehicle Systems, Budapest University of Technology and Economics, Budapest, Hungary
1 shared publication- Laszlo Szoke
Budapest University of Technology and Economics
1 shared publication
Latest Publications
- Open Access
- 26 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Open Journal of the Computer Society
- Vol. 7, 37-48
Residual Reinforcement Learning Enhanced With Unsuccessful Episode Buffer
Reinforcement learning (RL) agents have proven to be highly effective in many control domains; however, despite their generally promising performance, they may still encounter difficulties in certain challenging scenarios. To address this limitation, we propose a two-stage learning framework, where an initial pre-trained policy is extended with a second set of networks, aiming to correct the base agent's knowledge and preserve its behavior. Both modules are trained with the conventional RL loop, while the second learning system is also faced with an increased number of training samples from those problematic scenarios to provide more exploration possibilities across them. We evaluated the effectiveness of the proposed framework on various environments from the robotic and vehicle control domains. The results showed that the final agent demonstrates improved performance and can successfully complete a broader range of scenarios compared to the baseline agents, while also maintaining the control quality.
- 26 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Open Journal of the Computer Society
- Vol. 7, 37-48
Open AccessResidual Reinforcement Learning Enhanced With Unsuccessful Episode Buffer
Reinforcement learning (RL) agents have proven to be highly effective in many control domains; however, despite their generally promising performance, they may still encounter difficulties in certain challenging scenarios. To address this limitation, we propose a two-stage learning framework, where an initial pre-trained policy is extended with a second set of networks, aiming to correct the base agent's knowledge and preserve its behavior. Both modules are trained with the conventional RL loop, while the second learning system is also faced with an increased number of training samples from those problematic scenarios to provide more exploration possibilities across them. We evaluated the effectiveness of the proposed framework on various environments from the robotic and vehicle control domains. The results showed that the final agent demonstrates improved performance and can successfully complete a broader range of scenarios compared to the baseline agents, while also maintaining the control quality.
- Open Access
- 28 October 2025
- Published by MDPI AG in Engineering Proceedings
- Vol. 113 (1) , 10
Integrating a Stereo Vision System on the F1Tenth Platform for Enhanced Perception
During the development of vehicle control algorithms, effective real-world validation is crucial. Model vehicle platforms provide a cost-effective and accessible method for such testing. The open-source F1Tenth project is a popular choice, but its reliance on lidar sensors limits certain applications. To enable more universal environmental perception, integrating a stereo camera system could be advantageous, although existing software packages do not yet support this functionality. Therefore, our research focuses on developing a modular software architecture for the F1Tenth platform, incorporating real-time stereo vision-based environment perception, robust state representation, and clear actuator interfaces. The system simplifies the integration and testing of control algorithms, while minimizing the simulation-to-reality gap. The framework’s operation is demonstrated through a real-world control problem. Environmental sensing, representation, and the control method combine classical and deep learning techniques to ensure real-time performance and robust operation. Our platform facilitates real-world testing and is suitable for validating research projects.
- 28 October 2025
- Published by MDPI AG in Engineering Proceedings
- Vol. 113 (1) , 10
Open AccessIntegrating a Stereo Vision System on the F1Tenth Platform for Enhanced Perception
During the development of vehicle control algorithms, effective real-world validation is crucial. Model vehicle platforms provide a cost-effective and accessible method for such testing. The open-source F1Tenth project is a popular choice, but its reliance on lidar sensors limits certain applications. To enable more universal environmental perception, integrating a stereo camera system could be advantageous, although existing software packages do not yet support this functionality. Therefore, our research focuses on developing a modular software architecture for the F1Tenth platform, incorporating real-time stereo vision-based environment perception, robust state representation, and clear actuator interfaces. The system simplifies the integration and testing of control algorithms, while minimizing the simulation-to-reality gap. The framework’s operation is demonstrated through a real-world control problem. Environmental sensing, representation, and the control method combine classical and deep learning techniques to ensure real-time performance and robust operation. Our platform facilitates real-world testing and is suitable for validating research projects.
- 28 April 2025
- Published by Springer Nature
- p. 78-89
Adapting RL Control Policies to Changing Dynamics for Improved Robustness
- 28 April 2025
- Published by Springer Nature
- p. 78-89
Adapting RL Control Policies to Changing Dynamics for Improved Robustness
- Open Access
- 2 April 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Emerging Topics in Computational Intelligence
- Vol. 9 (6) , 4026-4036
Learn to Adapt: A Policy for History-Based Online Adaptation
Although today's reinforcement learning-based control agents operate effectively in ideal situations, their performance can significantly decrease under changing conditions. This paper addresses this limitation by proposing an experience-based online adaptation framework. It is designed to enable agents to adjust their policies to differing domains and scenarios by leveraging the information embedded in past state-action transitions. The method extracts these extra features via a history-based adaptor module and introduces them as supplementary input for the agents. It also contains a state encoder network, improving the representation capabilities and supporting the adaptation process. Furthermore, the introduced modules can replace hard-to-obtain information during deployment (e.g., sensor or domain-specific data), which facilitates real-world applications. To emphasize the contribution of our work, we evaluate the solution within highly dynamic environments where the changing physical parameters necessitate diverse control strategies. Our approach significantly improves conventional algorithms and results in comparable performance with agents receiving privileged information.
- 2 April 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Emerging Topics in Computational Intelligence
- Vol. 9 (6) , 4026-4036
Open AccessLearn to Adapt: A Policy for History-Based Online Adaptation
Although today's reinforcement learning-based control agents operate effectively in ideal situations, their performance can significantly decrease under changing conditions. This paper addresses this limitation by proposing an experience-based online adaptation framework. It is designed to enable agents to adjust their policies to differing domains and scenarios by leveraging the information embedded in past state-action transitions. The method extracts these extra features via a history-based adaptor module and introduces them as supplementary input for the agents. It also contains a state encoder network, improving the representation capabilities and supporting the adaptation process. Furthermore, the introduced modules can replace hard-to-obtain information during deployment (e.g., sensor or domain-specific data), which facilitates real-world applications. To emphasize the contribution of our work, we evaluate the solution within highly dynamic environments where the changing physical parameters necessitate diverse control strategies. Our approach significantly improves conventional algorithms and results in comparable performance with agents receiving privileged information.