David Simões
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
David Simões has a total of 15 co-authors. Here are the top co-authors by number of shared publications:
- Nuno Lau
University of Aveiro
10 shared publications - Luís Paulo Reis
Faculty of Engineering, University of Porto, 4200-465 Porto, Portugal
9 shared publications - Artur Pereira
University of Aveiro
2 shared publications Tiago Silva
LIACC -Artificial Intelligence and Computer Science Lab University of Porto Portugal
2 shared publications- A. Rodrigues
Instituto de Telecomunicações, Universidade de Aveiro,Aveiro,Portugal
1 shared publication - Abbas Abdolmaleki
University of Aveiro
1 shared publication
Latest Publications
- Open Access
FC Portugal 3D Simulation Team: Team Description Paper 2020
The FC Portugal 3D team is developed upon the structure of our previous Simulation league 2D/3D teams and our standard platform league team. Our research concerning the robot low-level skills is focused on developing behaviors that may be applied on real robots with minimal adaptation using model-based approaches. Our research on high-level soccer coordination methodologies and team playing is mainly focused on the adaptation of previously developed methodologies from our 2D soccer teams to the 3D humanoid environment and on creating new coordination methodologies based on the previously developed ones. The research-oriented development of our team has been pushing it to be one of the most competitive over the years (World champion in 2000 and Coach Champion in 2002, European champion in 2000 and 2001, Coach 2nd place in 2003 and 2004, European champion in Rescue Simulation and Simulation 3D in 2006, World Champion in Simulation 3D in Bremen 2006 and European champion in 2007, 2012, 2013, 2014 and 2015). This paper describes some of the main innovations of our 3D simulation league team during the last years. A new generic framework for reinforcement learning tasks has also been developed. The current research is focused on improving the above-mentioned framework by developing new learning algorithms to optimize low-level skills, such as running and sprinting. We are also trying to increase student contact by providing reinforcement learning assignments to be completed using our new framework, which exposes a simple interface without sharing low-level implementation details.
Open AccessFC Portugal 3D Simulation Team: Team Description Paper 2020
The FC Portugal 3D team is developed upon the structure of our previous Simulation league 2D/3D teams and our standard platform league team. Our research concerning the robot low-level skills is focused on developing behaviors that may be applied on real robots with minimal adaptation using model-based approaches. Our research on high-level soccer coordination methodologies and team playing is mainly focused on the adaptation of previously developed methodologies from our 2D soccer teams to the 3D humanoid environment and on creating new coordination methodologies based on the previously developed ones. The research-oriented development of our team has been pushing it to be one of the most competitive over the years (World champion in 2000 and Coach Champion in 2002, European champion in 2000 and 2001, Coach 2nd place in 2003 and 2004, European champion in Rescue Simulation and Simulation 3D in 2006, World Champion in Simulation 3D in Bremen 2006 and European champion in 2007, 2012, 2013, 2014 and 2015). This paper describes some of the main innovations of our 3D simulation league team during the last years. A new generic framework for reinforcement learning tasks has also been developed. The current research is focused on improving the above-mentioned framework by developing new learning algorithms to optimize low-level skills, such as running and sprinting. We are also trying to increase student contact by providing reinforcement learning assignments to be completed using our new framework, which exposes a simple interface without sharing low-level implementation details.
- Open Access
- 23 May 2020
- Published by Walter de Gruyter GmbH in Journal of Artificial Intelligence and Soft Computing Research
- Vol. 10 (3) , 189-207
Multi Agent Deep Learning with Cooperative Communication
We consider the problem of multi agents cooperating in a partially-observable environment. Agents must learn to coordinate and share relevant information to solve the tasks successfully. This article describes Asynchronous Advantage Actor-Critic with Communication (A3C2), an end-to-end differentiable approach where agents learn policies and communication protocols simultaneously. A3C2 uses a centralized learning, distributed execution paradigm, supports independent agents, dynamic team sizes, partially-observable environments, and noisy communications. We compare and show that A3C2 outperforms other state-of-the-art proposals in multiple environments.
- 23 May 2020
- Published by Walter de Gruyter GmbH in Journal of Artificial Intelligence and Soft Computing Research
- Vol. 10 (3) , 189-207
Open AccessMulti Agent Deep Learning with Cooperative Communication
We consider the problem of multi agents cooperating in a partially-observable environment. Agents must learn to coordinate and share relevant information to solve the tasks successfully. This article describes Asynchronous Advantage Actor-Critic with Communication (A3C2), an end-to-end differentiable approach where agents learn policies and communication protocols simultaneously. A3C2 uses a centralized learning, distributed execution paradigm, supports independent agents, dynamic team sizes, partially-observable environments, and noisy communications. We compare and show that A3C2 outperforms other state-of-the-art proposals in multiple environments.
- 1 May 2020
- Published by Elsevier in Neurocomputing
- Vol. 390, 40-56
Multi-agent actor centralized-critic with communication
- 1 May 2020
- Published by Elsevier in Neurocomputing
- Vol. 390, 40-56
Multi-agent actor centralized-critic with communication
- 1 March 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Forest Fire Monitoring Through a Network of Aerial Drones and Sensors
With the technological advances in recent years, elements such as aerial drones and its sensors are becoming increasingly accessible, smaller, transportable and also more stable in flight. Aerial drone fleets are ideally suited to monitor an active forest fire and to support firefighting teams on duty. In this paper we propose a system to support fire monitoring, built using a Flying Ad-hoc Network (FANET) and Unmanned Aerial Vehicles (UAVs), commonly called aerial drones, focused on collecting data from firefighters on duty, in wildfires' context. This system provides the sensing of a fire perimeter, and monitors and follows the firefighters while they are on duty. This system is validated both through simulation and through real-life experiments performed with a FANET of three UAVs. The results obtained in these experiments show that the proposed algorithms have good performance, and that the corresponding system is able to support the firefighting mission in an autonomous approach.
- 1 March 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Forest Fire Monitoring Through a Network of Aerial Drones and Sensors
With the technological advances in recent years, elements such as aerial drones and its sensors are becoming increasingly accessible, smaller, transportable and also more stable in flight. Aerial drone fleets are ideally suited to monitor an active forest fire and to support firefighting teams on duty. In this paper we propose a system to support fire monitoring, built using a Flying Ad-hoc Network (FANET) and Unmanned Aerial Vehicles (UAVs), commonly called aerial drones, focused on collecting data from firefighters on duty, in wildfires' context. This system provides the sensing of a fire perimeter, and monitors and follows the firefighters while they are on duty. This system is validated both through simulation and through real-life experiments performed with a FANET of three UAVs. The results obtained in these experiments show that the proposed algorithms have good performance, and that the corresponding system is able to support the firefighting mission in an autonomous approach.
- 20 November 2019
- Published by Springer Nature
- p. 537-548
Learning Low-Level Behaviors and High-Level Strategies in Humanoid Soccer
- 20 November 2019
- Published by Springer Nature
- p. 537-548
Learning Low-Level Behaviors and High-Level Strategies in Humanoid Soccer
- 30 March 2019
- Published by Springer Nature
- p. 3-12
Multi-agent Neural Reinforcement-Learning System with Communication
- 30 March 2019
- Published by Springer Nature
- p. 3-12
Multi-agent Neural Reinforcement-Learning System with Communication
- 8 January 2019
- Published by Springer Nature in Journal of Intelligent & Robotic Systems
- Vol. 96 (2) , 141-157
Contextual Direct Policy Search
- 8 January 2019
- Published by Springer Nature in Journal of Intelligent & Robotic Systems
- Vol. 96 (2) , 141-157
Contextual Direct Policy Search
- 21 December 2017
- Published by Springer Nature
- p. 743-755
A Hybrid ZMP-CPG Based Walk Engine for Biped Robots
- 21 December 2017
- Published by Springer Nature
- p. 743-755
A Hybrid ZMP-CPG Based Walk Engine for Biped Robots