Aristotelis Lazaridis
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Aristotelis Lazaridis has a total of 16 co-authors. Here are the top co-authors by number of shared publications:
Ioannis Vlahavas
School of Informatics, Aristotle University of Thessaloniki, Thessaloniki, Greece
3 shared publications- Dimitris Spachos
Aristotle University of Thessaloniki
2 shared publications - Ioannis Vlahavas
Aristotle University of Thessaloniki
2 shared publications - Niki Pandria
Aristotle University of Thessaloniki
2 shared publications - Panagiotis D. Bamidis
School of Medicine, Faculty of Health Sciences, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece
2 shared publications - Vasileia Petronikolou
School of Medicine, Aristotle University of Thessaloniki
2 shared publications
Latest Publications
- Open Access
Lucy-SKG: Learning to Play Rocket League Efficiently Using Deep Reinforcement Learning
A successful tactic that is followed by the scientific community for advancing AI is to treat games as problems, which has been proven to lead to various breakthroughs. We adapt this strategy in order to study Rocket League, a widely popular but rather under-explored 3D multiplayer video game with a distinct physics engine and complex dynamics that pose a significant challenge in developing efficient and high-performance game-playing agents. In this paper, we present Lucy-SKG, a Reinforcement Learning-based model that learned how to play Rocket League in a sample-efficient manner, outperforming by a notable margin the two highest-ranking bots in this game, namely Necto (2022 bot champion) and its successor Nexto, thus becoming a state-of-the-art agent. Our contributions include: a) the development of a reward analysis and visualization library, b) novel parameterizable reward shape functions that capture the utility of complex reward types via our proposed Kinesthetic Reward Combination (KRC) technique, and c) design of auxiliary neural architectures for training on reward prediction and state representation tasks in an on-policy fashion for enhanced efficiency in learning speed and performance. By performing thorough ablation studies for each component of Lucy-SKG, we showed their independent effectiveness in overall performance. In doing so, we demonstrate the prospects and challenges of using sample-efficient Reinforcement Learning techniques for controlling complex dynamical systems under competitive team-based multiplayer conditions.
Open AccessLucy-SKG: Learning to Play Rocket League Efficiently Using Deep Reinforcement Learning
A successful tactic that is followed by the scientific community for advancing AI is to treat games as problems, which has been proven to lead to various breakthroughs. We adapt this strategy in order to study Rocket League, a widely popular but rather under-explored 3D multiplayer video game with a distinct physics engine and complex dynamics that pose a significant challenge in developing efficient and high-performance game-playing agents. In this paper, we present Lucy-SKG, a Reinforcement Learning-based model that learned how to play Rocket League in a sample-efficient manner, outperforming by a notable margin the two highest-ranking bots in this game, namely Necto (2022 bot champion) and its successor Nexto, thus becoming a state-of-the-art agent. Our contributions include: a) the development of a reward analysis and visualization library, b) novel parameterizable reward shape functions that capture the utility of complex reward types via our proposed Kinesthetic Reward Combination (KRC) technique, and c) design of auxiliary neural architectures for training on reward prediction and state representation tasks in an on-policy fashion for enhanced efficiency in learning speed and performance. By performing thorough ablation studies for each component of Lucy-SKG, we showed their independent effectiveness in overall performance. In doing so, we demonstrate the prospects and challenges of using sample-efficient Reinforcement Learning techniques for controlling complex dynamical systems under competitive team-based multiplayer conditions.
- Open Access
- 9 January 2023
- Published by Springer Nature in International Journal of Information Technology
- Vol. 15 (2) , 643-650
GENEREIT: generating multi-talented reinforcement learning agents
Creating an intelligent system that is able to generalize and reach human or above-human performance in a variety of tasks will be part of the crowning achievement of Artificial General Intelligence. However, even though many steps have been taken towards this direction, they have critical shortcomings that prevent the research community from drawing a clear path towards that goal, such as limited learning capacity of a model, sample-inefficiency or low overall performance. In this paper, we propose GENEREIT, a meta-Reinforcement Learning model in which a single Deep Reinforcement Learning agent (meta-learner) is able to produce high-performance agents (inner-learners) for solving different environments under a single training session, in a sample-efficient way, as shown by primary results in a set of various toy-like environments. This is partially due to the fixed subset selection strategy implementation that allows the meta-learner to focus on tuning specific traits of the generated agents rather than tuning them completely. This, combined with our system’s modular design for introducing higher levels in the meta-learning hierarchy, can also be potentially immune to catastrophic forgetting and provide ample learning capacity.
- 9 January 2023
- Published by Springer Nature in International Journal of Information Technology
- Vol. 15 (2) , 643-650
Open AccessGENEREIT: generating multi-talented reinforcement learning agents
Creating an intelligent system that is able to generalize and reach human or above-human performance in a variety of tasks will be part of the crowning achievement of Artificial General Intelligence. However, even though many steps have been taken towards this direction, they have critical shortcomings that prevent the research community from drawing a clear path towards that goal, such as limited learning capacity of a model, sample-inefficiency or low overall performance. In this paper, we propose GENEREIT, a meta-Reinforcement Learning model in which a single Deep Reinforcement Learning agent (meta-learner) is able to produce high-performance agents (inner-learners) for solving different environments under a single training session, in a sample-efficient way, as shown by primary results in a set of various toy-like environments. This is partially due to the fixed subset selection strategy implementation that allows the meta-learner to focus on tuning specific traits of the generated agents rather than tuning them completely. This, combined with our system’s modular design for introducing higher levels in the meta-learning hierarchy, can also be potentially immune to catastrophic forgetting and provide ample learning capacity.
- Open Access
- 28 September 2022
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 11 (9) , e40189
Information System for Symptom Diagnosis and Improvement of Attention Deficit Hyperactivity Disorder: Protocol for a Nonrandomized Controlled Pilot Study
Background: Attention deficit hyperactivity disorder (ADHD) is one of the most common neurodevelopmental disorders during childhood; however, the diagnosis procedure remains challenging, as it is nonstandardized, multiparametric, and highly dependent on subjective evaluation of the perceived behavior. Objective: To address the challenges of existing procedures for ADHD diagnosis, the ADHD360 project aims to develop a platform for (1) early detection of ADHD by assessing the user’s likelihood of having ADHD characteristics and (2) providing complementary training for ADHD management. Methods: A 2-phase nonrandomized controlled pilot study was designed to evaluate the ADHD360 platform, including ADHD and non-ADHD participants aged 7 to 16 years. At the first stage, an initial neuropsychological evaluation along with an interaction with the serious game developed (“Pizza on Time”) for approximately 30-45 minutes is performed. Subsequently, a 2-week behavior monitoring of the participants through the mADHD360 app is planned after a telephone conversation between the participants’ parents and the psychologist, where the existence of any behaviors characteristic of ADHD that affect daily functioning is assessed. Once behavior monitoring is complete, the research team invites the participants to the second stage, where they play the game for a mean duration of 10 weeks (2 times per week). Once the serious game is finished, a second round of behavior monitoring is performed following the same procedures as the initial one. During the study, gameplay data were collected and preprocessed. The protocol of the pilot trials was initially designed for in-person participation, but after the COVID-19 outbreak, it was adjusted for remote participation. State-of-the-art machine learning (ML) algorithms were used to analyze labeled gameplay data aiming to detect discriminative gameplay patterns among the 2 groups (ADHD and non-ADHD) and estimate a player’s likelihood of having ADHD characteristics. A schema including a train-test splitting with a 75:25 split ratio, k-fold cross-validation with k=3, an ML pipeline, and data evaluation were designed. Results: A total of 43 participants were recruited for this study, where 18 were diagnosed with ADHD and the remaining 25 were controls. Initial neuropsychological assessment confirmed that the participants in the ADHD group showed a deviation from the participants without ADHD characteristics. A preliminary analysis of collected data consisting of 30 gameplay sessions showed that the trained ML models achieve high performance (ie, accuracy up to 0.85) in correctly predicting the users’ labels (ADHD or non-ADHD) from their gameplay session on the ADHD360 platform. Conclusions: ADHD360 is characterized by its notable capacity to discriminate player gameplay behavior as either ADHD or non-ADHD. Therefore, the ADHD360 platform could be a valuable complementary tool for early ADHD detection. Trial Registration: ClinicalTrials.gov NCT04362982; https://clinicaltrials.gov/ct2/show/NCT04362982 International Registered Report Identifier (IRRID): RR1-10.2196/40189
- 28 September 2022
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 11 (9) , e40189
Open AccessInformation System for Symptom Diagnosis and Improvement of Attention Deficit Hyperactivity Disorder: Protocol for a Nonrandomized Controlled Pilot Study
Background: Attention deficit hyperactivity disorder (ADHD) is one of the most common neurodevelopmental disorders during childhood; however, the diagnosis procedure remains challenging, as it is nonstandardized, multiparametric, and highly dependent on subjective evaluation of the perceived behavior. Objective: To address the challenges of existing procedures for ADHD diagnosis, the ADHD360 project aims to develop a platform for (1) early detection of ADHD by assessing the user’s likelihood of having ADHD characteristics and (2) providing complementary training for ADHD management. Methods: A 2-phase nonrandomized controlled pilot study was designed to evaluate the ADHD360 platform, including ADHD and non-ADHD participants aged 7 to 16 years. At the first stage, an initial neuropsychological evaluation along with an interaction with the serious game developed (“Pizza on Time”) for approximately 30-45 minutes is performed. Subsequently, a 2-week behavior monitoring of the participants through the mADHD360 app is planned after a telephone conversation between the participants’ parents and the psychologist, where the existence of any behaviors characteristic of ADHD that affect daily functioning is assessed. Once behavior monitoring is complete, the research team invites the participants to the second stage, where they play the game for a mean duration of 10 weeks (2 times per week). Once the serious game is finished, a second round of behavior monitoring is performed following the same procedures as the initial one. During the study, gameplay data were collected and preprocessed. The protocol of the pilot trials was initially designed for in-person participation, but after the COVID-19 outbreak, it was adjusted for remote participation. State-of-the-art machine learning (ML) algorithms were used to analyze labeled gameplay data aiming to detect discriminative gameplay patterns among the 2 groups (ADHD and non-ADHD) and estimate a player’s likelihood of having ADHD characteristics. A schema including a train-test splitting with a 75:25 split ratio, k-fold cross-validation with k=3, an ML pipeline, and data evaluation were designed. Results: A total of 43 participants were recruited for this study, where 18 were diagnosed with ADHD and the remaining 25 were controls. Initial neuropsychological assessment confirmed that the participants in the ADHD group showed a deviation from the participants without ADHD characteristics. A preliminary analysis of collected data consisting of 30 gameplay sessions showed that the trained ML models achieve high performance (ie, accuracy up to 0.85) in correctly predicting the users’ labels (ADHD or non-ADHD) from their gameplay session on the ADHD360 platform. Conclusions: ADHD360 is characterized by its notable capacity to discriminate player gameplay behavior as either ADHD or non-ADHD. Therefore, the ADHD360 platform could be a valuable complementary tool for early ADHD detection. Trial Registration: ClinicalTrials.gov NCT04362982; https://clinicaltrials.gov/ct2/show/NCT04362982 International Registered Report Identifier (IRRID): RR1-10.2196/40189
- Open Access
- 9 June 2022
- Published by JMIR Publications Inc. in JMIR Preprints
An Information System for Symptom Diagnosis and Improvement of Attention Deficit Hyperactivity Disorder: The ADHD360 Project (Preprint)
BACKGROUND Attention Deficit Hyperactivity Disorder (ADHD) is one of the most common neurodevelopmental disorders during childhood, however the diagnosis procedure remains challenging as it is non-standardized, multi-parametric and highly dependent on subjective evaluation of the perceived behavior. OBJECTIVE To address the challenges of existing procedures for ADHD diagnosis, the ADHD360 project aims to develop a platform for (a) early detection of ADHD by assessing the user’s likelihood of having ADHD characteristics and (b) providing complementary training for ADHD management. METHODS A two-phase pilot study was designed to evaluate the ADHD360 platform, including ADHD and non-ADHD participants aged 7-16 years. Machine Learning methods were used to detect discriminative gameplay patterns among the two groups (ADHD, non-ADHD) and estimate a player’s likelihood of having ADHD characteristics. RESULTS A preliminary analysis of collected data showed that the trained models achieve high performance in correctly predicting a user’s label (ADHD or non-ADHD) from his gameplay session in the ADHD360 platform. CONCLUSIONS ADHD360 is characterized by notable capacity to discriminate player gameplay behavior as either ADHD or non-ADHD. Therefore, the ADHD360 platform could be a valuable complementary tool for early ADHD detection. CLINICALTRIAL ClinicalTrials.gov NCT04362982
- 9 June 2022
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessAn Information System for Symptom Diagnosis and Improvement of Attention Deficit Hyperactivity Disorder: The ADHD360 Project (Preprint)
BACKGROUND Attention Deficit Hyperactivity Disorder (ADHD) is one of the most common neurodevelopmental disorders during childhood, however the diagnosis procedure remains challenging as it is non-standardized, multi-parametric and highly dependent on subjective evaluation of the perceived behavior. OBJECTIVE To address the challenges of existing procedures for ADHD diagnosis, the ADHD360 project aims to develop a platform for (a) early detection of ADHD by assessing the user’s likelihood of having ADHD characteristics and (b) providing complementary training for ADHD management. METHODS A two-phase pilot study was designed to evaluate the ADHD360 platform, including ADHD and non-ADHD participants aged 7-16 years. Machine Learning methods were used to detect discriminative gameplay patterns among the two groups (ADHD, non-ADHD) and estimate a player’s likelihood of having ADHD characteristics. RESULTS A preliminary analysis of collected data showed that the trained models achieve high performance in correctly predicting a user’s label (ADHD or non-ADHD) from his gameplay session in the ADHD360 platform. CONCLUSIONS ADHD360 is characterized by notable capacity to discriminate player gameplay behavior as either ADHD or non-ADHD. Therefore, the ADHD360 platform could be a valuable complementary tool for early ADHD detection. CLINICALTRIAL ClinicalTrials.gov NCT04362982
- 6 May 2022
- Published by Elsevier in Neurocomputing
- Vol. 497, 86-93
REIN-2: Giving birth to prepared reinforcement learning agents using reinforcement learning agents
- 6 May 2022
- Published by Elsevier in Neurocomputing
- Vol. 497, 86-93
REIN-2: Giving birth to prepared reinforcement learning agents using reinforcement learning agents