Nikita Belousov
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Nikita Belousov has a total of 8 co-authors. Here are the top co-authors by number of shared publications:
- Alexey Vasilev
Sber AI Lab, Moscow, Russian Federation and HSE University, Moscow, Russian Federation
1 shared publication - Alexey Zaytsev
Skolkovo Institute of Science and Technology, Moscow, Russia
1 shared publication - Andrey V. Savchenko
Sber AI Lab, Moscow, Russian Federation, HSE University, Moscow, Russian Federation, and ITMO University, Saint Petersburg, Russian Federation
1 shared publication - Anna Volodkevich
SB AI Lab, Moscow, Russian Federation and AI Center, Moscow, Russian Federation
1 shared publication - Artyom Sosedka
Sber AI, Moscow, Russian Federation and National University of Science and Technology MISIS, Moscow, Russian Federation
1 shared publication - Natalia Semenova
Sber AI, Moscow, Russian Federation and Artificial Intelligence Research Institute, Moscow, Russian Federation
1 shared publication
Latest Publications
- Open Access
- 24 August 2024
- Published by Association for Computing Machinery (ACM)
- p. 5701-5712
From Variability to Stability: Advancing RecSys Benchmarking Practices
In the rapidly evolving domain of Recommender Systems (RecSys), new algorithms frequently claim state-of-the-art performance based on evaluations over a limited set of arbitrarily selected datasets. However, this approach may fail to holistically reflect their effectiveness due to the significant impact of dataset characteristics on algorithm performance. Addressing this deficiency, this paper introduces a novel benchmarking methodology to facilitate a fair and robust comparison of RecSys algorithms, thereby advancing evaluation practices. By utilizing a diverse set of 30 open datasets, including two introduced in this work, and evaluating 11 collaborative filtering algorithms across 9 metrics, we critically examine the influence of dataset characteristics on algorithm performance. We further investigate the feasibility of aggregating outcomes from multiple datasets into a unified ranking. Through rigorous experimental analysis, we validate the reliability of our methodology under the variability of datasets, offering a benchmarking strategy that balances quality and computational demands. This methodology enables a fair yet effective means of evaluating RecSys algorithms, providing valuable guidance for future research endeavors.
- 24 August 2024
- Published by Association for Computing Machinery (ACM)
- p. 5701-5712
Open AccessFrom Variability to Stability: Advancing RecSys Benchmarking Practices
In the rapidly evolving domain of Recommender Systems (RecSys), new algorithms frequently claim state-of-the-art performance based on evaluations over a limited set of arbitrarily selected datasets. However, this approach may fail to holistically reflect their effectiveness due to the significant impact of dataset characteristics on algorithm performance. Addressing this deficiency, this paper introduces a novel benchmarking methodology to facilitate a fair and robust comparison of RecSys algorithms, thereby advancing evaluation practices. By utilizing a diverse set of 30 open datasets, including two introduced in this work, and evaluating 11 collaborative filtering algorithms across 9 metrics, we critically examine the influence of dataset characteristics on algorithm performance. We further investigate the feasibility of aggregating outcomes from multiple datasets into a unified ranking. Through rigorous experimental analysis, we validate the reliability of our methodology under the variability of datasets, offering a benchmarking strategy that balances quality and computational demands. This methodology enables a fair yet effective means of evaluating RecSys algorithms, providing valuable guidance for future research endeavors.