Wajd Meskini
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Wajd Meskini has a total of 2 co-authors. Here are the top co-authors by number of shared publications:
- Alexandre Brouste
Laboratoire Manceau de Mathématiques, Le Mans Université, Le Mans Cedex 9, France
1 shared publication - Nicolas Dugué
LIUM Computer Science Laboratory, University of Le Mans, Le Mans, France
1 shared publication
Latest Publications
- Open Access
- 21 May 2024
- Published by Springer Nature in Neural Processing Letters
- Vol. 56 (3) , 1-13
Speeding up the Training of Neural Networks with the One-Step Procedure
In the last decade, research and corporate have shown a dramatically growing interest in the field of machine learning, mostly due to the performances of deep neural networks. These increasingly complex architectures solved a wide range of problems. However, training these sophisticated architectures require many computation on advanced hardware. With this paper, we introduce a new approach based on the One-Step procedure that may fasten their training. In this procedure, an initial guess estimator is computed on a subsample that is then improved with only one step of the Newton gradient descent on the whole dataset. To show the efficiency of this framework, we consider regression and classification tasks using simulated and real datasets. We consider classic architectures, namely multi-layer perceptrons and show, on our examples, that the One-Step procedure is often halving the computation time to train the neural networks while preserving the performances.
- 21 May 2024
- Published by Springer Nature in Neural Processing Letters
- Vol. 56 (3) , 1-13
Open AccessSpeeding up the Training of Neural Networks with the One-Step Procedure
In the last decade, research and corporate have shown a dramatically growing interest in the field of machine learning, mostly due to the performances of deep neural networks. These increasingly complex architectures solved a wide range of problems. However, training these sophisticated architectures require many computation on advanced hardware. With this paper, we introduce a new approach based on the One-Step procedure that may fasten their training. In this procedure, an initial guess estimator is computed on a subsample that is then improved with only one step of the Newton gradient descent on the whole dataset. To show the efficiency of this framework, we consider regression and classification tasks using simulated and real datasets. We consider classic architectures, namely multi-layer perceptrons and show, on our examples, that the One-Step procedure is often halving the computation time to train the neural networks while preserving the performances.