Fundamental Components and Principles of Supervised Machine Learning Workflows with Numerical and Categorical Data
Open Access
Abstract
This paper offers a comprehensive examination of the process involved in developing and automating supervised end-to-end machine learning workflows for forecasting and classification purposes. It offers a complete overview of the components (i.e., feature engineering and model selection), principles (i.e., bias–variance decomposition, model complexity, overfitting, model sensitivity to feature assumptions and scaling, and output interpretability), models (i.e., neural networks and regression models), methods (i.e., cross-validation and data augmentation), metrics (i.e., Mean Squared Error and F1-score) and tools that rule most supervised learning applications with numerical and categorical data, as well as their integration, automation, and deployment. The end goal and contribution of this paper is the education and guidance of the non-AI expert academic community regarding complete and rigorous machine learning workflows and data science practices, from problem scoping to design and state-of-the-art automation tools, including basic principles and reasoning in the choice of methods. The paper delves into the critical stages of supervised machine learning workflow development, many of which are often omitted by researchers, and covers foundational concepts essential for understanding and optimizing a functional machine learning workflow, thereby offering a holistic view of task-specific application development for applied researchers who are non-AI experts. This paper may be of significant value to academic researchers developing and prototyping machine learning workflows for their own research or as customer-tailored solutions for government and industry partners.Keywords
All Related Versions
This publication has 168 references indexed in Scilit:
- Review of automated time series forecasting pipelinesWIREs Data Mining and Knowledge Discovery, 2022
- A workflow to address pitfalls and challenges in applying machine learning models to hydrologyAdvances in Water Resources, 2021
- Automated machine learning for identification of pest aphid species (Hemiptera: Aphididae)Applied Entomology and Zoology, 2019
- Deep belief networks and cortical algorithms: A comparative study for supervised classificationApplied Computing and Informatics, 2019
- A review of unsupervised feature selection methodsArtificial Intelligence Review, 2019
- Progressive sampling-based Bayesian optimization for efficient and automatic machine learning model selectionHealth Information Science and Systems, 2017
- Genetic programming for feature construction and selection in classification on high-dimensional dataMemetic Computing, 2015
- Group Invariant ScatteringCommunications on Pure and Applied Mathematics, 2012
- Multivariate random forestsWIREs Data Mining and Knowledge Discovery, 2011
- Bagging predictorsMachine Learning, 1996