Advancing Research Reproducibility in Machine Learning through Blockchain Technology
Open Access
- 11 April 2024
- journal article
- research article
- Published by Vilnius University Press in Informatica
- Vol. 35 (2) , 227-253
Abstract
Publisher: Vilnius University Institute of Data Science and Digital Technologies, Journal: Informatica, Title: Advancing Research Reproducibility in Machine Learning through Blockchain Technology, Authors: Ernestas Filatovas, Linas Stripinis, Francisco Orts, Remigijus Paulavičius , Like other disciplines, machine learning is currently facing a reproducibility crisis that hinders the advancement of scientific research. Researchers face difficulties reproducing key results due to the lack of critical details, including the disconnection between publications and associated models, data, parameter settings, and experimental results. To promote transparency and trust in research, solutions that improve the accessibility of models and data, facilitate experiment tracking, and allow audit of experimental results are needed. Blockchain technology, characterized by its decentralization, data immutability, cryptographic hash functions, consensus algorithms, robust security measures, access control mechanisms, and innovative smart contracts, offers a compelling pathway for the development of such solutions. To address the reproducibility challenges in machine learning, we present a novel concept of a blockchain-based platform that operates on a peer-to-peer network. This network comprises organizations and researchers actively engaged in machine learning research, seamlessly integrating various machine learning research and development frameworks. To validate the viability of our proposed concept, we implemented a blockchain network using the Hyperledger Fabric infrastructure and conducted experimental simulations in several scenarios to thoroughly evaluate its effectiveness. By fostering transparency and facilitating collaboration, our proposed platform has the potential to significantly improve reproducible research in machine learning and can be adapted to other domains within artificial intelligence.Keywords
This publication has 44 references indexed in Scilit:
- A verifiable and privacy-preserving blockchain-based federated learning approachPeer-to-Peer Networking and Applications, 2023
- A Blockchain-Based Architecture for Trust in Collaborative Scientific ExperimentationJournal of Grid Computing, 2022
- Deep learning based single sample face recognition: a surveyArtificial Intelligence Review, 2022
- Do machine learning platforms provide out-of-the-box reproducibility?Future Generation Computer Systems, 2022
- Deep learning-based object recognition in multispectral satellite imagery for real-time applicationsMachine Vision and Applications, 2021
- Towards Secure and Efficient Scientific Research Project Management Using Consortium BlockchainJournal of Signal Processing Systems, 2021
- Distributed Ledger for Provenance Tracking of Artificial Intelligence Assets2020
- Machine learning applied in production planning and control: a state-of-the-art in the era of industry 4.0Journal of Intelligent Manufacturing, 2020
- Towards Enabling Trusted Artificial Intelligence via Blockchain2019
- Improving the Efficiency and Reliability of Digital Time-Stamping1993