Hybrid Quantum Classical Machine Learning with Knowledge Distillation
Authors:
- 9 June 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1139-1144
Abstract
The rapid advancement of machine learning (ML) and the growing need for computational power have led to the exploration of quantum computing, which offers significant potential for faster complex calculations. However, Quantum Machine Learning (QML) faces challenges due to the limited number of qubits and noise of quantum circuits, particularly with Noisy Intermediate-Scale Quantum (NISQ) devices. These challenges severely limit the current capacity to train accurate and stable Quantum Machine Learning Models. In this paper, we propose a novel framework for QML that employs the knowledge distillation method to harness the power of well-trained classical machine learning (CML) models and enhance the training performance of QML models. In this framework, we utilize the well-trained CML as a teacher model to assist the training of the student QML model using the knowledge distillation method. By distilling knowledge from the robust CML model, our framework can potentially address the problem of the barren plateau which hinders effective model training. Knowledge distillation is well suited for this framework through the transfer of knowledge without parameter sharing. Through empirical tests, our framework has demonstrated not only an increase in the accuracy of QML models but also a notable improvement in training stability.Keywords
Funding Information
- U.S. NSF (EECS-2045978,CNS-2107216,CNS-2128368,CMMI-2222810,ECCS-2302469,CNS-2107057,CNS-2318664)
This publication has 15 references indexed in Scilit:
- Challenges and opportunities in quantum machine learningNature Computational Science, 2022
- A rigorous and robust quantum speed-up in supervised machine learningNature Physics, 2021
- Machine learning and deep learningElectronic Markets, 2021
- Quantum machine learning in high energy physicsMachine Learning: Science and Technology, 2021
- Recent advances in quantum machine learningQuantum Engineering, 2020
- Quantum Machine Learning for 6G Communication Networks: State-of-the-Art and Vision for the FutureIEEE Access, 2019
- A Survey on quantum computing technologyComputer Science Review, 2019
- Quantum machine learningNature, 2017
- Deep Residual Learning for Image Recognition2016
- Parallelizing quantum circuitsTheoretical Computer Science, 2009