Modeling Semantic Inspired by Quantum Composite System
- 1 December 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 755-759
Abstract
In the field of Natural Language Processing (NLP), especially for many specific tasks, representing and modeling semantic of text plays essential role. Generally speaking, by extracting feature of words, we can find the internal relationship between words and model text semantics. Further more, there have been achievements in using quantum concepts to construct language models, which suggests the effectiveness of applying quantum theory to semantic learning and representation. However, in the current research of quantum-inspired language model, semantic of the text is often directly modeled by quantum concept (e.g., density matrix), which blurs the original meaning of the word itself. In this study, we propose the composite semantic system (CSS) hypothesis and construct a quantum-inspired semantic representation network (QSRN). We apply QSRN to four different text classification tasks, the experimental results show the effectiveness of the algorithm and verify the hypothesis we proposed.Keywords
This publication has 13 references indexed in Scilit:
- Supervised Learning of Universal Sentence Representations from Natural Language Inference Data2017
- Glove: Global Vectors for Word Representation2014
- Concepts and Their Dynamics: A Quantum‐Theoretic Modeling of Human ThoughtTopics in Cognitive Science, 2013
- Modeling term dependencies with quantum language models for IR2013
- Quantum Models of Cognition and Decision2012
- Is there something quantum-like about the human mental lexicon?Journal of Mathematical Psychology, 2009
- Entanglement detectionPhysics Reports, 2009
- Statistical Language Models for Information RetrievalSynthesis Lectures on Human Language Technologies, 2008
- Mining and summarizing customer reviews2004
- Quantum information and computationNature, 2000