FuDoBa: Fusing Document and Knowledge Graph-based Representations with Bayesian Optimisation
Preprint
Abstract
Building on the success of Large Language Models (LLMs), LLM-based representations have dominated the document representation landscape, achieving great performance on the document embedding benchmarks. However, the high-dimensional, computationally expensive embeddings from LLMs tend to be either too generic or inefficient for domain-specific applications. To address these limitations, we introduce FuDoBa a Bayesian optimisation-based method that integrates LLM-based embeddings with domain-specific structured knowledge, sourced both locally and from external repositories like WikiData. This fusion produces low-dimensional, task-relevant representations while reducing training complexity and yielding interpretable early-fusion weights for enhanced classification performance. We demonstrate the effectiveness of our approach on six datasets in two domains, showing that when paired with robust AutoML-based classifiers, our proposed representation learning approach performs on par with, or surpasses, those produced solely by the proprietary LLM-based embedding baselines.Keywords
All Related Versions
This publication has 26 references indexed in Scilit:
- Augmenting Multimodal LLMs with Self-Reflective Tokens for Knowledge-based Visual Question Answering2025
- AutoML-Guided Fusion of Entity and LLM-Based Representations for Document Classification2025
- Knowledge graph informed fake news classification via heterogeneous representation ensemblesNeurocomputing, 2022
- Compressibility of Distributed Document Representations2021
- Zero-Shot Text Classification via Knowledge Graph Embedding for Social Media DataIEEE Internet of Things Journal, 2021
- autoBOT: evolving neuro-symbolic representations for explainable low resource text classificationMachine Learning, 2021
- tax2vec: Constructing Interpretable Features from Taxonomies for Short Text ClassificationComputer Speech & Language, 2021
- Scaling tree-based automated machine learning to biomedical big data with a feature set selectorBioinformatics, 2019
- Multisensor Data Fusion with Singular Value Decomposition2012
- The singular value decomposition: Its computation and some applicationsIEEE Transactions on Automatic Control, 1980