Implications of Topological Imbalance for Representation Learning on Biomedical Knowledge Graphs
Authors:
Preprint
Abstract
Adoption of recently developed methods from machine learning has given rise to creation of drug-discovery knowledge graphs (KG) that utilize the interconnected nature of the domain. Graph-based modelling of the data, combined with KG embedding (KGE) methods, are promising as they provide a more intuitive representation and are suitable for inference tasks such as predicting missing links. One common application is to produce ranked lists of genes for a given disease, where the rank is based on the perceived likelihood of association between the gene and the disease. It is thus critical that these predictions are not only pertinent but also biologically meaningful. However, KGs can be biased either directly due to the underlying data sources that are integrated or due to modeling choices in the construction of the graph, one consequence of which is that certain entities can get topologically overrepresented. We demonstrate the effect of these inherent structural imbalances, resulting in densely-connected entities being highly ranked no matter the context. We provide support for this observation across different datasets, models as well as predictive tasks. Further, we present various graph perturbation experiments which yield more support to the observation that KGE models can be more influenced by the frequency of entities rather than any biological information encoded within the relations. Our results highlight the importance of data modeling choices, and emphasizes the need for practitioners to be mindful of these issues when interpreting model outputs and during KG composition.Keywords
All Related Versions
This publication has 21 references indexed in Scilit:
- A review of biomedical datasets relating to drug discovery: a knowledge graph perspectiveBriefings in Bioinformatics, 2022
- Understanding the performance of knowledge graph embeddings in drug discoveryArtificial Intelligence in the Life Sciences, 2022
- Preclinical validation of therapeutic targets predicted by tensor factorization on heterogeneous graphsScientific Reports, 2020
- OpenBioLink: a benchmarking framework for large-scale biomedical link predictionBioinformatics, 2020
- Melanoma subtypes: genomic profiles, prognostic molecular markers and therapeutic possibilitiesThe Journal of Pathology, 2018
- Pharos: Collating protein information to shed light on the druggable genomeNucleic Acids Research, 2016
- Coming of age: ten years of next-generation sequencing technologiesNature Reviews Genetics, 2016
- DISEASES: Text mining and data integration of disease–gene associationsMethods, 2015
- Lessons learned from the fate of AstraZeneca's drug pipeline: a five-dimensional frameworkNature Reviews Drug Discovery, 2014
- Regulatory mechanisms involved in the control of ubiquitin homeostasisThe Journal of Biochemistry, 2010