Teng Li
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Teng Li has a total of 8 co-authors. Here are the top co-authors by number of shared publications:
- Jimmy Xiangji Huang
Information Retrieval and Knowledge Management Research Lab, York University
2 shared publications Min Pan
College of Computer and Information Engineering Hubei Normal University Huangshi China
2 shared publicationsQuanli Pei
School of Information Technology York University Toronto Canada
2 shared publicationsYu Liu
College of Computer and Information Engineering Hubei Normal University Huangshi China
2 shared publicationsAngela J. Huang
Lassonde School of Engineering York University Toronto Ontario Canada
1 shared publicationEllen Anne Huang
1 shared publication
Latest Publications
- Open Access
- 7 June 2024
- Published by Wiley in Computational Intelligence
- Vol. 40 (3)
Utilizing passage‐level relevance and kernel pooling for enhancing BERT‐based document reranking
The pre‐trained language model (PLM) based on the Transformer encoder, namely BERT, has achieved state‐of‐the‐art results in the field of Information Retrieval. Existing BERT‐based ranking models divide documents into passages and aggregate passage‐level relevance to rank the document list. However, these common score aggregation strategies cannot capture important semantic information such as document structure and have not been extensively studied. In this article, we propose a novel kernel‐based score pooling system to capture document‐level relevance by aggregating passage‐level relevance. In particular, we propose and study several representative kernel pooling functions and several different document ranking strategies based on passage‐level relevance. Our proposed framework KnBERT naturally incorporates kernel functions from the passage level into the BERT‐based re‐ranking method, which provides a promising avenue for building universal retrieval‐then‐rerank information retrieval systems. Experiments conducted on two widely used TREC Robust04 and GOV2 test datasets show that the KnBERT has made significant improvements over other BERT‐based ranking approaches in terms of MAP, P@20, and NDCG@20 indicators with no extra or even less computations.
- 7 June 2024
- Published by Wiley in Computational Intelligence
- Vol. 40 (3)
Open AccessUtilizing passage‐level relevance and kernel pooling for enhancing BERT‐based document reranking
The pre‐trained language model (PLM) based on the Transformer encoder, namely BERT, has achieved state‐of‐the‐art results in the field of Information Retrieval. Existing BERT‐based ranking models divide documents into passages and aggregate passage‐level relevance to rank the document list. However, these common score aggregation strategies cannot capture important semantic information such as document structure and have not been extensively studied. In this article, we propose a novel kernel‐based score pooling system to capture document‐level relevance by aggregating passage‐level relevance. In particular, we propose and study several representative kernel pooling functions and several different document ranking strategies based on passage‐level relevance. Our proposed framework KnBERT naturally incorporates kernel functions from the passage level into the BERT‐based re‐ranking method, which provides a promising avenue for building universal retrieval‐then‐rerank information retrieval systems. Experiments conducted on two widely used TREC Robust04 and GOV2 test datasets show that the KnBERT has made significant improvements over other BERT‐based ranking approaches in terms of MAP, P@20, and NDCG@20 indicators with no extra or even less computations.
- 13 May 2023
- Published by Elsevier in Knowledge-Based Systems
- Vol. 274
SPRF: A semantic Pseudo-relevance Feedback enhancement for information retrieval via ConceptNet
- 13 May 2023
- Published by Elsevier in Knowledge-Based Systems
- Vol. 274
SPRF: A semantic Pseudo-relevance Feedback enhancement for information retrieval via ConceptNet