Enhancing Temporal Understanding in LLMs for Semi-structured Tables
Preprint
Abstract
Temporal reasoning over tabular data presents substantial challenges for large language models (LLMs), as evidenced by recent research. In this study, we conduct a comprehensive analysis of temporal datasets to pinpoint the specific limitations of LLMs. Our investigation leads to enhancements in TempTabQA, a dataset specifically designed for tabular temporal question answering. We provide critical insights for improving LLM performance in temporal reasoning tasks with tabular data. Furthermore, we introduce a novel approach, C.L.E.A.R to strengthen LLM capabilities in this domain. Our findings demonstrate that our method significantly improves evidence-based reasoning across various models. Additionally, our experimental results reveal that indirect supervision with auxiliary data substantially boosts model performance in these tasks. This work contributes to a deeper understanding of LLMs' temporal reasoning abilities over tabular data and promotes advancements in their application across diverse fields.Keywords
All Related Versions
This publication has 37 references indexed in Scilit:
- Time-Aware Language Models as Temporal Knowledge BasesTransactions of the Association for Computational Linguistics, 2022
- Summarizing and Exploring Tabular Data in Conversational Search2020
- Web Table Extraction, Retrieval, and AugmentationACM Transactions on Intelligent Systems and Technology, 2020
- TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data2020
- TaPas: Weakly Supervised Table Parsing via Pre-training2020
- Logical Natural Language Generation from Open-Domain Tables2020
- INFOTABS: Inference on Tables as Semi-structured Data2020
- Table2Vec2019
- TEQUILA2018
- TempQuestions2018