Procheta Sen
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Procheta Sen has a total of 40 co-authors. Here are the top co-authors by number of shared publications:
- Emine Yilmaz
University College London, London, United Kingdom
5 shared publications - Xi Wang
University of Sheffield, Sheffield, United Kingdom
5 shared publications - Jionglong Su
Xi'an Jiaotong-Liverpool University
3 shared publications - Ruizhe Li
University of Aberdeen
3 shared publications - Zhengyong Jiang
School of AI and Advanced Computing Xi'an Jiaotong-Liverpool University China
3 shared publications - Aldo Lipani
University College London, London, United Kingdom
2 shared publications
Latest Publications
- Open Access
- 10 January 2026
- Published by Springer Nature in Discover Computing
- Vol. 29 (1) , 19
Early detection of anorexia from reddit posts using time series based transformer model
Rates of mental health concerns are rising, and an increasing number of individuals openly share their experiences on social media platforms (Hasell and Nabi, in: Emotions in the digital world: exploring affective experience and expression in online interactions, Oxford University Press, 2023). This openness creates an opportunity to study, detect, and ultimately support those at risk using data-driven methods. We focus on Anorexia Nervosa , an eating disorder characterized by persistent restriction and an intense fear of weight gain. Early, automatic identification can enable timelier assessment and intervention. We propose a transformer-based time-series model that analyzes longitudinal Reddit activity to estimate an individual’s likelihood of Anorexia. The model jointly captures temporal dynamics (how signals evolve over time) and semantic content (what the posts mean), yielding an accuracy of $$85.2\%$$ . In our experiments, this approach outperforms baselines that rely solely on semantic features, underscoring the value of modeling user trajectories rather than treating posts in isolation. We further conduct post-hoc explanation analyses to highlight the features most responsible for the model’s predictions, and we show that these attributions align with human intuition. Code for our approach is available in the repository here ( https://anonymous.4open.science/r/From-Posts-to-Patterns-Detecting-Anorexia-on-Reddit-6CB7/ ).- 10 January 2026
- Published by Springer Nature in Discover Computing
- Vol. 29 (1) , 19
Open AccessEarly detection of anorexia from reddit posts using time series based transformer model
Rates of mental health concerns are rising, and an increasing number of individuals openly share their experiences on social media platforms (Hasell and Nabi, in: Emotions in the digital world: exploring affective experience and expression in online interactions, Oxford University Press, 2023). This openness creates an opportunity to study, detect, and ultimately support those at risk using data-driven methods. We focus on Anorexia Nervosa , an eating disorder characterized by persistent restriction and an intense fear of weight gain. Early, automatic identification can enable timelier assessment and intervention. We propose a transformer-based time-series model that analyzes longitudinal Reddit activity to estimate an individual’s likelihood of Anorexia. The model jointly captures temporal dynamics (how signals evolve over time) and semantic content (what the posts mean), yielding an accuracy of $$85.2\%$$ . In our experiments, this approach outperforms baselines that rely solely on semantic features, underscoring the value of modeling user trajectories rather than treating posts in isolation. We further conduct post-hoc explanation analyses to highlight the features most responsible for the model’s predictions, and we show that these attributions align with human intuition. Code for our approach is available in the repository here ( https://anonymous.4open.science/r/From-Posts-to-Patterns-Detecting-Anorexia-on-Reddit-6CB7/ ). - Open Access
- 25 November 2025
- Published by Springer Nature in Research Square
From Posts to Patterns: Early Detection of Anorexia on Reddit
Rates of mental health concerns are rising, and an increasing number of individuals openly share their experiences on social media platforms. This openness creates an opportunity to study, detect, and ultimately support those at risk using data-driven methods. We focus on 'Anorexia Nervosa', an eating disorder characterized by persistent restriction and an intense fear of weight gain. Early, automatic identification can enable timelier assessment and intervention. We propose a transformer-based time-series model that analyzes longitudinal Reddit activity to estimate an individual’s likelihood of Anorexia. The model jointly captures temporal dynamics (how signals evolve over time) and semantic content (what the posts mean), yielding an accuracy of 85.2%. In our experiments, this approach outperforms baselines that rely solely on semantic features, underscoring the value of modeling user trajectories rather than treating posts in isolation. We further conduct post-hoc explanation analyses to highlight the features most responsible for the model’s predictions, and we show that these attributions align with human intuition.
- 25 November 2025
- Published by Springer Nature in Research Square
Open AccessFrom Posts to Patterns: Early Detection of Anorexia on Reddit
Rates of mental health concerns are rising, and an increasing number of individuals openly share their experiences on social media platforms. This openness creates an opportunity to study, detect, and ultimately support those at risk using data-driven methods. We focus on 'Anorexia Nervosa', an eating disorder characterized by persistent restriction and an intense fear of weight gain. Early, automatic identification can enable timelier assessment and intervention. We propose a transformer-based time-series model that analyzes longitudinal Reddit activity to estimate an individual’s likelihood of Anorexia. The model jointly captures temporal dynamics (how signals evolve over time) and semantic content (what the posts mean), yielding an accuracy of 85.2%. In our experiments, this approach outperforms baselines that rely solely on semantic features, underscoring the value of modeling user trajectories rather than treating posts in isolation. We further conduct post-hoc explanation analyses to highlight the features most responsible for the model’s predictions, and we show that these attributions align with human intuition.
- Open Access
MedFact: A Large-scale Chinese Dataset for Evidence-based Medical Fact-checking of LLM Responses
Medical fact-checking has become increasingly critical as more individuals seek medical information online. However, existing datasets predominantly focus on human-generated content, leaving the verification of content generated by large language models (LLMs) relatively unexplored. To address this gap, we introduce MedFact, the first evidence-based Chinese medical fact-checking dataset of LLM-generated medical content. It consists of 1,321 questions and 7,409 claims, mirroring the complexities of real-world medical scenarios. We conduct comprehensive experiments in both in-context learning (ICL) and fine-tuning settings, showcasing the capability and challenges of current LLMs on this task, accompanied by an in-depth error analysis to point out key directions for future research. Our dataset is publicly available at https://github.com/AshleyChenNLP/MedFact.
Open AccessMedFact: A Large-scale Chinese Dataset for Evidence-based Medical Fact-checking of LLM Responses
Medical fact-checking has become increasingly critical as more individuals seek medical information online. However, existing datasets predominantly focus on human-generated content, leaving the verification of content generated by large language models (LLMs) relatively unexplored. To address this gap, we introduce MedFact, the first evidence-based Chinese medical fact-checking dataset of LLM-generated medical content. It consists of 1,321 questions and 7,409 claims, mirroring the complexities of real-world medical scenarios. We conduct comprehensive experiments in both in-context learning (ICL) and fine-tuning settings, showcasing the capability and challenges of current LLMs on this task, accompanied by an in-depth error analysis to point out key directions for future research. Our dataset is publicly available at https://github.com/AshleyChenNLP/MedFact.
- Open Access
Dissecting Bias in LLMs: A Mechanistic Interpretability Perspective
Large Language Models (LLMs) are known to exhibit social, demographic, and gender biases, often as a consequence of the data on which they are trained. In this work, we adopt a mechanistic interpretability approach to analyze how such biases are structurally represented within models such as GPT-2 and Llama2. Focusing on demographic and gender biases, we explore different metrics to identify the internal edges responsible for biased behavior. We then assess the stability, localization, and generalizability of these components across dataset and linguistic variations. Through systematic ablations, we demonstrate that bias-related computations are highly localized, often concentrated in a small subset of layers. Moreover, the identified components change across fine-tuning settings, including those unrelated to bias. Finally, we show that removing these components not only reduces biased outputs but also affects other NLP tasks, such as named entity recognition and linguistic acceptability judgment because of the sharing of important components with these tasks.
Open AccessDissecting Bias in LLMs: A Mechanistic Interpretability Perspective
Large Language Models (LLMs) are known to exhibit social, demographic, and gender biases, often as a consequence of the data on which they are trained. In this work, we adopt a mechanistic interpretability approach to analyze how such biases are structurally represented within models such as GPT-2 and Llama2. Focusing on demographic and gender biases, we explore different metrics to identify the internal edges responsible for biased behavior. We then assess the stability, localization, and generalizability of these components across dataset and linguistic variations. Through systematic ablations, we demonstrate that bias-related computations are highly localized, often concentrated in a small subset of layers. Moreover, the identified components change across fine-tuning settings, including those unrelated to bias. Finally, we show that removing these components not only reduces biased outputs but also affects other NLP tasks, such as named entity recognition and linguistic acceptability judgment because of the sharing of important components with these tasks.
- Open Access
- 11 April 2025
- Published by Association for the Advancement of Artificial Intelligence (AAAI) in Proceedings of the AAAI Conference on Artificial Intelligence
- Vol. 39 (28) , 29407-29409
Unraveling the Influence of Training Data and Internal Structures in Large Language Models for Enhanced Explainability (Student Abstract)
Recent advances in deep learning have expanded the application of large language models (LLMs) across fields such as medicine, finance, and education. Understanding the mechanisms underlying these models is essential to mitigate issues like hallucinations and bias. This study provides deep learning practitioners with insights into how specific training data points and internal structures influence model behaviour. Using influence functions and mechanistic interpretability, we will analyze the impact of data on model predictions across various tasks. Preliminary findings indicate that semantic search techniques, such as FAISS, enable efficient identification of influential training points in GPT-2 small. Future work will extend these methods to additional tasks and more complex models, with a focus on further elucidating LLM structures to improve interpretability.
- 11 April 2025
- Published by Association for the Advancement of Artificial Intelligence (AAAI) in Proceedings of the AAAI Conference on Artificial Intelligence
- Vol. 39 (28) , 29407-29409
Open AccessUnraveling the Influence of Training Data and Internal Structures in Large Language Models for Enhanced Explainability (Student Abstract)
Recent advances in deep learning have expanded the application of large language models (LLMs) across fields such as medicine, finance, and education. Understanding the mechanisms underlying these models is essential to mitigate issues like hallucinations and bias. This study provides deep learning practitioners with insights into how specific training data points and internal structures influence model behaviour. Using influence functions and mechanistic interpretability, we will analyze the impact of data on model predictions across various tasks. Preliminary findings indicate that semantic search techniques, such as FAISS, enable efficient identification of influential training points in GPT-2 small. Future work will extend these methods to additional tasks and more complex models, with a focus on further elucidating LLM structures to improve interpretability.
- Open Access
- 1 January 2025
- Published by Association for Computational Linguistics (ACL)
- p. 32328-32341
MedFact: A Large-scale Chinese Dataset for Evidence-based Medical Fact-checking of LLM Responses
Tong Chen, Zimu Wang, Yiyi Miao, Haoran Luo, Sun Yuanfei, Wei Wang, Zhengyong Jiang, Procheta Sen, Jionglong Su. Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing. 2025.
- 1 January 2025
- Published by Association for Computational Linguistics (ACL)
- p. 32328-32341
Open AccessMedFact: A Large-scale Chinese Dataset for Evidence-based Medical Fact-checking of LLM Responses
Tong Chen, Zimu Wang, Yiyi Miao, Haoran Luo, Sun Yuanfei, Wei Wang, Zhengyong Jiang, Procheta Sen, Jionglong Su. Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing. 2025.
- Open Access
- 1 January 2025
- Published by Association for Computational Linguistics (ACL)
- p. 491-503
Adaptive Retrieval-Augmented Generation for Conversational Systems
Xi Wang, Procheta Sen, Ruizhe Li, Emine Yilmaz. Findings of the Association for Computational Linguistics: NAACL 2025. 2025.
- 1 January 2025
- Published by Association for Computational Linguistics (ACL)
- p. 491-503
Open AccessAdaptive Retrieval-Augmented Generation for Conversational Systems
Xi Wang, Procheta Sen, Ruizhe Li, Emine Yilmaz. Findings of the Association for Computational Linguistics: NAACL 2025. 2025.
- Top Cited PapersOpen Access
- 11 November 2024
- Published by Springer Nature in Artificial Intelligence and Law
- Vol. 34 (1) , 245-266
A case study for automated attribute extraction from legal documents using large language models
The escalating number of pending cases is a growing concern worldwide. Recent advancements in digitization have opened up possibilities for leveraging artificial intelligence (AI) tools in the processing of legal documents. Adopting a structured representation for legal documents, as opposed to a mere bag-of-words flat text representation, can significantly enhance processing capabilities. With the aim of achieving this objective, we put forward a set of diverse attributes for criminal case proceedings. To enhance the effectiveness of automatically extracting these attributes from legal documents within a sequence labeling framework, we propose the utilization of a few-shot learning approach based on Large Language Models (LLMs). Moreover, we demonstrate the efficacy of the extracted attributes in downstream tasks, such as legal judgment prediction and legal statute prediction .
- 11 November 2024
- Published by Springer Nature in Artificial Intelligence and Law
- Vol. 34 (1) , 245-266
Top Cited PapersOpen AccessA case study for automated attribute extraction from legal documents using large language models
The escalating number of pending cases is a growing concern worldwide. Recent advancements in digitization have opened up possibilities for leveraging artificial intelligence (AI) tools in the processing of legal documents. Adopting a structured representation for legal documents, as opposed to a mere bag-of-words flat text representation, can significantly enhance processing capabilities. With the aim of achieving this objective, we put forward a set of diverse attributes for criminal case proceedings. To enhance the effectiveness of automatically extracting these attributes from legal documents within a sequence labeling framework, we propose the utilization of a few-shot learning approach based on Large Language Models (LLMs). Moreover, we demonstrate the efficacy of the extracted attributes in downstream tasks, such as legal judgment prediction and legal statute prediction .
- Open Access
Adaptive Retrieval-Augmented Generation for Conversational Systems
Despite the success of integrating large language models into the development of conversational systems, many studies have shown the effectiveness of retrieving and augmenting external knowledge for informative responses. Hence, many existing studies commonly assume the always need for Retrieval Augmented Generation (RAG) in a conversational system without explicit control. This raises a research question about such a necessity. In this study, we propose to investigate the need for each turn of system response to be augmented with external knowledge. In particular, by leveraging human judgements on the binary choice of adaptive augmentation, we develop RAGate, a gating model, which models conversation context and relevant inputs to predict if a conversational system requires RAG for improved responses. We conduct extensive experiments on devising and applying RAGate to conversational models and well-rounded analyses of different conversational scenarios. Our experimental results and analysis indicate the effective application of RAGate in RAG-based conversational systems in identifying system responses for appropriate RAG with high-quality responses and a high generation confidence. This study also identifies the correlation between the generation's confidence level and the relevance of the augmented knowledge.
Open AccessAdaptive Retrieval-Augmented Generation for Conversational Systems
Despite the success of integrating large language models into the development of conversational systems, many studies have shown the effectiveness of retrieving and augmenting external knowledge for informative responses. Hence, many existing studies commonly assume the always need for Retrieval Augmented Generation (RAG) in a conversational system without explicit control. This raises a research question about such a necessity. In this study, we propose to investigate the need for each turn of system response to be augmented with external knowledge. In particular, by leveraging human judgements on the binary choice of adaptive augmentation, we develop RAGate, a gating model, which models conversation context and relevant inputs to predict if a conversational system requires RAG for improved responses. We conduct extensive experiments on devising and applying RAGate to conversational models and well-rounded analyses of different conversational scenarios. Our experimental results and analysis indicate the effective application of RAGate in RAG-based conversational systems in identifying system responses for appropriate RAG with high-quality responses and a high generation confidence. This study also identifies the correlation between the generation's confidence level and the relevance of the augmented knowledge.
- 20 March 2024
- Published by Springer Nature
- p. 157-172
Simulated Task Oriented Dialogues for Developing Versatile Conversational Agents
- 20 March 2024
- Published by Springer Nature
- p. 157-172
Simulated Task Oriented Dialogues for Developing Versatile Conversational Agents