Jini K Gopinath
Research Subjects
Jini K Gopinath has a total of 11 co-authors. Here are the top co-authors by number of shared publications:
- Aseem Srivastava
IIIT Delhi India
2 shared publications - Koushik Sinha Deb
Department of Psychiatry, AIIMS, New Delhi, India
2 shared publications - Prottay Kumar Adhikary
Indian Institute of Technology Delhi, New Delhi, India
2 shared publications - Puneet Manuja
YourDOST, Karnataka, India
2 shared publications - Salam Michael Singh
Department of Electrical Engineering, Indian Institute of Technology Delhi, Room: 3B-7 (Block III 3rd Floor), Hauz Khas, New Delhi, 110016, India, 91 26591076 ext 011
2 shared publications - Shivani Kumar
Indraprastha Institute of Information Technology, Delhi, India
2 shared publications
Latest Publications
- Open Access
- 9 January 2025
- Published by Cambridge University Press (CUP) in Cambridge Prisms: Global Mental Health
- Vol. 12, e9
Internet chat based intervention as a mode for therapy and counselling
Increasing mental health issues in India demands for a strong intervention to curb the rise. According to the World Health Organization, roughly around 21 Indians out of 100,000 die by suicide every year. The burden on mental health domain increases due to the existing system as most of the existing services follow a traditional approach and are most sought after but lack reachability and ease of access. This study recognises the need for programmes that help in reachability and ease of access while simultaneously maintaining anonymity, therefore, analyses the impact of chat-based therapy provided online through the platform. The paper analyses the difference in subjective unit of well-being (SUW) pre and post chat-based sessions among 2624 college students and 805 corporate employees. The Wilcoxon signed rank test between pre and post intervention indicates significant results with the p < 0.001 ( Z = −44.100a) suggesting and increase in SUW scores post intervention. Further, the Kruskal–Wallis test revealed that the gender of the clients has an association with the SUW scores ( p < 0.05). It was also found that the duration of the sessions had a positive relation with the impact scores ( p < 0.001).
- 9 January 2025
- Published by Cambridge University Press (CUP) in Cambridge Prisms: Global Mental Health
- Vol. 12, e9
Open AccessInternet chat based intervention as a mode for therapy and counselling
Increasing mental health issues in India demands for a strong intervention to curb the rise. According to the World Health Organization, roughly around 21 Indians out of 100,000 die by suicide every year. The burden on mental health domain increases due to the existing system as most of the existing services follow a traditional approach and are most sought after but lack reachability and ease of access. This study recognises the need for programmes that help in reachability and ease of access while simultaneously maintaining anonymity, therefore, analyses the impact of chat-based therapy provided online through the platform. The paper analyses the difference in subjective unit of well-being (SUW) pre and post chat-based sessions among 2624 college students and 805 corporate employees. The Wilcoxon signed rank test between pre and post intervention indicates significant results with the p < 0.001 ( Z = −44.100a) suggesting and increase in SUW scores post intervention. Further, the Kruskal–Wallis test revealed that the gender of the clients has an association with the SUW scores ( p < 0.05). It was also found that the duration of the sessions had a positive relation with the impact scores ( p < 0.001).
- Top Cited PapersOpen Access
- 23 July 2024
- Published by JMIR Publications Inc. in JMIR Mental Health
- Vol. 11 (1) , e57306
Exploring the Efficacy of Large Language Models in Summarizing Mental Health Counseling Sessions: Benchmark Study
Background: Comprehensive session summaries enable effective continuity in mental health counseling, facilitating informed therapy planning. However, manual summarization presents a significant challenge, diverting experts’ attention from the core counseling process. Leveraging advances in automatic summarization to streamline the summarization process addresses this issue because this enables mental health professionals to access concise summaries of lengthy therapy sessions, thereby increasing their efficiency. However, existing approaches often overlook the nuanced intricacies inherent in counseling interactions. Objective: This study evaluates the effectiveness of state-of-the-art large language models (LLMs) in selectively summarizing various components of therapy sessions through aspect-based summarization, aiming to benchmark their performance. Methods: We first created Mental Health Counseling-Component–Guided Dialogue Summaries, a benchmarking data set that consists of 191 counseling sessions with summaries focused on 3 distinct counseling components (also known as counseling aspects). Next, we assessed the capabilities of 11 state-of-the-art LLMs in addressing the task of counseling-component–guided summarization. The generated summaries were evaluated quantitatively using standard summarization metrics and verified qualitatively by mental health professionals. Results: Our findings demonstrated the superior performance of task-specific LLMs such as MentalLlama, Mistral, and MentalBART evaluated using standard quantitative metrics such as Recall-Oriented Understudy for Gisting Evaluation (ROUGE)-1, ROUGE-2, ROUGE-L, and Bidirectional Encoder Representations from Transformers Score across all aspects of the counseling components. Furthermore, expert evaluation revealed that Mistral superseded both MentalLlama and MentalBART across 6 parameters: affective attitude, burden, ethicality, coherence, opportunity costs, and perceived effectiveness. However, these models exhibit a common weakness in terms of room for improvement in the opportunity costs and perceived effectiveness metrics. Conclusions: While LLMs fine-tuned specifically on mental health domain data display better performance based on automatic evaluation scores, expert assessments indicate that these models are not yet reliable for clinical application. Further refinement and validation are necessary before their implementation in practice.
- 23 July 2024
- Published by JMIR Publications Inc. in JMIR Mental Health
- Vol. 11 (1) , e57306
Top Cited PapersOpen AccessExploring the Efficacy of Large Language Models in Summarizing Mental Health Counseling Sessions: Benchmark Study
Background: Comprehensive session summaries enable effective continuity in mental health counseling, facilitating informed therapy planning. However, manual summarization presents a significant challenge, diverting experts’ attention from the core counseling process. Leveraging advances in automatic summarization to streamline the summarization process addresses this issue because this enables mental health professionals to access concise summaries of lengthy therapy sessions, thereby increasing their efficiency. However, existing approaches often overlook the nuanced intricacies inherent in counseling interactions. Objective: This study evaluates the effectiveness of state-of-the-art large language models (LLMs) in selectively summarizing various components of therapy sessions through aspect-based summarization, aiming to benchmark their performance. Methods: We first created Mental Health Counseling-Component–Guided Dialogue Summaries, a benchmarking data set that consists of 191 counseling sessions with summaries focused on 3 distinct counseling components (also known as counseling aspects). Next, we assessed the capabilities of 11 state-of-the-art LLMs in addressing the task of counseling-component–guided summarization. The generated summaries were evaluated quantitatively using standard summarization metrics and verified qualitatively by mental health professionals. Results: Our findings demonstrated the superior performance of task-specific LLMs such as MentalLlama, Mistral, and MentalBART evaluated using standard quantitative metrics such as Recall-Oriented Understudy for Gisting Evaluation (ROUGE)-1, ROUGE-2, ROUGE-L, and Bidirectional Encoder Representations from Transformers Score across all aspects of the counseling components. Furthermore, expert evaluation revealed that Mistral superseded both MentalLlama and MentalBART across 6 parameters: affective attitude, burden, ethicality, coherence, opportunity costs, and perceived effectiveness. However, these models exhibit a common weakness in terms of room for improvement in the opportunity costs and perceived effectiveness metrics. Conclusions: While LLMs fine-tuned specifically on mental health domain data display better performance based on automatic evaluation scores, expert assessments indicate that these models are not yet reliable for clinical application. Further refinement and validation are necessary before their implementation in practice.
- Open Access
- 12 February 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Exploring the Efficacy of Large Language Models in Summarizing Mental Health Counseling Sessions: Benchmark Study (Preprint)
BACKGROUND Comprehensive session summaries enable effective continuity in mental health counseling, facilitating informed therapy planning. However, manual summarization presents a significant challenge, diverting experts’ attention from the core counseling process. Leveraging advances in automatic summarization to streamline the summarization process addresses this issue because this enables mental health professionals to access concise summaries of lengthy therapy sessions, thereby increasing their efficiency. However, existing approaches often overlook the nuanced intricacies inherent in counseling interactions. OBJECTIVE This study evaluates the effectiveness of state-of-the-art large language models (LLMs) in selectively summarizing various components of therapy sessions through aspect-based summarization, aiming to benchmark their performance. METHODS We first created Mental Health Counseling-Component–Guided Dialogue Summaries, a benchmarking data set that consists of 191 counseling sessions with summaries focused on 3 distinct counseling components (also known as counseling aspects). Next, we assessed the capabilities of 11 state-of-the-art LLMs in addressing the task of counseling-component–guided summarization. The generated summaries were evaluated quantitatively using standard summarization metrics and verified qualitatively by mental health professionals. RESULTS Our findings demonstrated the superior performance of task-specific LLMs such as MentalLlama, Mistral, and MentalBART evaluated using standard quantitative metrics such as Recall-Oriented Understudy for Gisting Evaluation (ROUGE)-1, ROUGE-2, ROUGE-L, and Bidirectional Encoder Representations from Transformers Score across all aspects of the counseling components. Furthermore, expert evaluation revealed that Mistral superseded both MentalLlama and MentalBART across 6 parameters: affective attitude, burden, ethicality, coherence, opportunity costs, and perceived effectiveness. However, these models exhibit a common weakness in terms of room for improvement in the opportunity costs and perceived effectiveness metrics. CONCLUSIONS While LLMs fine-tuned specifically on mental health domain data display better performance based on automatic evaluation scores, expert assessments indicate that these models are not yet reliable for clinical application. Further refinement and validation are necessary before their implementation in practice.
- 12 February 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessExploring the Efficacy of Large Language Models in Summarizing Mental Health Counseling Sessions: Benchmark Study (Preprint)
BACKGROUND Comprehensive session summaries enable effective continuity in mental health counseling, facilitating informed therapy planning. However, manual summarization presents a significant challenge, diverting experts’ attention from the core counseling process. Leveraging advances in automatic summarization to streamline the summarization process addresses this issue because this enables mental health professionals to access concise summaries of lengthy therapy sessions, thereby increasing their efficiency. However, existing approaches often overlook the nuanced intricacies inherent in counseling interactions. OBJECTIVE This study evaluates the effectiveness of state-of-the-art large language models (LLMs) in selectively summarizing various components of therapy sessions through aspect-based summarization, aiming to benchmark their performance. METHODS We first created Mental Health Counseling-Component–Guided Dialogue Summaries, a benchmarking data set that consists of 191 counseling sessions with summaries focused on 3 distinct counseling components (also known as counseling aspects). Next, we assessed the capabilities of 11 state-of-the-art LLMs in addressing the task of counseling-component–guided summarization. The generated summaries were evaluated quantitatively using standard summarization metrics and verified qualitatively by mental health professionals. RESULTS Our findings demonstrated the superior performance of task-specific LLMs such as MentalLlama, Mistral, and MentalBART evaluated using standard quantitative metrics such as Recall-Oriented Understudy for Gisting Evaluation (ROUGE)-1, ROUGE-2, ROUGE-L, and Bidirectional Encoder Representations from Transformers Score across all aspects of the counseling components. Furthermore, expert evaluation revealed that Mistral superseded both MentalLlama and MentalBART across 6 parameters: affective attitude, burden, ethicality, coherence, opportunity costs, and perceived effectiveness. However, these models exhibit a common weakness in terms of room for improvement in the opportunity costs and perceived effectiveness metrics. CONCLUSIONS While LLMs fine-tuned specifically on mental health domain data display better performance based on automatic evaluation scores, expert assessments indicate that these models are not yet reliable for clinical application. Further refinement and validation are necessary before their implementation in practice.