Christine Lisetti
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Christine Lisetti has a total of 64 co-authors. Here are the top co-authors by number of shared publications:
- Maya Boustani
Loma Linda University
4 shared publications - Ubbo Visser
University of Miami, USA
4 shared publications - Chen Chen
Florida International University, Miami, USA
3 shared publications - Lingyao Li
University of South Florida
3 shared publications - Renkai Ma
School of Information Technology, University of Cincinnati, Cincinnati, Ohio, USA
3 shared publications - Shaoze Zhou
Florida International University, Miami, USA
3 shared publications
Latest Publications
- Open Access
- 2 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-19
ChatMuse: Supporting In-Person Small-Group Conversation Experience with a Proactive Assistive AI Agent in Mixed Reality
- 2 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-19
Open AccessChatMuse: Supporting In-Person Small-Group Conversation Experience with a Proactive Assistive AI Agent in Mixed Reality
- Open Access
- 16 May 2026
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Computer-Human Interaction
Virtual Counselor Extenders: Social Cue Taxonomy, Soft Rooms, and Brief Motivational Interviewing
To address behavioral health shortages, we propose virtual counselor extenders: socially interactive virtual health agents (VHAs) that operationalize evidence-based interventions to expand clinicians’ reach and mitigate barriers to access for stigmatized populations. Current VHAs often lack systematic therapeutic communication and evidence-based environmental design. We present five contributions: (1) the implementation of a complete Brief Motivational Interviewing (BMI) intervention for heavy-drinking adults; (2) the application of a social cue taxonomy to systematically document multimodal active listening behaviors; (3) the design of a therapeutic ”soft room” grounded in environmental psychology; (4) a quantitative evaluation of usability and engagement with the target population; and (5) a qualitative thematic analysis of user acceptance regarding agent demographics and environmental realism. We conclude by extending the taxonomy with therapeutic-specific cues and providing design recommendations for future virtual counseling systems. This work demonstrates that autonomous agents can deliver complex therapeutic interventions while maintaining high user acceptance.
- 16 May 2026
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Computer-Human Interaction
Open AccessVirtual Counselor Extenders: Social Cue Taxonomy, Soft Rooms, and Brief Motivational Interviewing
To address behavioral health shortages, we propose virtual counselor extenders: socially interactive virtual health agents (VHAs) that operationalize evidence-based interventions to expand clinicians’ reach and mitigate barriers to access for stigmatized populations. Current VHAs often lack systematic therapeutic communication and evidence-based environmental design. We present five contributions: (1) the implementation of a complete Brief Motivational Interviewing (BMI) intervention for heavy-drinking adults; (2) the application of a social cue taxonomy to systematically document multimodal active listening behaviors; (3) the design of a therapeutic ”soft room” grounded in environmental psychology; (4) a quantitative evaluation of usability and engagement with the target population; and (5) a qualitative thematic analysis of user acceptance regarding agent demographics and environmental realism. We conclude by extending the taxonomy with therapeutic-specific cues and providing design recommendations for future virtual counseling systems. This work demonstrates that autonomous agents can deliver complex therapeutic interventions while maintaining high user acceptance.
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Exploring Needs and Design Opportunities for Proactive Information Support in In-Person Small-Group Conversations
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessExploring Needs and Design Opportunities for Proactive Information Support in In-Person Small-Group Conversations
- Open Access
- 23 March 2026
- Published by Association for Computing Machinery (ACM)
- p. 22-29
Aurora: Neuro-Symbolic AI Driven Advising Agent
Academic advising in higher education is under severe strain, with advisor-to-student ratios commonly exceeding 300:1. These structural bottlenecks limit timely access to guidance, increase the risk of delayed graduation, and contribute to inequities in student support. We introduce Aurora, a modular neuro-symbolic advising agent that unifies retrieval-augmented generation (RAG), symbolic reasoning, and normalized curricular databases to deliver policy-compliant, verifiable recommendations at scale. Aurora integrates three components: (i) a Boyce-Codd Normal Form (BCNF) catalog schema for consistent program rules, (ii) a Prolog engine for prerequisite and credit enforcement, and (iii) an instruction-tuned large language model for natural-language explanations of its recommendations. To assess performance, we design a structured evaluation suite spanning common and edge-case advising scenarios, including short-term scheduling, long-term roadmapping, skill-aligned pathways, and out-of-scope requests. Across this diverse set, Aurora improves semantic alignment with expert-crafted answers from 0.68 (Raw LLM baseline) to 0.93 (+36%), achieves perfect precision and recall in nearly half of in-scope cases, and consistently produces correct fallbacks for unanswerable prompts. On commodity hardware, Aurora averages 32.99 s per query (vs. 20.13 s for the Raw-LLM baseline), reflecting the runtime overhead of neuro-symbolic grounding. By combining symbolic rigor with neural fluency, Aurora advances a paradigm for accurate, explainable, and scalable AI-driven advising.
- 23 March 2026
- Published by Association for Computing Machinery (ACM)
- p. 22-29
Open AccessAurora: Neuro-Symbolic AI Driven Advising Agent
Academic advising in higher education is under severe strain, with advisor-to-student ratios commonly exceeding 300:1. These structural bottlenecks limit timely access to guidance, increase the risk of delayed graduation, and contribute to inequities in student support. We introduce Aurora, a modular neuro-symbolic advising agent that unifies retrieval-augmented generation (RAG), symbolic reasoning, and normalized curricular databases to deliver policy-compliant, verifiable recommendations at scale. Aurora integrates three components: (i) a Boyce-Codd Normal Form (BCNF) catalog schema for consistent program rules, (ii) a Prolog engine for prerequisite and credit enforcement, and (iii) an instruction-tuned large language model for natural-language explanations of its recommendations. To assess performance, we design a structured evaluation suite spanning common and edge-case advising scenarios, including short-term scheduling, long-term roadmapping, skill-aligned pathways, and out-of-scope requests. Across this diverse set, Aurora improves semantic alignment with expert-crafted answers from 0.68 (Raw LLM baseline) to 0.93 (+36%), achieves perfect precision and recall in nearly half of in-scope cases, and consistently produces correct fallbacks for unanswerable prompts. On commodity hardware, Aurora averages 32.99 s per query (vs. 20.13 s for the Raw-LLM baseline), reflecting the runtime overhead of neuro-symbolic grounding. By combining symbolic rigor with neural fluency, Aurora advances a paradigm for accurate, explainable, and scalable AI-driven advising.
- Open Access
Exploring Needs and Design Opportunities for Proactive Information Support in In-Person Small-Group Conversations
In-person small-group conversations play a crucial role in everyday life; however, facilitating effective group interaction can be challenging, as the real-time nature demands full attention, offers no opportunity for revision, and requires interpreting non-verbal cues. Using Mixed Reality to provide proactive information support shows promise in helping individuals engage in and contribute to group conversations. We present a preliminary participatory design and qualitative study (N = 10) using focus groups and two technology probes to explore the opportunities of designing proactive information support in in-person small-group conversations. We reveal key design opportunities concerning how to maximize the benefits of proactive information support and how to effectively design such supporting information. Our study is crucial for paving the way toward designing future proactive AI agents to enable the paradigm of augmented in-person small-group conversation experience.
Open AccessExploring Needs and Design Opportunities for Proactive Information Support in In-Person Small-Group Conversations
In-person small-group conversations play a crucial role in everyday life; however, facilitating effective group interaction can be challenging, as the real-time nature demands full attention, offers no opportunity for revision, and requires interpreting non-verbal cues. Using Mixed Reality to provide proactive information support shows promise in helping individuals engage in and contribute to group conversations. We present a preliminary participatory design and qualitative study (N = 10) using focus groups and two technology probes to explore the opportunities of designing proactive information support in in-person small-group conversations. We reveal key design opportunities concerning how to maximize the benefits of proactive information support and how to effectively design such supporting information. Our study is crucial for paving the way toward designing future proactive AI agents to enable the paradigm of augmented in-person small-group conversation experience.
- Open Access
- 4 November 2024
- Published by Association for Computing Machinery (ACM)
- p. 75-77
An LLM-powered Socially Interactive Agent with Adaptive Facial Expressions for Conversing about Health
Virtual Socially Interactive Agents (SIA) have shown great promise for human interactions with computer applications in which not only domain-relevant content is needed, but also the way in which the content is delivered (e.g. socio-emotionally adaptive tutoring agents, socio-emotionally responsive health agents). While recent progress on Large Language Models (LLMs) has made rich verbal interactions possible, LLMs cannot communicate nonverbal social cues through a simple text-based interface. We propose an expressive conversational SIA system, powered by an OpenAI Large Language Model (LLM) for text generation, integrated with a 3D humanoid model with real-time behavior generation of FACS-based facial expressions that mirror the user’s to increase rapport and engagement using HumeAI’s Facial Expression Recognition and Empathic Voice Interface (EVI) models to drive the model’s animations. As a case study, we use prompt-engineering to focus the conversation on discussing health-related behaviors. We ground the generation of the LLM’s questions based on the World Health Organization’s (WHO) Alcohol Use Disorders Identification Test (AUDIT) 10-question inventory, a test that help identify whether someone is at risk of alcohol use disorder.
- 4 November 2024
- Published by Association for Computing Machinery (ACM)
- p. 75-77
Open AccessAn LLM-powered Socially Interactive Agent with Adaptive Facial Expressions for Conversing about Health
Virtual Socially Interactive Agents (SIA) have shown great promise for human interactions with computer applications in which not only domain-relevant content is needed, but also the way in which the content is delivered (e.g. socio-emotionally adaptive tutoring agents, socio-emotionally responsive health agents). While recent progress on Large Language Models (LLMs) has made rich verbal interactions possible, LLMs cannot communicate nonverbal social cues through a simple text-based interface. We propose an expressive conversational SIA system, powered by an OpenAI Large Language Model (LLM) for text generation, integrated with a 3D humanoid model with real-time behavior generation of FACS-based facial expressions that mirror the user’s to increase rapport and engagement using HumeAI’s Facial Expression Recognition and Empathic Voice Interface (EVI) models to drive the model’s animations. As a case study, we use prompt-engineering to focus the conversation on discussing health-related behaviors. We ground the generation of the LLM’s questions based on the World Health Organization’s (WHO) Alcohol Use Disorders Identification Test (AUDIT) 10-question inventory, a test that help identify whether someone is at risk of alcohol use disorder.
- 14 March 2024
- Published by Springer Nature
- p. 42-53
3D Multimodal Socially Interactive Robot with ChatGPT Active Listening
- 14 March 2024
- Published by Springer Nature
- p. 42-53
3D Multimodal Socially Interactive Robot with ChatGPT Active Listening
- 25 October 2022
- Published by Elsevier in Journal of School Psychology
- Vol. 95, 121-138
Bridging simulation technology with positive behavioral supports to promote student engagement and behavior
- 25 October 2022
- Published by Elsevier in Journal of School Psychology
- Vol. 95, 121-138
Bridging simulation technology with positive behavioral supports to promote student engagement and behavior
- Open Access
- 29 September 2021
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 23 (9) , e25837
Development, Feasibility, Acceptability, and Utility of an Expressive Speech-Enabled Digital Health Agent to Deliver Online, Brief Motivational Interviewing for Alcohol Misuse: Descriptive Study
Background: Digital health agents — embodied conversational agents designed specifically for health interventions — provide a promising alternative or supplement to behavioral health services by reducing barriers to access to care. Objective: Our goals were to (1) develop an expressive, speech-enabled digital health agent operating in a 3-dimensional virtual environment to deliver a brief behavioral health intervention over the internet to reduce alcohol use and to (2) understand its acceptability, feasibility, and utility with its end users. Methods: We developed an expressive, speech-enabled digital health agent with facial expressions and body gestures operating in a 3-dimensional virtual office and able to deliver a brief behavioral health intervention over the internet to reduce alcohol use. We then asked 51 alcohol users to report on the digital health agent acceptability, feasibility, and utility. Results: The developed digital health agent uses speech recognition and a model of empathetic verbal and nonverbal behaviors to engage the user, and its performance enabled it to successfully deliver a brief behavioral health intervention over the internet to reduce alcohol use. Descriptive statistics indicated that participants had overwhelmingly positive experiences with the digital health agent, including engagement with the technology, acceptance, perceived utility, and intent to use the technology. Illustrative qualitative quotes provided further insight about the potential reach and impact of digital health agents in behavioral health care. Conclusions: Web-delivered interventions delivered by expressive, speech-enabled digital health agents may provide an exciting complement or alternative to traditional one-on-one treatment. They may be especially helpful for hard-to-reach communities with behavioral workforce shortages.
- 29 September 2021
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 23 (9) , e25837
Open AccessDevelopment, Feasibility, Acceptability, and Utility of an Expressive Speech-Enabled Digital Health Agent to Deliver Online, Brief Motivational Interviewing for Alcohol Misuse: Descriptive Study
Background: Digital health agents — embodied conversational agents designed specifically for health interventions — provide a promising alternative or supplement to behavioral health services by reducing barriers to access to care. Objective: Our goals were to (1) develop an expressive, speech-enabled digital health agent operating in a 3-dimensional virtual environment to deliver a brief behavioral health intervention over the internet to reduce alcohol use and to (2) understand its acceptability, feasibility, and utility with its end users. Methods: We developed an expressive, speech-enabled digital health agent with facial expressions and body gestures operating in a 3-dimensional virtual office and able to deliver a brief behavioral health intervention over the internet to reduce alcohol use. We then asked 51 alcohol users to report on the digital health agent acceptability, feasibility, and utility. Results: The developed digital health agent uses speech recognition and a model of empathetic verbal and nonverbal behaviors to engage the user, and its performance enabled it to successfully deliver a brief behavioral health intervention over the internet to reduce alcohol use. Descriptive statistics indicated that participants had overwhelmingly positive experiences with the digital health agent, including engagement with the technology, acceptance, perceived utility, and intent to use the technology. Illustrative qualitative quotes provided further insight about the potential reach and impact of digital health agents in behavioral health care. Conclusions: Web-delivered interventions delivered by expressive, speech-enabled digital health agents may provide an exciting complement or alternative to traditional one-on-one treatment. They may be especially helpful for hard-to-reach communities with behavioral workforce shortages.