Ingrid Zukerman
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Ingrid Zukerman has a total of 127 co-authors. Here are the top co-authors by number of shared publications:
Sarah George
Monash University
15 shared publications- David Albrecht
Monash University, Melbourne, VIC, Australia
14 shared publications Fabian Bohnert
Monash University
13 shared publications- Michael Niemann
Monash University
13 shared publications - Ann E. Nicholson
Faculty of Information Technology, Monash University, Melbourne, Australia
7 shared publications Bhavani Raskutti
Telstra Research Laboratories
6 shared publications
Latest Publications
- Open Access
Supporting Multimodal Data Interaction on Refreshable Tactile Displays: An Architecture to Combine Touch and Conversational AI
Combining conversational AI with refreshable tactile displays (RTDs) offers significant potential for creating accessible data visualization for people who are blind or have low vision (BLV). To support researchers and developers building accessible data visualizations with RTDs, we present a multimodal data interaction architecture along with an open-source reference implementation. Our system is the first to combine touch input with a conversational agent on an RTD, enabling deictic queries that fuse touch context with spoken language, such as "what is the trend between these points?" The architecture addresses key technical challenges, including touch sensing on RTDs, visual-to-tactile encoding, integrating touch context with conversational AI, and synchronizing multimodal output. Our contributions are twofold: (1) a technical architecture integrating RTD hardware, external touch sensing, and conversational AI to enable multimodal data interaction; and (2) an open-source reference implementation demonstrating its feasibility. This work provides a technical foundation to support future research in multimodal accessible data visualization.
Open AccessSupporting Multimodal Data Interaction on Refreshable Tactile Displays: An Architecture to Combine Touch and Conversational AI
Combining conversational AI with refreshable tactile displays (RTDs) offers significant potential for creating accessible data visualization for people who are blind or have low vision (BLV). To support researchers and developers building accessible data visualizations with RTDs, we present a multimodal data interaction architecture along with an open-source reference implementation. Our system is the first to combine touch input with a conversational agent on an RTD, enabling deictic queries that fuse touch context with spoken language, such as "what is the trend between these points?" The architecture addresses key technical challenges, including touch sensing on RTDs, visual-to-tactile encoding, integrating touch context with conversational AI, and synchronizing multimodal output. Our contributions are twofold: (1) a technical architecture integrating RTD hardware, external touch sensing, and conversational AI to enable multimodal data interaction; and (2) an open-source reference implementation demonstrating its feasibility. This work provides a technical foundation to support future research in multimodal accessible data visualization.
- Open Access
Comparing verbal, visual and combined explanations for Bayesian Network inferences
Bayesian Networks (BNs) are an important tool for assisting probabilistic reasoning, but despite being considered transparent models, people have trouble understanding them. Further, current User Interfaces (UIs) still do not clarify the reasoning of BNs. To address this problem, we have designed verbal and visual extensions to the standard BN UI, which can guide users through common inference patterns. We conducted a user study to compare our verbal, visual and combined UI extensions, and a baseline UI. Our main findings are: (1) users did better with all three types of extensions than with the baseline UI for questions about the impact of an observation, the paths that enable this impact, and the way in which an observation influences the impact of other observations; and (2) using verbal and visual modalities together is better than using either modality alone for some of these question types.
Open AccessComparing verbal, visual and combined explanations for Bayesian Network inferences
Bayesian Networks (BNs) are an important tool for assisting probabilistic reasoning, but despite being considered transparent models, people have trouble understanding them. Further, current User Interfaces (UIs) still do not clarify the reasoning of BNs. To address this problem, we have designed verbal and visual extensions to the standard BN UI, which can guide users through common inference patterns. We conducted a user study to compare our verbal, visual and combined UI extensions, and a baseline UI. Our main findings are: (1) users did better with all three types of extensions than with the baseline UI for questions about the impact of an observation, the paths that enable this impact, and the way in which an observation influences the impact of other observations; and (2) using verbal and visual modalities together is better than using either modality alone for some of these question types.
- Open Access
- 1 January 2025
- Published by Springer Nature
- p. C1
Correction to: Modeling and Detecting Urinary Anomalies in Seniors from Data Obtained by Unintrusive Sensors
- 1 January 2025
- Published by Springer Nature
- p. C1
Open AccessCorrection to: Modeling and Detecting Urinary Anomalies in Seniors from Data Obtained by Unintrusive Sensors
- 1 January 2025
- Published by Springer Nature
- p. 336-344
Modeling and Detecting Urinary Anomalies in Seniors from Data Obtained by Unintrusive Sensors
- 1 January 2025
- Published by Springer Nature
- p. 336-344
Modeling and Detecting Urinary Anomalies in Seniors from Data Obtained by Unintrusive Sensors
- Open Access
A Brief Summary of Explanatory Virtues
In this report, I provide a brief summary of the literature in philosophy, psychology and cognitive science about Explanatory Virtues, and link these concepts to eXplainable AI.
Open AccessA Brief Summary of Explanatory Virtues
In this report, I provide a brief summary of the literature in philosophy, psychology and cognitive science about Explanatory Virtues, and link these concepts to eXplainable AI.
- Open Access
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 30-46
Communicating Uncertainty in Explanations of the Outcomes of Machine Learning Models
Ingrid Zukerman, Sameen Maruf. Proceedings of the 17th International Natural Language Generation Conference. 2024.
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 30-46
Open AccessCommunicating Uncertainty in Explanations of the Outcomes of Machine Learning Models
Ingrid Zukerman, Sameen Maruf. Proceedings of the 17th International Natural Language Generation Conference. 2024.
- Open Access
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 103-120
Generating Simple, Conservative and Unifying Explanations for Logistic Regression Models
Sameen Maruf, Ingrid Zukerman, Xuelin Situ, Cecile Paris, Gholamreza Haffari. Proceedings of the 17th International Natural Language Generation Conference. 2024.
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 103-120
Open AccessGenerating Simple, Conservative and Unifying Explanations for Logistic Regression Models
Sameen Maruf, Ingrid Zukerman, Xuelin Situ, Cecile Paris, Gholamreza Haffari. Proceedings of the 17th International Natural Language Generation Conference. 2024.
- Open Access
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 420-427
Going beyond Imagination! Enhancing Multi-modal Dialogue Agents with Synthetic Visual Descriptions
Haolan Zhan, Sameen Maruf, Ingrid Zukerman, Gholamreza Haffari. Proceedings of the 25th Annual Meeting of the Special Interest Group on Discourse and Dialogue. 2024.
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 420-427
Open AccessGoing beyond Imagination! Enhancing Multi-modal Dialogue Agents with Synthetic Visual Descriptions
Haolan Zhan, Sameen Maruf, Ingrid Zukerman, Gholamreza Haffari. Proceedings of the 25th Annual Meeting of the Special Interest Group on Discourse and Dialogue. 2024.
- Open Access
- 18 July 2023
- Published by Association for Computing Machinery (ACM)
- p. 2712-2722
SocialDial: A Benchmark for Socially-Aware Dialogue Systems
Content Warning: this paper may contain content that is offensive or upsetting. Dialogue systems have been widely applied in many scenarios and are now more powerful and ubiquitous than ever before. With large neural models and massive available data, current dialogue systems have access to more knowledge than any people in their life. However, current dialogue systems still do not perform at a human level. One major gap between conversational agents and humans lies in their abilities to be aware of social norms. The development of socially-aware dialogue systems is impeded due to the lack of resources. In this paper, we present the first socially-aware dialogue corpus -- SocialDial based on Chinese social culture. SocialDial consists of two parts: 1,563 multi-turn dialogues between two human speakers with fine-grained labels, and 4,870 synthetic conversations generated by ChatGPT. The human corpus covers five categories of social norms, which have 14 sub-categories in total. Specifically, it contains social factor annotations including social relation, context, social distance, and social norms. However, collecting sufficient socially-aware dialogues is costly. Thus, we harness the power of ChatGPT and devise an ontology-based synthetic data generation framework. This framework is able to generate synthetic data at scale. To ensure the quality of synthetic dialogues, we design several mechanisms for quality control during data collection. Finally, we evaluate our dataset using several pre-trained models, such as BERT and RoBERTa. Comprehensive empirical results based on state-of-the-art neural models demonstrate that modeling of social norms for dialogue systems is a promising research direction. To the best of our knowledge, SocialDial is the first socially-aware dialogue dataset that covers multiple social factors and has fine-grained labels.
- 18 July 2023
- Published by Association for Computing Machinery (ACM)
- p. 2712-2722
Open AccessSocialDial: A Benchmark for Socially-Aware Dialogue Systems
Content Warning: this paper may contain content that is offensive or upsetting. Dialogue systems have been widely applied in many scenarios and are now more powerful and ubiquitous than ever before. With large neural models and massive available data, current dialogue systems have access to more knowledge than any people in their life. However, current dialogue systems still do not perform at a human level. One major gap between conversational agents and humans lies in their abilities to be aware of social norms. The development of socially-aware dialogue systems is impeded due to the lack of resources. In this paper, we present the first socially-aware dialogue corpus -- SocialDial based on Chinese social culture. SocialDial consists of two parts: 1,563 multi-turn dialogues between two human speakers with fine-grained labels, and 4,870 synthetic conversations generated by ChatGPT. The human corpus covers five categories of social norms, which have 14 sub-categories in total. Specifically, it contains social factor annotations including social relation, context, social distance, and social norms. However, collecting sufficient socially-aware dialogues is costly. Thus, we harness the power of ChatGPT and devise an ontology-based synthetic data generation framework. This framework is able to generate synthetic data at scale. To ensure the quality of synthetic dialogues, we design several mechanisms for quality control during data collection. Finally, we evaluate our dataset using several pre-trained models, such as BERT and RoBERTa. Comprehensive empirical results based on state-of-the-art neural models demonstrate that modeling of social norms for dialogue systems is a promising research direction. To the best of our knowledge, SocialDial is the first socially-aware dialogue dataset that covers multiple social factors and has fine-grained labels.
- Open Access
- 30 March 2023
- Published by Springer Nature in User Modeling and User-Adapted Interaction
- Vol. 33 (5) , 1015-1063
Influence of Device Performance and Agent Advice on User Trust and Behaviour in a Care-taking Scenario
- 30 March 2023
- Published by Springer Nature in User Modeling and User-Adapted Interaction
- Vol. 33 (5) , 1015-1063
Open AccessInfluence of Device Performance and Agent Advice on User Trust and Behaviour in a Care-taking Scenario