Mary Beth Kery
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Mary Beth Kery has a total of 13 co-authors. Here are the top co-authors by number of shared publications:
- Fred Hohman
Apple, Seattle, Washington, USA
4 shared publications - Dominik Moritz
Apple, Pittsburgh, Pennsylvania, USA
3 shared publications - Adriana Hilliard
Apple, Cupertino, CA, USA
1 shared publication - Donghao Ren
Apple, Seattle, Washington, USA
1 shared publication - Jeffrey P. Bigham
Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, USA
1 shared publication - Jennifer King Chen
Apple, Seattle, Washington, USA
1 shared publication
Latest Publications
- Open Access
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-24
Policy Maps: Tools for Guiding the Unbounded Space of LLM Behaviors
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-24
Open AccessPolicy Maps: Tools for Guiding the Unbounded Space of LLM Behaviors
- Open Access
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-18
Model Compression in Practice: Lessons Learned from Practitioners Creating On-device Machine Learning Experiences
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-18
Open AccessModel Compression in Practice: Lessons Learned from Practitioners Creating On-device Machine Learning Experiences
- Open Access
- 19 June 2023
- Published by Association for Computing Machinery (ACM)
- p. 40-51
Collaborative Machine Learning Model Building with Families Using Co-ML
Existing novice-friendly machine learning (ML) modeling tools center around a solo user experience, where a single user collects only their own data to build a model. However, solo modeling experiences limit valuable opportunities for encountering alternative ideas and approaches that can arise when learners work together; consequently, it often precludes encountering critical issues in ML around data representation and diversity that can surface when different perspectives are manifested in a group-constructed data set. To address this issue, we created Co-ML – a tablet-based app for learners to collaboratively build ML image classifiers through an end-to-end, iterative model-building process. In this paper, we illustrate the feasibility and potential richness of collaborative modeling by presenting an in-depth case study of a family (two children 11 and 14-years-old working with their parents) using Co-ML in a facilitated introductory ML activity at home. We share the Co-ML system design and contribute a discussion of how using Co-ML in a collaborative activity enabled beginners to collectively engage with dataset design considerations underrepresented in prior work such as data diversity, class imbalance, and data quality. We discuss how a distributed collaborative process, in which individuals can take on different model-building responsibilities, provides a rich context for children and adults to learn ML dataset design.
- 19 June 2023
- Published by Association for Computing Machinery (ACM)
- p. 40-51
Open AccessCollaborative Machine Learning Model Building with Families Using Co-ML
Existing novice-friendly machine learning (ML) modeling tools center around a solo user experience, where a single user collects only their own data to build a model. However, solo modeling experiences limit valuable opportunities for encountering alternative ideas and approaches that can arise when learners work together; consequently, it often precludes encountering critical issues in ML around data representation and diversity that can surface when different perspectives are manifested in a group-constructed data set. To address this issue, we created Co-ML – a tablet-based app for learners to collaboratively build ML image classifiers through an end-to-end, iterative model-building process. In this paper, we illustrate the feasibility and potential richness of collaborative modeling by presenting an in-depth case study of a family (two children 11 and 14-years-old working with their parents) using Co-ML in a facilitated introductory ML activity at home. We share the Co-ML system design and contribute a discussion of how using Co-ML in a collaborative activity enabled beginners to collectively engage with dataset design considerations underrepresented in prior work such as data diversity, class imbalance, and data quality. We discuss how a distributed collaborative process, in which individuals can take on different model-building responsibilities, provides a rich context for children and adults to learn ML dataset design.
- Top Cited PapersOpen Access
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-20
Angler: Helping Machine Translation Practitioners Prioritize Model Improvements
Machine learning (ML) models can fail in unexpected ways in the real world, but not all model failures are equal. With finite time and resources, ML practitioners are forced to prioritize their model debugging and improvement efforts. Through interviews with 13 ML practitioners at Apple, we found that practitioners construct small targeted test sets to estimate an error’s nature, scope, and impact on users. We built on this insight in a case study with machine translation models, and developed Angler, an interactive visual analytics tool to help practitioners prioritize model improvements. In a user study with 7 machine translation experts, we used Angler to understand prioritization practices when the input space is infinite, and obtaining reliable signals of model quality is expensive. Our study revealed that participants could form more interesting and user-focused hypotheses for prioritization by analyzing quantitative summary statistics and qualitatively assessing data by reading sentences.
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-20
Top Cited PapersOpen AccessAngler: Helping Machine Translation Practitioners Prioritize Model Improvements
Machine learning (ML) models can fail in unexpected ways in the real world, but not all model failures are equal. With finite time and resources, ML practitioners are forced to prioritize their model debugging and improvement efforts. Through interviews with 13 ML practitioners at Apple, we found that practitioners construct small targeted test sets to estimate an error’s nature, scope, and impact on users. We built on this insight in a case study with machine translation models, and developed Angler, an interactive visual analytics tool to help practitioners prioritize model improvements. In a user study with 7 machine translation experts, we used Angler to understand prioritization practices when the input space is infinite, and obtaining reliable signals of model quality is expensive. Our study revealed that participants could form more interesting and user-focused hypotheses for prioritization by analyzing quantitative summary statistics and qualitatively assessing data by reading sentences.