Jiaju Ma
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
Jiaju Ma has a total of 38 co-authors. Here are the top co-authors by number of shared publications:
- Anyi Rao
The Hong Kong University of Science and Technology, Hong Kong Sar, China
3 shared publications - Maneesh Agrawala
Stanford University, Stanford, USA and Roblox, San Mateo, USA
3 shared publications - Asya Lyubavina
Pomona College, Claremont, California, USA
2 shared publications - Catherine Liu
Claremont McKenna College, Claremont, California, USA
2 shared publications - Chau Vu
Pomona College, Claremont, California, USA
2 shared publications - Jiahao Nick Li
University of California, Los Angeles, Los Angeles, California, USA
2 shared publications
Latest Publications
- Open Access
- 19 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-2
AI for Creative Visual Content Generation, Editing and Understanding
- 19 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-2
Open AccessAI for Creative Visual Content Generation, Editing and Understanding
- Open Access
- 13 June 2026
- Published by Association for Computing Machinery (ACM)
- p. 2054-2070
Artistic Practice Opportunities in CST Evaluations: A Longitudinal Group Deployment of ArtKrit
Creativity support tools (CSTs) aim to elevate the quality of artists’ creative processes and artifacts. Yet most current CST evaluations overlook temporal and social aspects of tool use. To address this gap, we present a longitudinal, group-based CST evaluation through a three-week deployment of ArtKrit, a computational drawing tool that supports disciplined drawing. Nine digital artists, organized into three communities of practice, completed weekly “master studies” alongside a researcher-artist. Our results show users’ evolving relationships with ArtKrit over time—from early experimentation to selective incorporation or misuse—alongside changes in their ways of artistic seeing. These changes unfolded within artist support networks that fostered confidence and creative safety, and validated individual expression. Overall, our findings suggest that CST evaluations can—and should—be designed as opportunities for meaningful artistic engagement rather than purely extractive measurement exercises. We contribute this longitudinal, group-based approach as one CST evaluation method.
- 13 June 2026
- Published by Association for Computing Machinery (ACM)
- p. 2054-2070
Open AccessArtistic Practice Opportunities in CST Evaluations: A Longitudinal Group Deployment of ArtKrit
Creativity support tools (CSTs) aim to elevate the quality of artists’ creative processes and artifacts. Yet most current CST evaluations overlook temporal and social aspects of tool use. To address this gap, we present a longitudinal, group-based CST evaluation through a three-week deployment of ArtKrit, a computational drawing tool that supports disciplined drawing. Nine digital artists, organized into three communities of practice, completed weekly “master studies” alongside a researcher-artist. Our results show users’ evolving relationships with ArtKrit over time—from early experimentation to selective incorporation or misuse—alongside changes in their ways of artistic seeing. These changes unfolded within artist support networks that fostered confidence and creative safety, and validated individual expression. Overall, our findings suggest that CST evaluations can—and should—be designed as opportunities for meaningful artistic engagement rather than purely extractive measurement exercises. We contribute this longitudinal, group-based approach as one CST evaluation method.
- Top Cited PapersOpen Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-18
Collaposer: Transforming Photo Collections into Visual Assets for Storytelling with Collages
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-18
Top Cited PapersOpen AccessCollaposer: Transforming Photo Collections into Visual Assets for Storytelling with Collages
- Top Cited PapersOpen Access
- 22 March 2026
- Published by Association for Computing Machinery (ACM)
- p. 1496-1513
Script2Screen: Supporting Dialogue-Centric Scriptwriting with Interactive Audiovisual Generation
Scriptwriting has traditionally been text-centric, a modality that only partially conveys the produced audiovisual experience. A formative study with professional writers informed us that connecting textual and audiovisual modalities can aid ideation and iteration, especially for writing dialogues. In this work, we present Script2Screen, an AI-assisted tool that integrates scriptwriting with audiovisual scene creation in a unified, synchronized workflow. Focusing on dialogues in scripts, Script2Screen generates expressive scenes with emotional speeches and animated characters through a novel text-to-audiovisual-scene pipeline. The user interface provides fine-grained controls, allowing writers to fine-tune audiovisual elements such as character gestures, speech emotions, and camera angles. A user study with both novice and professional writers from various domains demonstrated that Script2Screen’s interactive audiovisual generation enhances the scriptwriting process, facilitating iterative refinement while complementing - rather than replacing - their creative efforts.
- 22 March 2026
- Published by Association for Computing Machinery (ACM)
- p. 1496-1513
Top Cited PapersOpen AccessScript2Screen: Supporting Dialogue-Centric Scriptwriting with Interactive Audiovisual Generation
Scriptwriting has traditionally been text-centric, a modality that only partially conveys the produced audiovisual experience. A formative study with professional writers informed us that connecting textual and audiovisual modalities can aid ideation and iteration, especially for writing dialogues. In this work, we present Script2Screen, an AI-assisted tool that integrates scriptwriting with audiovisual scene creation in a unified, synchronized workflow. Focusing on dialogues in scripts, Script2Screen generates expressive scenes with emotional speeches and animated characters through a novel text-to-audiovisual-scene pipeline. The user interface provides fine-grained controls, allowing writers to fine-tune audiovisual elements such as character gestures, speech emotions, and camera angles. A user study with both novice and professional writers from various domains demonstrated that Script2Screen’s interactive audiovisual generation enhances the scriptwriting process, facilitating iterative refinement while complementing - rather than replacing - their creative efforts.
- Open Access
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Computational Scaffolding of Composition, Value, and Color for Disciplined Drawing
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Open AccessComputational Scaffolding of Composition, Value, and Color for Disciplined Drawing
- Open Access
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-18
AmbigChat: Interactive Hierarchical Clarification for Ambiguous Open-Domain Question Answering
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-18
Open AccessAmbigChat: Interactive Hierarchical Clarification for Ambiguous Open-Domain Question Answering
- Open Access
- 27 July 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 44 (4) , 1-17
MoVer: Motion Verification for Motion Graphics Animations
While large vision-language models can generate motion graphics animations from text prompts, they regularly fail to include all spatio-temporal properties described in the prompt. We introduce MoVer, a motion verification DSL based on first-order logic that can check spatio-temporal properties of a motion graphics animation. We identify a general set of such properties that people commonly use to describe animations (e.g., the direction and timing of motions, the relative positioning of objects, etc.). We implement these properties as predicates in MoVer and provide an execution engine that can apply a MoVer program to any input SVG-based motion graphics animation. We then demonstrate how MoVer can be used in an LLM-based synthesis and verification pipeline for iteratively refining motion graphics animations. Given a text prompt, our pipeline synthesizes a motion graphics animation and a corresponding MoVer program. Executing the verification program on the animation yields a report of the predicates that failed and the report can be automatically fed back to LLM to iteratively correct the animation. To evaluate our pipeline, we build a synthetic dataset of 5600 text prompts paired with ground truth MoVer verification programs. We find that while our LLM-based pipeline is able to automatically generate a correct motion graphics animation for 58.8% of the test prompts without any iteration, this number raises to 93.6% with up to 50 correction iterations. Our code and dataset are at https://mover-dsl.github.io.
- 27 July 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 44 (4) , 1-17
Open AccessMoVer: Motion Verification for Motion Graphics Animations
While large vision-language models can generate motion graphics animations from text prompts, they regularly fail to include all spatio-temporal properties described in the prompt. We introduce MoVer, a motion verification DSL based on first-order logic that can check spatio-temporal properties of a motion graphics animation. We identify a general set of such properties that people commonly use to describe animations (e.g., the direction and timing of motions, the relative positioning of objects, etc.). We implement these properties as predicates in MoVer and provide an execution engine that can apply a MoVer program to any input SVG-based motion graphics animation. We then demonstrate how MoVer can be used in an LLM-based synthesis and verification pipeline for iteratively refining motion graphics animations. Given a text prompt, our pipeline synthesizes a motion graphics animation and a corresponding MoVer program. Executing the verification program on the animation yields a report of the predicates that failed and the report can be automatically fed back to LLM to iteratively correct the animation. To evaluate our pipeline, we build a synthetic dataset of 5600 text prompts paired with ground truth MoVer verification programs. We find that while our LLM-based pipeline is able to automatically generate a correct motion graphics animation for 58.8% of the test prompts without any iteration, this number raises to 93.6% with up to 50 correction iterations. Our code and dataset are at https://mover-dsl.github.io.
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-20
OmniQuery: Contextually Augmenting Captured Multimodal Memories to Enable Personal Question Answering
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-20
Open AccessOmniQuery: Contextually Augmenting Captured Multimodal Memories to Enable Personal Question Answering
- Open Access
- 13 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-3
OmniQuery: Enabling Question Answering on Personal Memory by Augmenting Multimodal Album Data
We present OmniQuery, an interactive system that augments users’ personal photo albums and enables free-form question answering on users’ past memories. OmniQuery processes multimodal media data in personal albums, aggregates them into related episodic memory databases in different levels, and infers semantic knowledge including personal facts like social relationships, preferences, and experiences. OmniQuery then allows users to interact with their database using natural language, giving media that directly matches the query or an exact answer supported by related media as a result.
- 13 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-3
Open AccessOmniQuery: Enabling Question Answering on Personal Memory by Augmenting Multimodal Album Data
We present OmniQuery, an interactive system that augments users’ personal photo albums and enables free-form question answering on users’ past memories. OmniQuery processes multimodal media data in personal albums, aggregates them into related episodic memory databases in different levels, and infers semantic knowledge including personal facts like social relationships, preferences, and experiences. OmniQuery then allows users to interact with their database using natural language, giving media that directly matches the query or an exact answer supported by related media as a result.
- Open Access
- 5 December 2023
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 42 (6) , 1-13
Editing Motion Graphics Video via Motion Vectorization and Transformation
Motion graphics videos are widely used in Web design, digital advertising, animated logos and film title sequences, to capture a viewer's attention. But editing such video is challenging because the video provides a low-level sequence of pixels and frames rather than higher-level structure such as the objects in the video with their corresponding motions and occlusions. We present a motion vectorization pipeline for converting motion graphics video into an SVG motion program that provides such structure. The resulting SVG program can be rendered using any SVG renderer (e.g. most Web browsers) and edited using any SVG editor. We also introduce a program transformation API that facilitates editing of a SVG motion program to create variations that adjust the timing, motions and/or appearances of objects. We show how the API can be used to create a variety of effects including retiming object motion to match a music beat, adding motion textures to objects, and collision preserving appearance changes.
- 5 December 2023
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 42 (6) , 1-13
Open AccessEditing Motion Graphics Video via Motion Vectorization and Transformation
Motion graphics videos are widely used in Web design, digital advertising, animated logos and film title sequences, to capture a viewer's attention. But editing such video is challenging because the video provides a low-level sequence of pixels and frames rather than higher-level structure such as the objects in the video with their corresponding motions and occlusions. We present a motion vectorization pipeline for converting motion graphics video into an SVG motion program that provides such structure. The resulting SVG program can be rendered using any SVG renderer (e.g. most Web browsers) and edited using any SVG editor. We also introduce a program transformation API that facilitates editing of a SVG motion program to create variations that adjust the timing, motions and/or appearances of objects. We show how the API can be used to create a variety of effects including retiming object motion to match a music beat, adding motion textures to objects, and collision preserving appearance changes.