SOSteve Oney

Steve Oney

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Steve Oney has a total of 26 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Editrail: Understanding AI Usage by Visualizing Student-AI Interaction in Code

    by Ashley Ge Zhang, Yan-Ru Jhou, Yinuo Yang, Shamita Rao, Maryam Arab, Yan Chen, Steve Oney


  • Open Access

    CodeStream: Augmenting Timelines with Code Annotation for Navigating Large Coding Histories

    by Ashley Ge Zhang, Yan-Ru Jhou, Yinuo Yang, Shamita Rao, Maryam Arab, Yan Chen, Steve Oney

    Code edit histories can offer instructors valuable insight into students’ problem-solving processes, revealing unproductive behaviors that final code alone cannot capture. For example, a correct solution may contain large copy-and-pasted segments (suggesting the code originated elsewhere) or unguided trial-and-error (suggesting a lack of clear strategy). Timelines are a common way to visualize code histories, but existing timeline visualizations of code or document histories show only when and where edits occurred, not what changed. Without this context, it is difficult to answer key questions about how students invested effort or to infer their intentions. We present CodeStream, a visualization system that augments timelines with situational code annotations, whose granularity and visibility dynamically adapt to scale and interaction state. A comparison study shows that CodeStream enables context-aware navigation of coding histories, supporting fast and accurate pattern identification, and helping instructors reason about students’ coding behaviors and identify who may need intervention.


  • Open Access

    Multi-Click: Cross-Tab Web Automation via Action Generalization

    by Jiacheng Zhang, Jiawen Li, Maryam Arab, Steve Oney


  • Top Cited Papers
    Open Access

    VRCopilot: Authoring 3D Layouts with Generative AI Models in VR

    by Lei Zhang, Jin Pan, Jacob Gettig, Steve Oney, Anhong Guo

    Immersive authoring provides an intuitive medium for users to create 3D scenes via direct manipulation in Virtual Reality (VR). Recent advances in generative AI have enabled the automatic creation of realistic 3D layouts. However, it is unclear how capabilities of generative AI can be used in immersive authoring to support fluid interactions, user agency, and creativity. We introduce VRCopilot, a mixed-initiative system that integrates pre-trained generative AI models into immersive authoring to facilitate human-AI co-creation in VR. VRCopilot presents multimodal interactions to support rapid prototyping and iterations with AI, and intermediate representations such as wireframes to augment user controllability over the created content. Through a series of user studies, we evaluated the potential and challenges in manual, scaffolded, and automatic creation in immersive authoring. We found that scaffolded creation using wireframes enhanced the user agency compared to automatic creation. We also found that manual creation via multimodal specification offers the highest sense of creativity and agency.


  • Open Access

    CFlow: Supporting Semantic Flow Analysis of Students' Code in Programming Problems at Scale

    by Ashley Ge Zhang, Xiaohang Tang, Steve Oney, Yan Chen

    Introductory programming courses have been growing rapidly, now enrolling hundreds or thousands of students. In such large courses, it can be overwhelmingly difficult for instructors to understand class-wide problem-solving patterns or issues, which is crucial for improving instruction and addressing important pedagogical challenges. In this paper, we propose a technique and system, CFlow, for creating understandable and navigable representations of code at scale. CFlow is able to represent thousands of code samples in a visualization that resembles a single code sample. CFlow creates scalable code representations by (1) clustering individual statements with similar semantic purposes, (2) presenting clustered statements in a way that maintains semantic relationships between statements, (3) representing the correctness of different variations as a histogram, and (4) allowing users to navigate through solutions interactively using semantic filters. With a multi-level view design, users can navigate high-level patterns, and low-level implementations. This is in contrast to prior tools that either limit their focus on isolated statements (and thus discard the surrounding context of those statements) or cluster entire code samples (which can lead to large numbers of clusters---for example, if there are n code features and m implementations of each, there can be mn clusters). We evaluated the effectiveness of CFlow with a comparison study, found participants using CFlow spent only half the time identifying mistakes and recalled twice as many desired patterns from over 6,000 submissions.


  • Open Access

    VizCode: A Practical Real-time Tool for In-Class Computer Programming Tutoring

    by Yinuo Yang, Steve Oney

    Prior research has shown the benefits and promise of allowing instructors in large programming classes to monitor students' coding activity in real-time. However, translating these findings into practical, user-friendly tools remains a challenge. This demonstration showcases VizCode, a tool that allows instructors to monitor students' code in real-time as they edit in the popular Visual Studio Code (VSCode) IDE. VizCode is designed to be practical (integrating with widely-used tools and requiring minimal server overhead), scalable (minimizing network latency by only communicating code changes), and easy to use (requiring minimal setup from students). By focusing on practicality and seamless integration with VSCode, VizCode bridges the gap between research and practice, making it easier for instructors to monitor students' code in real-time.


  • Open Access

    Demonstration of CFlow: Supporting Semantic Flow Analysis of Students' Code in Programming Problems at Scale

    by Ashley Ge Zhang, Xiaohang Tang, Steve Oney, Yan Chen

    Introductory programming courses have been growing rapidly, now enrolling hundreds or thousands of students. In such large courses, it can be overwhelmingly difficult for instructors to understand class-wide problem-solving patterns or issues, which is crucial for improving instruction and addressing important pedagogical challenges. In this paper, we propose a technique and system, CFlow, for creating understandable and navigable representations of code at scale. CFlow is able to represent thousands of code samples in a visualization that resembles a single code sample. CFlow creates scalable code representations by (1) clustering individual statements with similar semantic purposes, (2) presenting clustered statements in a way that maintains semantic relationships between statements, (3) representing the correctness of different variations as a histogram, and (4) allowing users to navigate through solutions interactively using semantic filters. With a multi-level view design, users can navigate high-level patterns, and low-level implementations. This is in contrast to prior tools that either limit their focus on isolated statements (and thus discard the surrounding context of those statements) or cluster entire code samples (which can lead to large numbers of clusters---for example, if there are n code features and m implementations of each, there can be m^n clusters).

  • Open Access

    Improving Advising Relationships Between PhD Students and Faculty in Human-Computer Interaction

    by Jane Im, Himanshu Zade, Steve Oney, Pamela Wisniewski, Kentaro Toyama

    Advisor-advisee relationships between PhD students and faculty are vital to research, but advising dynamics can be challenging for both student and advisor. Though advising can involve egregious problems such as sexual harassment, we focus on what might be less serious but more common issues such as exploitation, unprofessional behavior, mishandling of credit, and inadequate communication. While problems can be caused by advisor or advisee, the power imbalance exacerbates problems for PhD students. In any case, open discussion about PhD advising is rare. In this panel, we hope to start a much-needed conversation about PhD advising to raise awareness within the SIGCHI community about common advising problems; and to begin brainstorming solutions that faculty, administrators, and PhD students can implement.