Nels Numan
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Nels Numan has a total of 52 co-authors. Here are the top co-authors by number of shared publications:
- Anthony Steed
University College London, U.K.
7 shared publications - Ruofei Du
XR Labs, Google, San Francisco, California, USA
3 shared publications - Andrew David Wilson
Microsoft Research, Redmond, Washington, USA
2 shared publications - Balasaravanan Thoravi Kumaravel
Microsoft Research, United States
2 shared publications - Ben Congdon
Department of Computer Science, University College London, United Kingdom
2 shared publications - Daniele Giunchi
School of Computer Science, University of Birmingham, Birmingham, United Kingdom
2 shared publications
Latest Publications
- Open Access
- 16 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-11
Vibe Coding XR: Accelerating AI + XR Prototyping with XR Blocks and Gemini
- 16 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-11
Open AccessVibe Coding XR: Accelerating AI + XR Prototyping with XR Blocks and Gemini
- Open Access
- 2 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-4
The World as a Canvas: Materializing Imagination through Prompting the Physical World
- 2 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Open AccessThe World as a Canvas: Materializing Imagination through Prompting the Physical World
- 7 April 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 32 (5) , 3657-3667
A Comparative Study of Using Augmented vs Virtual Reality in Collaborative Tasks
Extended Reality (XR) technologies offer many possibilities to support collaboration between remote and local team members. However, in a scenario with multiple devices and multiple interaction options, including virtual, augmented and the continuum of realities among them, it is still unclear how to select the right option to make collaboration more efficient. To provide some design insights in this context, this paper presents a comparative study of collaboration behaviours and outcomes when using different XR technologies, where X stands for Virtual or Augmented. In our experimental setup, pairs of users collaborated on three tasks drawn from visual analytics, each designed to require a different level of synchronization: low, medium, and high. We conducted a study with 40 participants (20 dyads), who performed tasks in two conditions: Augmented Reality (AR) and Virtual Reality (VR). All used the same equipment and interactions; only the immersive environment differed. The results suggest that collaboration outcomes differed only in high-coupling tasks, with AR showing a performance advantage. This may stem from a greater difficulty of synchronizing actions when perceiving a partner through avatars rather than directly. However, no significant differences were observed in collaboration dynamics, and the choice of XR technology did not appear to affect collaboration patterns. These findings suggest that, for collaborative analytical tasks comparable to those in this study, collaborators can choose the XR mode that best fits their preferences and current needs without concern about hindering teamwork.
- 7 April 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 32 (5) , 3657-3667
A Comparative Study of Using Augmented vs Virtual Reality in Collaborative Tasks
Extended Reality (XR) technologies offer many possibilities to support collaboration between remote and local team members. However, in a scenario with multiple devices and multiple interaction options, including virtual, augmented and the continuum of realities among them, it is still unclear how to select the right option to make collaboration more efficient. To provide some design insights in this context, this paper presents a comparative study of collaboration behaviours and outcomes when using different XR technologies, where X stands for Virtual or Augmented. In our experimental setup, pairs of users collaborated on three tasks drawn from visual analytics, each designed to require a different level of synchronization: low, medium, and high. We conducted a study with 40 participants (20 dyads), who performed tasks in two conditions: Augmented Reality (AR) and Virtual Reality (VR). All used the same equipment and interactions; only the immersive environment differed. The results suggest that collaboration outcomes differed only in high-coupling tasks, with AR showing a performance advantage. This may stem from a greater difficulty of synchronizing actions when perceiving a partner through avatars rather than directly. However, no significant differences were observed in collaboration dynamics, and the choice of XR technology did not appear to affect collaboration patterns. These findings suggest that, for collaborative analytical tasks comparable to those in this study, collaborators can choose the XR mode that best fits their preferences and current needs without concern about hindering teamwork.
- Open Access
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-22
Sensible Agent: A Framework for Unobtrusive Interaction with Proactive AR Agents
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-22
Open AccessSensible Agent: A Framework for Unobtrusive Interaction with Proactive AR Agents
- Open Access
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-4
AdjustAR: AI-Driven In-Situ Adjustment of Site-Specific Augmented Reality Content
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Open AccessAdjustAR: AI-Driven In-Situ Adjustment of Site-Specific Augmented Reality Content
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Decoupled Hands: An Approach for Aligning Perspectives in Collaborative Mixed Reality
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessDecoupled Hands: An Approach for Aligning Perspectives in Collaborative Mixed Reality
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-22
CoCreatAR: Enhancing Authoring of Outdoor Augmented Reality Experiences Through Asymmetric Collaboration
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-22
Open AccessCoCreatAR: Enhancing Authoring of Outdoor Augmented Reality Experiences Through Asymmetric Collaboration
- Open Access
- 11 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-25
SpaceBlender: Creating Context-Rich Collaborative Spaces Through Generative 3D Scene Blending
There is increased interest in using generative AI to create 3D spaces for Virtual Reality (VR) applications. However, today’s models produce artificial environments, falling short of supporting collaborative tasks that benefit from incorporating the user’s physical context. To generate environments that support VR telepresence, we introduce SpaceBlender, a novel pipeline that utilizes generative AI techniques to blend users’ physical surroundings into unified virtual spaces. This pipeline transforms user-provided 2D images into context-rich 3D environments through an iterative process consisting of depth estimation, mesh alignment, and diffusion-based space completion guided by geometric priors and adaptive text prompts. In a preliminary within-subjects study, where 20 participants performed a collaborative VR affinity diagramming task in pairs, we compared SpaceBlender with a generic virtual environment and a state-of-the-art scene generation framework, evaluating its ability to create virtual spaces suitable for collaboration. Participants appreciated the enhanced familiarity and context provided by SpaceBlender but also noted complexities in the generative environments that could detract from task focus. Drawing on participant feedback, we propose directions for improving the pipeline and discuss the value and design of blended spaces for different scenarios.
- 11 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-25
Open AccessSpaceBlender: Creating Context-Rich Collaborative Spaces Through Generative 3D Scene Blending
There is increased interest in using generative AI to create 3D spaces for Virtual Reality (VR) applications. However, today’s models produce artificial environments, falling short of supporting collaborative tasks that benefit from incorporating the user’s physical context. To generate environments that support VR telepresence, we introduce SpaceBlender, a novel pipeline that utilizes generative AI techniques to blend users’ physical surroundings into unified virtual spaces. This pipeline transforms user-provided 2D images into context-rich 3D environments through an iterative process consisting of depth estimation, mesh alignment, and diffusion-based space completion guided by geometric priors and adaptive text prompts. In a preliminary within-subjects study, where 20 participants performed a collaborative VR affinity diagramming task in pairs, we compared SpaceBlender with a generic virtual environment and a state-of-the-art scene generation framework, evaluating its ability to create virtual spaces suitable for collaboration. Participants appreciated the enhanced familiarity and context provided by SpaceBlender but also noted complexities in the generative environments that could detract from task focus. Drawing on participant feedback, we propose directions for improving the pipeline and discuss the value and design of blended spaces for different scenarios.
- Open Access
- 11 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-19
BlendScape: Enabling End-User Customization of Video-Conferencing Environments through Generative AI
Today’s video-conferencing tools support a rich range of professional and social activities, but their generic meeting environments cannot be dynamically adapted to align with distributed collaborators’ needs. To enable end-user customization, we developed BlendScape, a rendering and composition system for video-conferencing participants to tailor environments to their meeting context by leveraging AI image generation techniques. BlendScape supports flexible representations of task spaces by blending users’ physical or digital backgrounds into unified environments and implements multimodal interaction techniques to steer the generation. Through an exploratory study with 15 end-users, we investigated whether and how they would find value in using generative AI to customize video-conferencing environments. Participants envisioned using a system like BlendScape to facilitate collaborative activities in the future, but required further controls to mitigate distracting or unrealistic visual elements. We implemented scenarios to demonstrate BlendScape’s expressiveness for supporting environment design strategies from prior work and propose composition techniques to improve the quality of environments.
- 11 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-19
Open AccessBlendScape: Enabling End-User Customization of Video-Conferencing Environments through Generative AI
Today’s video-conferencing tools support a rich range of professional and social activities, but their generic meeting environments cannot be dynamically adapted to align with distributed collaborators’ needs. To enable end-user customization, we developed BlendScape, a rendering and composition system for video-conferencing participants to tailor environments to their meeting context by leveraging AI image generation techniques. BlendScape supports flexible representations of task spaces by blending users’ physical or digital backgrounds into unified environments and implements multimodal interaction techniques to steer the generation. Through an exploratory study with 15 end-users, we investigated whether and how they would find value in using generative AI to customize video-conferencing environments. Participants envisioned using a system like BlendScape to facilitate collaborative activities in the future, but required further controls to mitigate distracting or unrealistic visual elements. We implemented scenarios to demonstrate BlendScape’s expressiveness for supporting environment design strategies from prior work and propose composition techniques to improve the quality of environments.
- Open Access
- 9 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-9
Extending the Open Source Social Virtual Reality Ecosystem to the Browser in Ubiq
Social VR (SVR) systems are VR systems with a common subset of features facilitating unstructured social interaction. In the real world, social situations have many purposes, each with a different set of requirements, and roles its participants take - creator, moderator, performer, visitor, etc. Yet, common SVR systems typically offer only a single client to users. Even if there are versions for different platforms, there is a one-size-fits-all approach to the user experience. Consequently users need to employ workarounds or build their own functionality to support specific roles, where this is possible at all. We argue that platforms need to develop more open frameworks that support different processes and user interactions. One way to do this is through using appropriate web standards and an open messaging system in order to allow distributed clients that can leverage the strongest features of heterogeneous computing platforms. Supporting asymmetrical capabilities greatly increases the scope of supported virtual social interactions and potential use cases of SVR. We take a qualitative experimental approach to exploring cross platform support in this way, from a designers perspective. We use the open-source SDK Ubiq, and create a library that allows building Ubiq Peers using web standards and thus clients that can operate solely in a web browser or certain Javascript environments. We validate our approach by demonstrating six proof of concept demonstrators that would be difficult or impossible to achieve in most other SVR systems, and report on what we encountered for the benefit of other SVR designers.
- 9 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-9
Open AccessExtending the Open Source Social Virtual Reality Ecosystem to the Browser in Ubiq
Social VR (SVR) systems are VR systems with a common subset of features facilitating unstructured social interaction. In the real world, social situations have many purposes, each with a different set of requirements, and roles its participants take - creator, moderator, performer, visitor, etc. Yet, common SVR systems typically offer only a single client to users. Even if there are versions for different platforms, there is a one-size-fits-all approach to the user experience. Consequently users need to employ workarounds or build their own functionality to support specific roles, where this is possible at all. We argue that platforms need to develop more open frameworks that support different processes and user interactions. One way to do this is through using appropriate web standards and an open messaging system in order to allow distributed clients that can leverage the strongest features of heterogeneous computing platforms. Supporting asymmetrical capabilities greatly increases the scope of supported virtual social interactions and potential use cases of SVR. We take a qualitative experimental approach to exploring cross platform support in this way, from a designers perspective. We use the open-source SDK Ubiq, and create a library that allows building Ubiq Peers using web standards and thus clients that can operate solely in a web browser or certain Javascript environments. We validate our approach by demonstrating six proof of concept demonstrators that would be difficult or impossible to achieve in most other SVR systems, and report on what we encountered for the benefit of other SVR designers.