Fernanda De La Torre
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Fernanda De La Torre has a total of 7 co-authors. Here are the top co-authors by number of shared publications:
- Judith Amores
Microsoft Research, Cambridge, Massachusetts, USA
2 shared publications - Andrew David Wilson
Microsoft Research, Redmond, Washington, USA
1 shared publication - Andrzej Banburski-Fahey
Microsoft, Redmond, Washington, USA
1 shared publication - Cathy Mengying Fang
MIT Media Lab, United States
1 shared publication - Han Huang
Mathematics, Rensselaer Polytechnic Institute, United States and Microsoft, United States
1 shared publication - Jaron Lanier
Microsoft, United States
1 shared publication
Latest Publications
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-22
Sonora: Human-AI Co-Creation of 3D Audio Worlds and its Impact on Anxiety and Cognitive Load
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-22
Open AccessSonora: Human-AI Co-Creation of 3D Audio Worlds and its Impact on Anxiety and Cognitive Load
- Top Cited PapersOpen Access
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-22
LLMR: Real-time Prompting of Interactive Worlds using Large Language Models
We present Large Language Model for Mixed Reality (LLMR), a framework for the real-time creation and modification of interactive Mixed Reality experiences using LLMs. LLMR leverages novel strategies to tackle difficult cases where ideal training data is scarce, or where the design goal requires the synthesis of internal dynamics, intuitive analysis, or advanced interactivity. Our framework relies on text interaction and the Unity game engine. By incorporating techniques for scene understanding, task planning, self-debugging, and memory management, LLMR outperforms the standard GPT-4 by 4x in average error rate. We demonstrate LLMR’s cross-platform interoperability with several example worlds, and evaluate it on a variety of creation and modification tasks to show that it can produce and edit diverse objects, tools, and scenes. Finally, we conducted a usability study (N=11) with a diverse set that revealed participants had positive experiences with the system and would use it again.
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-22
Top Cited PapersOpen AccessLLMR: Real-time Prompting of Interactive Worlds using Large Language Models
We present Large Language Model for Mixed Reality (LLMR), a framework for the real-time creation and modification of interactive Mixed Reality experiences using LLMs. LLMR leverages novel strategies to tackle difficult cases where ideal training data is scarce, or where the design goal requires the synthesis of internal dynamics, intuitive analysis, or advanced interactivity. Our framework relies on text interaction and the Unity game engine. By incorporating techniques for scene understanding, task planning, self-debugging, and memory management, LLMR outperforms the standard GPT-4 by 4x in average error rate. We demonstrate LLMR’s cross-platform interoperability with several example worlds, and evaluate it on a variety of creation and modification tasks to show that it can produce and edit diverse objects, tools, and scenes. Finally, we conducted a usability study (N=11) with a diverse set that revealed participants had positive experiences with the system and would use it again.