TNTommy Nilsson

Tommy Nilsson

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Tommy Nilsson has a total of 101 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Human-in/on-the-Loop AI: Enabling Human Controllability and Decision-Making in Spaceflight

    by Leonie Bensch, Oliver Bensch, Tommy Nilsson, Joseph A. Paradiso, Scott Davidoff, Lancelot Blanchard, Pat Pataranutaporn, Melanie Weber, J. Nathan Kutz, Frank Flemisch

  • Open Access

    The Impact of Graviception on Human-Computer Interaction

    by Jean Vanderdonckt, Philippe Lefevre, Radu-Daniel Vatavu, Nuwan T Attygalle, Laura-Bianca Bilius, Gaëlle Calvary, Sophie Dupuy-Chessa, Merle Fairhurst, Tommy Nilsson, Leif Oppermann, et al.

    Graviception, the human sensory perception of gravity and body orientation, plays a fundamental, yet often overlooked, role in how individuals interact with interactive systems. Human–computer interaction has traditionally emphasized visual, auditory, and tactile modalities, while comparatively neglecting the influence of gravity perception on embodiment, attention, motor control, and user experience. This paper draws on the field of biomechanics to examine how graviception can impact interaction, such as the impact of vision and gravity on body movements, especially in immersive, hypogravity environments, mobile contexts of use, and accessibility. By positioning graviception as a first-class concern in embodied interaction, we suggest actionable implications for interaction design that consider graviceptive factors for designers and researchers developing future graviceptive-aware interactive systems. Each implication is described by a short statement, a detailed statement, a rationale, and a series of examples illustrating the impact of graviception on design decisions.


  • Human-in/on-the-Loop AI: Enabling Human Controllability and Decision-Making in Spaceflight

    by Leonie Bensch, Oliver Bensch, Tommy Nilsson, Joseph A. Paradiso, Scott Davidoff, Lancelot Blanchard, Pat Pataranutaporn, Melanie Weber, J. Nathan Kutz, Frank Flemisch


  • Open Access

    Lunar Subterra: a Self-Integrative Unit with an Automated Drilling System

    by Anthony Sfeir, Asya Petkova, Sabine Chaaya, Karina Chichova, Marta Rossi, Anna Vock, Alessandro Mosut, Akshayanivasini Ramasamy Saravanaraj, Valentina Sumini, Tommy Nilsson

    As humans venture deeper into space, the need for a lunar settlement, housing the first group of settlers, grows steadily. By means of new technologies such as in situ resource utilisation (ISRU) as well as computational design, this goal can be implemented in present years. Providing the first arrivals with an immediate underground habitat safe from radiation and other environmental constraints is of crucial importance to initialise a prolonged mission on the Moon. The project's proposal revolves around the idea of establishing a base which provides an immediately habitable space with the possibility for future expansion. Advanced construction methods and sustainable practices lay the groundwork for a permanent human presence, predominantly based on ISRU. This paper outlines a two-phase initiative aimed at the foundation of the Lunar Subterra, followed by an extension of the habitat above ground. Following our collaboration with the PoliSpace Sparc Student Association group, a Virtual Reality (VR) reproduction of the proposed habitat enabled quick iterative testing of the habitable space with the use of a Meta Quest 2 headset. This not only allowed an evaluation of the environment and its impact on human residents but also eradicated the need for tangible models to conceptualise the idea, enabling rapid user-centred design and implementation in the future of space exploration.

  • Open Access

    Towards a Reliable Offline Personal AI Assistant for Long Duration Spaceflight

    by Oliver Bensch, Leonie Bensch, Tommy Nilsson, Florian Saling, Wafa M. Sadri, Carsten Hartmann, Tobias Hecking, J. Nathan Kutz

    As humanity prepares for new missions to the Moon and Mars, astronauts will need to operate with greater autonomy, given the communication delays that make real-time support from Earth difficult. For instance, messages between Mars and Earth can take up to 24 minutes, making quick responses impossible. This limitation poses a challenge for astronauts who must rely on in-situ tools to access the large volume of data from spacecraft sensors, rovers, and satellites, data that is often fragmented and difficult to use. To bridge this gap, systems like the Mars Exploration Telemetry-Driven Information System (METIS) are being developed. METIS is an AI assistant designed to handle routine tasks, monitor spacecraft systems, and detect anomalies, all while reducing the reliance on mission control. Current Generative Pretrained Transformer (GPT) Models, while powerful, struggle in safety-critical environments. They can generate plausible but incorrect responses, a phenomenon known as "hallucination," which could endanger astronauts. To overcome these limitations, this paper proposes enhancing systems like METIS by integrating GPTs, Retrieval-Augmented Generation (RAG), Knowledge Graphs (KGs), and Augmented Reality (AR). The idea is to allow astronauts to interact with their data more intuitively, using natural language queries and visualizing real-time information through AR. KGs will be used to easily access live telemetry and multimodal data, ensuring that astronauts have the right information at the right time. By combining AI, KGs, and AR, this new system will empower astronauts to work more autonomously, safely, and efficiently during future space missions.


  • Open Access

    Spatial Interfaces in Space Exploration

    by Tommy Nilsson

    Renewed interest in space exploration is paving the way for humanity’s future among the stars, with ambitious new programs being launched aiming to establish human presence on the Moon, Mars, and beyond. The realization of this vision will depend on the development of a new generation of reliable, safe, and efficient technologies, along with accompanying astronaut work procedures, to underpin future missions. Novel prototypes and procedures are typically developed, tested, and refined through field deployments in Earth-based analog environments. These environments, such as the underground cave systems in Sardinia, replicate some of the extreme conditions associated with extraterrestrial settings, thereby providing an operationally valid context for astronaut drills and prototype studies. While generally effective, this approach is facing criticism due to its logistical complexity and often prohibitive costs. In response, the European Space Agency (ESA) is exploring the potential of virtual and mixed reality technologies as a cost-effective alternative to these traditional analog environments. This talk will present ESA’s initiative, focusing on the benefits and limitations of using immersive and spatial interfaces in the context of human spaceflight. We will conclude by discussing how these interfaces might evolve as we look toward the future.

  • Open Access

    Touching the Moon: Leveraging Passive Haptics, Embodiment and Presence for Operational Assessments in Virtual Reality

    by Florian Dufresne, Tommy Nilsson, Geoffrey Gorisse, Enrico Guerra, André Zenner, Olivier Christmann, Leonie Bensch, Nikolai Anton Callus, Aidan Cowley

    Space agencies are in the process of drawing up carefully thought-out Concepts of Operations (ConOps) for future human missions on the Moon. These are typically assessed and validated through costly and logistically demanding analogue field studies. While interactive simulations in Virtual Reality (VR) offer a comparatively cost-effective alternative, they have faced criticism for lacking the fidelity of real-world deployments. This paper explores the applicability of passive haptic interfaces in bridging the gap between simulated and real-world ConOps assessments. Leveraging passive haptic props (equipment mockup and astronaut gloves), we virtually recreated the Apollo 12 mission procedure and assessed it with experienced astronauts and other space experts. Quantitative and qualitative findings indicate that haptics increased presence and embodiment, thus improving perceived simulation fidelity and validity of user reflections. We conclude by discussing the potential role of passive haptic modalities in facilitating early-stage ConOps assessments for human endeavours on the Moon and beyond.


  • Open Access

    Designing for Human Operations on the Moon: Challenges and Opportunities of Navigational HUD Interfaces

    by Leonie Bensch, Tommy Nilsson, Jan Wulkop, Paul Demedeiros, Nicolas Daniel Herzberger, Michael Preutenborbeck, Andreas Gerndt, Frank Flemisch, Florian Dufresne, Georgia Albuquerque, et al.

    Future crewed missions to the Moon will face significant environmental and operational challenges, posing risks to the safety and performance of astronauts navigating its inhospitable surface. Whilst head-up displays (HUDs) have proven effective in providing intuitive navigational support on Earth, the design of novel human-spaceflight solutions typically relies on costly and time-consuming analogue deployments, leaving the potential use of lunar HUDs largely under-explored. This paper explores an alternative approach by simulating navigational HUD concepts in a high-fidelity Virtual Reality (VR) representation of the lunar environment. In evaluating these concepts with astronauts and other aerospace experts (n=25), our mixed methods study demonstrates the efficacy of simulated analogues in facilitating rapid design assessments of early-stage HUD solutions. We illustrate this by elaborating key design challenges and guidelines for future lunar HUDs. In reflecting on the limitations of our approach, we propose directions for future design exploration of human-machine interfaces for the Moon.


  • Co-designing Immersive Virtual and Extended Reality Systems for Remote and Unsupervised Interaction, Intervention, Training and Research

    by Wiesław Kopeć, Monika Kornacka, Grzegorz Pochwatko, Cezary Biele, Anna Jaskulska, Kinga Skorupska, Steven Barnes, Maciej Grzeszczuk, Tommy Nilsson, Wladyslaw Fuchs, et al.


  • Open Access

    Augmented Reality in Service of Human Operations on the Moon: Insights from a Virtual Testbed

    by Leonie Becker, Tommy Nilsson, Paul Demedeiros, Flavie Rometsch

    Future astronauts living and working on the Moon will face extreme environmental conditions impeding their operational safety and performance. While it has been suggested that Augmented Reality (AR) Head-Up Displays (HUDs) could potentially help mitigate some of these adversities, the applicability of AR in the unique lunar context remains underexplored. To address this limitation, we have produced an accurate representation of the lunar setting in virtual reality (VR) which then formed our testbed for the exploration of prospective operational scenarios with aerospace experts. Herein we present findings based on qualitative reflections made by the first 6 study participants. AR was found instrumental in several use cases, including the support of navigation and risk awareness. Major design challenges were likewise identified, including the importance of redundancy and contextual appropriateness. Drawing on these findings, we conclude by outlining directions for future research aimed at developing AR-based assistive solutions tailored to the lunar setting.