Caroline Appert
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Caroline Appert has a total of 63 co-authors. Here are the top co-authors by number of shared publications:
- Emmanuel Pietriga
LISN, Université Paris-Saclay, CNRS, INRIA, Orsay, France
31 shared publications Olivier Chapuis
Univ. Paris-Sud, CNRS, Inria, Université Paris-Saclay, Orsay, France
8 shared publicationsMichel Beaudouin-Lafon
LRI - Univ. Paris-Sud & CNRS, Orsay, France and INRIA, Orsay, France
6 shared publications- Olivier Chapuis
LISN, Université Paris-Saclay, CNRS, INRIA, Orsay, France
5 shared publications Hugo Romat
Univ. Paris-Sud, CNRS, INRIA, Université Paris-Saclay & TecKnowMetrix, Orsay, France
3 shared publicationsJean-Daniel Fekete
INRIA, Orsay, France and LRI - Univ. Paris-Sud, Orsay, France
3 shared publications
Latest Publications
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-5
AiRWeb: Using AR to Extend Web Browsing Beyond Handheld Screens
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-5
Open AccessAiRWeb: Using AR to Extend Web Browsing Beyond Handheld Screens
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-16
Can We Infer Object Pose Changes from Hand Movements?
Some Augmented Reality applications require tracking physical objects to anchor virtual elements to them. Despite significant progress in computer vision, achieving robust tracking of manipulated objects remains challenging, notably due to occlusions caused by the hands. Yet the hands carry valuable information: the way an object is grasped and moved is reflected in their shape and motion. We explore the following question: can we infer changes to an object’s position and orientation from the shape and movements of the hand manipulating it? We investigate this general approach, which we call Object-from-Hand (ObHa), building three probes, drawing on insights from experimental psychology research on grasping, on our own empirical studies, and on an analysis of the extensive HOT3D dataset of everyday object manipulations. We then discuss the approach’s potential either as a complement to vision-based pose tracking solutions or as a coarse standalone pose tracking solution.
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-16
Open AccessCan We Infer Object Pose Changes from Hand Movements?
Some Augmented Reality applications require tracking physical objects to anchor virtual elements to them. Despite significant progress in computer vision, achieving robust tracking of manipulated objects remains challenging, notably due to occlusions caused by the hands. Yet the hands carry valuable information: the way an object is grasped and moved is reflected in their shape and motion. We explore the following question: can we infer changes to an object’s position and orientation from the shape and movements of the hand manipulating it? We investigate this general approach, which we call Object-from-Hand (ObHa), building three probes, drawing on insights from experimental psychology research on grasping, on our own empirical studies, and on an analysis of the extensive HOT3D dataset of everyday object manipulations. We then discuss the approach’s potential either as a complement to vision-based pose tracking solutions or as a coarse standalone pose tracking solution.
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-17
DoubleMe: Local Blending in Multi-Display Environments with Augmented Reality to Facilitate Co-Located Collaboration
Co-located collaboration often raises challenges related to physical constraints because of e.g., stationary display setups or limited possibilities of movement. We introduce DoubleMe, an Augmented Reality system that generates virtual duplicates of collaborators’ workspaces, comprising both their displays and avatars. With DoubleMe, users maintain the layout of their own physical workspace and can position the duplicate of their collaborator’s workspace nearby. This approach alleviates spatial constraints by enabling one user to join another’s workspace without leaving their own. We report on two experiments examining the effectiveness of this approach. The first experiment investigates how avatar appearance and interaction influence user comfort and relationship dynamics. The second experiment assesses the performance benefits of duplicates over traditional co-located setups for collaborative tasks. Our findings suggest that the addition of duplicates to physical presence can enhance co-located collaboration while improving comfort.
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-17
Open AccessDoubleMe: Local Blending in Multi-Display Environments with Augmented Reality to Facilitate Co-Located Collaboration
Co-located collaboration often raises challenges related to physical constraints because of e.g., stationary display setups or limited possibilities of movement. We introduce DoubleMe, an Augmented Reality system that generates virtual duplicates of collaborators’ workspaces, comprising both their displays and avatars. With DoubleMe, users maintain the layout of their own physical workspace and can position the duplicate of their collaborator’s workspace nearby. This approach alleviates spatial constraints by enabling one user to join another’s workspace without leaving their own. We report on two experiments examining the effectiveness of this approach. The first experiment investigates how avatar appearance and interaction influence user comfort and relationship dynamics. The second experiment assesses the performance benefits of duplicates over traditional co-located setups for collaborative tasks. Our findings suggest that the addition of duplicates to physical presence can enhance co-located collaboration while improving comfort.
- Open Access
- 9 September 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 9 (5) , 1-25
Investigating Hand-Bound Pads for AR Input Using Hand-Tracking Only MHCI018
Interaction in Augmented Reality primarily relies on raycast pointing and mid-air touch. An alternative consists of using the non-dominant hand as a touch-sensitive surface, enabling more comfortable, less fatiguing input. AR UI design guidelines have so far discouraged this alternative because of poor hand tracking performance when the hands overlap, favoring touchpads in the air near the hand, rather than on the hand. But significant improvements to the hand tracking capabilities of recent commodity headsets suggest that on-hand pads may now be feasible. We develop an on-hand touchpad prototype and conduct two studies that involve both discrete input and continuous control tasks. The first study compares such on-hand pads to baseline in-air and on-object pads, showing comparable performance despite some limitations in tracking accuracy. The second study quantifies the advantage of on-hand and in-air pads over on-object pads during transitions between touchpad input and other physical hand activities.
- 9 September 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 9 (5) , 1-25
Open AccessInvestigating Hand-Bound Pads for AR Input Using Hand-Tracking Only MHCI018
Interaction in Augmented Reality primarily relies on raycast pointing and mid-air touch. An alternative consists of using the non-dominant hand as a touch-sensitive surface, enabling more comfortable, less fatiguing input. AR UI design guidelines have so far discouraged this alternative because of poor hand tracking performance when the hands overlap, favoring touchpads in the air near the hand, rather than on the hand. But significant improvements to the hand tracking capabilities of recent commodity headsets suggest that on-hand pads may now be feasible. We develop an on-hand touchpad prototype and conduct two studies that involve both discrete input and continuous control tasks. The first study compares such on-hand pads to baseline in-air and on-object pads, showing comparable performance despite some limitations in tracking accuracy. The second study quantifies the advantage of on-hand and in-air pads over on-object pads during transitions between touchpad input and other physical hand activities.
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-16
EuterPen: Unleashing Creative Expression in Music Score Writing
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-16
Open AccessEuterPen: Unleashing Creative Expression in Music Score Writing
- Open Access
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-18
TriPad: Touch Input in AR on Ordinary Surfaces with Hand Tracking Only
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-18
Open AccessTriPad: Touch Input in AR on Ordinary Surfaces with Hand Tracking Only
- Open Access
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-16
Challenges of Music Score Writing and the Potentials of Interactive Surfaces
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-16
Open AccessChallenges of Music Score Writing and the Potentials of Interactive Surfaces
- Open Access
- 29 January 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Computer-Human Interaction
- Vol. 31 (2) , 1-33
Spreadsheets on Interactive Surfaces: Breaking through the Grid with the Pen
Spreadsheet programs for interactive surfaces have limited manipulations capabilities and are often frustrating to use. One key reason is that the spreadsheet grid creates a layer that intercepts most user input events, making it difficult to reach the cell values that lie underneath. We conduct an analysis of commercial spreadsheet programs and an elicitation study to understand what users can do and what they would like to do with spreadsheets on interactive surfaces. Informed by these, we design interaction techniques that leverage the precision of the pen to mitigate friction between the different layers. These enable more operations by direct manipulation on and through the grid, targeting not only cells and groups of cells, but values and substrings within and across cells as well. We prototype these interaction techniques and conduct a qualitative study with information workers who perform a variety of spreadsheet operations on their own data.
- 29 January 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Computer-Human Interaction
- Vol. 31 (2) , 1-33
Open AccessSpreadsheets on Interactive Surfaces: Breaking through the Grid with the Pen
Spreadsheet programs for interactive surfaces have limited manipulations capabilities and are often frustrating to use. One key reason is that the spreadsheet grid creates a layer that intercepts most user input events, making it difficult to reach the cell values that lie underneath. We conduct an analysis of commercial spreadsheet programs and an elicitation study to understand what users can do and what they would like to do with spreadsheets on interactive surfaces. Informed by these, we design interaction techniques that leverage the precision of the pen to mitigate friction between the different layers. These enable more operations by direct manipulation on and through the grid, targeting not only cells and groups of cells, but values and substrings within and across cells as well. We prototype these interaction techniques and conduct a qualitative study with information workers who perform a variety of spreadsheet operations on their own data.
- Open Access
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-15
SurfAirs: Surface + Mid-air Input for Large Vertical Displays
Large vertical surfaces such as wall displays allow users to work with a very large and high-resolution workspace. Such displays promote physical navigation: users can step close to the display to see details, but also move away to get a wider view of the workspace. In terms of input, current solutions usually combine direct touch on the wall with input on a handheld device, disconnecting close and distant input rather than treating it as a continuum. We present SurfAirs, which are physical controllers that users can manipulate on screen (surface input), in the air (mid-air input), and transition from the surface to the air during a single manipulation (hybrid input). We report on two user studies that compare SurfAirs’ performance with bare-hand input for both mid-air and hybrid input. Participants prefer and perform better with SurfAirs.
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Open AccessSurfAirs: Surface + Mid-air Input for Large Vertical Displays
Large vertical surfaces such as wall displays allow users to work with a very large and high-resolution workspace. Such displays promote physical navigation: users can step close to the display to see details, but also move away to get a wider view of the workspace. In terms of input, current solutions usually combine direct touch on the wall with input on a handheld device, disconnecting close and distant input rather than treating it as a continuum. We present SurfAirs, which are physical controllers that users can manipulate on screen (surface input), in the air (mid-air input), and transition from the surface to the air during a single manipulation (hybrid input). We report on two user studies that compare SurfAirs’ performance with bare-hand input for both mid-air and hybrid input. Participants prefer and perform better with SurfAirs.