AI-generated AR Reassembly Guidance from Disassembly Videos to Scaffold Everyday Repair
Open Access
- 13 April 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-16
Abstract
Repair is a valuable yet challenging activity, especially when product manuals are missing or outdated. Augmented Reality (AR) has been widely explored for repair tasks, but most systems rely on CAD models or pre-constructed assets, which escalate authoring costs and constrain scalability. We introduce RePairAR, a system that leverages multimodal large language models (MLLMs) to generate interactive AR reassembly guidance derived directly from user-recorded egocentric disassembly videos. RePairAR deduces step-part-relation structures, reverses these for reassembly planning, and delivers the guidance through mixed-media AR visualizations. In a user study with repair novices, RePairAR significantly reduced perceived temporal demand compared to traditional how-to videos. Both media improved self-efficacy, with RePairAR providing greater gains. Follow-up interviews revealed the mechanisms behind these effects. We contribute a validated MLLM-driven pipeline and highlight design implications for scalable, situated support in everyday repair practices.Keywords
This publication has 79 references indexed in Scilit:
- Empowering consumers to repair: The utility and acceptability of a serious game to examine decision-making behaviour regarding home appliances in IrelandEnergy Research & Social Science, 2024
- Barriers, enablers and market governance: A review of the policy landscape for repair of consumer electronics in the EU and the U.S.Journal of Cleaner Production, 2021
- Why do users (not) repair their devices? A study of the predictors of repair practicesJournal of Cleaner Production, 2021
- Increasing repair of household appliances, mobile phones and clothing: Experiences from consumers and the repair industryJournal of Cleaner Production, 2021
- From quick fixes to repair projects: Insights from a citizen science projectJournal of Cleaner Production, 2021
- Comparative study of AR versus video tutorials for minor maintenance operationsMultimedia Tools and Applications, 2019
- Augmented reality on large screen for interactive maintenance instructionsComputers in Industry, 2014
- GuideMe: A Mobile Augmented Reality System to Display User Manuals for Home Appliances2013
- Reducing waste: repair, recondition, remanufacture or recycle?Sustainable Development, 2005
- Self-efficacy: Toward a unifying theory of behavioral changeAdvances in Behaviour Research and Therapy, 1978