Eye-In-Finger: Smart Fingers for Delicate Assembly and Disassembly of LEGO
Authors:
- 19 October 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 20990-20996
Abstract
Manipulation and insertion of small and tight-toleranced objects in robotic assembly remain a critical challenge for vision-based robotics systems due to the required precision and cluttered environment. Conventional global or wrist-mounted cameras often suffer from occlusions when either assembling or disassembling from an existing structure. To address the challenge, this paper introduces "Eye-In-Finger", a novel tool design approach that enhances robotic manipulation by embedding low-cost, high-resolution perception directly at the tool tip. We validate our approach using LEGO assembly and disassembly tasks, which require the robot to manipulate in a cluttered environment and achieve sub-millimeter accuracy and robust error correction due to the tight tolerances. Experimental results demonstrate that our proposed system enables real-time, fine corrections to alignment error, increasing the tolerance of calibration error from 0.4mm to up to 2.0mm for the LEGO manipulation robot.Keywords
All Related Versions
Funding Information
- Carnegie Mellon University
This publication has 11 references indexed in Scilit:
- BFA: Best-Feature-Aware Fusion for Multi-View Fine-Grained ManipulationIEEE Robotics and Automation Letters, 2025
- APEX-MR: Multi-Robot Asynchronous Planning and Execution for Cooperative Assembly2025
- π₀: A Vision-Language-Action Flow Model for General Robot Control2025
- Precision Harvesting in Cluttered Environments: Integrating End Effector Design with Dual Camera Perception2025
- A Lightweight and Transferable Design for Robust Lego Manipulation2024
- Robotic Manipulation of Hand Tools: The Case of Screwdriving2024
- High-Speed Autonomous Robotic Assembly Using In-Hand Manipulation and Re-GraspingApplied Sciences, 2020
- A Learning Framework for High Precision Industrial Assembly2019
- Improved GelSight tactile sensor for measuring geometry and slip2017
- Localization and manipulation of small parts using GelSight tactile sensing2014