Advancing industrial inspection with an automated computer vision solution for orthopedic surgical tray inspection
Authors:
Open Access
- 6 March 2025
- journal article
- Published by Springer Nature in Scientific Reports
- Vol. 15 (1) , 7867
Abstract
This work aimed to automate the current manual inspection process of orthopedic joint reconstruction loaner trays, which contain multiple components securely placed in designated slots, by developing an end-to-end pipeline, including an object detection model followed by a tray layout verification algorithm. We collected video training data from 74 trays comprising 1039 unique components. We trained a single You Only Look Once (YOLOv7) model capable of detecting 1039 classes, where we customized the loss and non-max suppression (NMS) functions. For layout verification, we implemented an in-house algorithm based on a pretrained Local Feature Matching with Transformer (LoFTR) model to verify each component's presence and correct placement within a tray. We evaluated our end-to-end pipeline on 139 testing inspection images and achieved an overall mean average precision (mAP@0.5) and false-positive rate of 0.94 ± 0.10 and 0.05 ± 0.08, respectively, across 12 test scenarios. Our enhanced YOLOv7-X architecture outperformed the Region-based Convolutional Neural Network (Faster-RCNN-ResNet101) baseline model by 24%. Remarkably, in 7 out of 12 scenarios, we achieved an mAP exceeding 0.99. Our proposed solution substantially reduces the inspection time by 47.3% and is highly scalable, allowing straightforward integration into broad industrial applications.Keywords
This publication has 34 references indexed in Scilit:
- A Robust Method for Electrical Equipment Infrared and Visible Image Registration2022
- Small object detection method with shallow feature fusion network for chip surface defect detectionScientific Reports, 2022
- A Fabric Defect Detection Method Based on Deep LearningIEEE Access, 2022
- A robust approach for industrial small-object detection using an improved faster regional convolutional neural networkScientific Reports, 2021
- Detection of PCB Surface Defects With Improved Faster-RCNN and Feature Pyramid NetworkIEEE Access, 2020
- Tackling Faults in the Industry 4.0 Era—A Survey of Machine-Learning Solutions and Key AspectsSensors, 2019
- TDD‐net: a tiny defect detection network for printed circuit boardsCAAI Transactions on Intelligence Technology, 2019
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- USAC: A Universal Framework for Random Sample ConsensusIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009