Robotic-Based Touch Panel Test System Using Pattern Recognition Methods
Open Access
- 24 November 2020
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 10 (23) , 8339
Abstract
In this study, pattern recognition methods are applied to a five-degrees-of-freedom robot arm that can key in words on a touch screen for an automatic smartphone test. The proposed system can recognize Chinese characters and Mandarin phonetic symbols. The mechanical arm is able to perform corresponding movements and edit words on the screen. Pattern matching is based on the Red-Green-Blue (RGB) color space and is transformed to binary images for higher correct rate and geometric matching. A web camera is utilized to capture patterns on the tested smartphone screen. The proposed control scheme uses a support vector machine with a histogram of oriented gradient classifier to recognize Chinese Mandarin phonetic symbols and provide correct coordinates during the control process. The control scheme also calculates joint angles of the robot arm during the movement using the Denavit–Hartenberg parameters (D-H) model and fuzzy logic system. Fuzzy theory is applied to use the position error between the robot arm and target location then resend the command to adjust the arm’s position. From the experiments, the proposed control scheme can control the robot to press desired buttons on the tested smartphone. For Chinese Mandarin phonetic symbols, recognition accuracy of the test system can reach 90 percent.Keywords
This publication has 17 references indexed in Scilit:
- An Analytic Approach to Converting POE Parameters Into D–H Parameters for Serial-Link RobotsIEEE Robotics and Automation Letters, 2017
- Application of character recognition to robot control on smartphone test systemAdvances in Mechanical Engineering, 2017
- Moving Object Tracking and Its Application to an Indoor Dual-Robot PatrolApplied Sciences, 2016
- Visual Recognition and Its Application to Robot Arm ControlApplied Sciences, 2015
- Implementation of fuzzy logic control in robot arm for searching location of gas leak2015
- Image Recognition System using Geometric Matching and Contour DetectionInternational Journal of Computer Applications, 2012
- Fractional Fuzzy Adaptive Sliding-Mode Control of a 2-DOF Direct-Drive Robot ArmIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2008
- Support vector clusteringScholarpedia, 2008
- Collision avoidance using potential fieldsIndustrial Robot: the international journal of robotics research and application, 1998
- Coordinated motion control of robot arms based on the virtual internal modelIEEE Transactions on Robotics and Automation, 1992