Kang Mao
Research Subjects
Kang Mao has a total of 11 co-authors. Here are the top co-authors by number of shared publications:
- Youchun Xu
Institute of Military Transportation, Army Military Transportation University, Tianjin 300161, China
2 shared publications Feng Lu
Institute of Military Transportation, Army Military Transportation University, Tianjin, China
1 shared publication- Hua Cong
Army Academy of Armored Forces, Beijing 100072, China
1 shared publication - Mianhao Qiu
Army Academy of Armored Forces, Beijing 100072, China
1 shared publication - Rendong Wang
Institute of Military Transportation, Army Military Transportation University, Tianjin, China
1 shared publication - Shiju Pan
Institute of Military Transportation, Army Military Transportation University, Tianjin 300161, China
1 shared publication
Latest Publications
- Open Access
- 23 April 2025
- Published by Kaunas University of Technology (KTU) in Elektronika ir Elektrotechnika
- Vol. 31 (2) , 60-70
Active Tracking of Moving Objects with Speed Variations Using a Novel PTZ Camera-based Machine Vision Technique
Most existing methods of active tracking focus mainly on slow-moving objects, resulting in limited adaptability to objects with variable speeds. To bridge this research gap, a novel spherical coordinate guided adaptive active tracking (SCAAT) approach based on the pan–tilt–zoom (PTZ) camera machine vision system is proposed in this study. For object detection and tracking, YOLOv5 and DeepSORT are employed in the PTZ vision system. The spherical coordinates and angular speeds of the moving object can be acquired under the spherical coordinate system. For practical application, the start-time and start-angle delay of the PTZ cameras are calibrated, and a speed control equation is conducted in the spherical coordinate system to reduce rapid location deviation between the PTZ and the moving object. To adapt different speeds of the object and avoid camera shaking under different zooms, an adaptive tracking window is designed to keep the object within the camera field of view. Experimental testing has been performed to evaluate the proposed SCAAT method. The results indicate that the SCATT can not only expand the effective following distance and zoom of the PTZ camera, but also effectively improve the accuracy and stability of active tracking for the moving object with large speed variations.
- 23 April 2025
- Published by Kaunas University of Technology (KTU) in Elektronika ir Elektrotechnika
- Vol. 31 (2) , 60-70
Open AccessActive Tracking of Moving Objects with Speed Variations Using a Novel PTZ Camera-based Machine Vision Technique
Most existing methods of active tracking focus mainly on slow-moving objects, resulting in limited adaptability to objects with variable speeds. To bridge this research gap, a novel spherical coordinate guided adaptive active tracking (SCAAT) approach based on the pan–tilt–zoom (PTZ) camera machine vision system is proposed in this study. For object detection and tracking, YOLOv5 and DeepSORT are employed in the PTZ vision system. The spherical coordinates and angular speeds of the moving object can be acquired under the spherical coordinate system. For practical application, the start-time and start-angle delay of the PTZ cameras are calibrated, and a speed control equation is conducted in the spherical coordinate system to reduce rapid location deviation between the PTZ and the moving object. To adapt different speeds of the object and avoid camera shaking under different zooms, an adaptive tracking window is designed to keep the object within the camera field of view. Experimental testing has been performed to evaluate the proposed SCAAT method. The results indicate that the SCATT can not only expand the effective following distance and zoom of the PTZ camera, but also effectively improve the accuracy and stability of active tracking for the moving object with large speed variations.
- Open Access
Gaze Point Tracking Based on a Robotic Body–Head–Eye Coordination Method
When the magnitude of a gaze is too large, human beings change the orientation of their head or body to assist their eyes in tracking targets because saccade alone is insufficient to keep a target at the center region of the retina. To make a robot gaze at targets rapidly and stably (as a human does), it is necessary to design a body–head–eye coordinated motion control strategy. A robot system equipped with eyes and a head is designed in this paper. Gaze point tracking problems are divided into two sub-problems: in situ gaze point tracking and approaching gaze point tracking. In the in situ gaze tracking state, the desired positions of the eye, head and body are calculated on the basis of minimizing resource consumption and maximizing stability. In the approaching gaze point tracking state, the robot is expected to approach the object at a zero angle. In the process of tracking, the three-dimensional (3D) coordinates of the object are obtained by the bionic eye and then converted to the head coordinate system and the mobile robot coordinate system. The desired positions of the head, eyes and body are obtained according to the object’s 3D coordinates. Then, using sophisticated motor control methods, the head, eyes and body are controlled to the desired position. This method avoids the complex process of adjusting control parameters and does not require the design of complex control algorithms. Based on this strategy, in situ gaze point tracking and approaching gaze point tracking experiments are performed by the robot. The experimental results show that body–head–eye coordination gaze point tracking based on the 3D coordinates of an object is feasible. This paper provides a new method that differs from the traditional two-dimensional image-based method for robotic body–head–eye gaze point tracking.
Open AccessGaze Point Tracking Based on a Robotic Body–Head–Eye Coordination Method
When the magnitude of a gaze is too large, human beings change the orientation of their head or body to assist their eyes in tracking targets because saccade alone is insufficient to keep a target at the center region of the retina. To make a robot gaze at targets rapidly and stably (as a human does), it is necessary to design a body–head–eye coordinated motion control strategy. A robot system equipped with eyes and a head is designed in this paper. Gaze point tracking problems are divided into two sub-problems: in situ gaze point tracking and approaching gaze point tracking. In the in situ gaze tracking state, the desired positions of the eye, head and body are calculated on the basis of minimizing resource consumption and maximizing stability. In the approaching gaze point tracking state, the robot is expected to approach the object at a zero angle. In the process of tracking, the three-dimensional (3D) coordinates of the object are obtained by the bionic eye and then converted to the head coordinate system and the mobile robot coordinate system. The desired positions of the head, eyes and body are obtained according to the object’s 3D coordinates. Then, using sophisticated motor control methods, the head, eyes and body are controlled to the desired position. This method avoids the complex process of adjusting control parameters and does not require the design of complex control algorithms. Based on this strategy, in situ gaze point tracking and approaching gaze point tracking experiments are performed by the robot. The experimental results show that body–head–eye coordination gaze point tracking based on the 3D coordinates of an object is feasible. This paper provides a new method that differs from the traditional two-dimensional image-based method for robotic body–head–eye gaze point tracking.
- Open Access
- 12 September 2022
- Published by MDPI AG in Applied Sciences
- Vol. 12 (18) , 9148
A General Calibration Method for Dual-PTZ Cameras Based on Feedback Parameters
With the increasing application of dual-PTZ (Pan-Tilt-Zoom) cameras in intelligent unmanned systems, research regarding their calibration methods is becoming more and more important. The intrinsic and extrinsic parameters of dual-PTZ cameras continuously change during rotation and zoom, resulting in difficulties in obtaining precise calibration. Here, we propose a general calibration method for dual-PTZ cameras with variable focal length and posture under the following conditions: the optical center of the camera does not coincide with the horizontal and pitch rotation axes, and the horizontal and pitch rotation axes are not perpendicular to each other. We establish a relationship between the intrinsic and extrinsic parameters and the feedback parameters (pan, tilt, zoom value) of dual-PTZ cameras by fitting and calculating previous calibration results acquired at specific angles and zoom values using Zhang’s calibration method. Subsequently, we derive the intrinsic and extrinsic parameter calculation formula at arbitrary focal length and posture based on the camera’s feedback parameters. The experimental results show that intrinsic and extrinsic parameters computed using the proposed method can better meet precision requirements compared with the ground truth calibrated using Zhang’s method. The average focal length error is less than 4%, the cosine similarity of the rotation matrix between the left and right cameras is more than 99.8%, the translation vector error is less than 1%, and the recalculated Euler angle errors are less than 1 degree. Our work can quickly and accurately obtain intrinsic and extrinsic parameters during the use of the dual-PTZ camera.
- 12 September 2022
- Published by MDPI AG in Applied Sciences
- Vol. 12 (18) , 9148
Open AccessA General Calibration Method for Dual-PTZ Cameras Based on Feedback Parameters
With the increasing application of dual-PTZ (Pan-Tilt-Zoom) cameras in intelligent unmanned systems, research regarding their calibration methods is becoming more and more important. The intrinsic and extrinsic parameters of dual-PTZ cameras continuously change during rotation and zoom, resulting in difficulties in obtaining precise calibration. Here, we propose a general calibration method for dual-PTZ cameras with variable focal length and posture under the following conditions: the optical center of the camera does not coincide with the horizontal and pitch rotation axes, and the horizontal and pitch rotation axes are not perpendicular to each other. We establish a relationship between the intrinsic and extrinsic parameters and the feedback parameters (pan, tilt, zoom value) of dual-PTZ cameras by fitting and calculating previous calibration results acquired at specific angles and zoom values using Zhang’s calibration method. Subsequently, we derive the intrinsic and extrinsic parameter calculation formula at arbitrary focal length and posture based on the camera’s feedback parameters. The experimental results show that intrinsic and extrinsic parameters computed using the proposed method can better meet precision requirements compared with the ground truth calibrated using Zhang’s method. The average focal length error is less than 4%, the cosine similarity of the rotation matrix between the left and right cameras is more than 99.8%, the translation vector error is less than 1%, and the recalculated Euler angle errors are less than 1 degree. Our work can quickly and accurately obtain intrinsic and extrinsic parameters during the use of the dual-PTZ camera.