Vahan Babushkin

Handwriting style is an important aspect affecting the quality of handwriting. Adhering to one style is crucial for languages that follow cursive orthography and possess multiple handwriting styles, such as Arabic. The majority of available studies analyze Arabic handwriting style from static documents, focusing only on pure styles. In this study, we analyze handwriting samples with mixed styles, pure styles (Ruq’ah and Naskh), and samples without a specific style from dynamic features of the stylus and hand kinematics. We propose a model for classifying handwritten samples into four classes based on adherence to style. The stylus and hand kinematics data were collected from 50 participants who were writing an Arabic text containing all 28 letters and covering most Arabic orthography. The parameter search was conducted to find the best hyperparameters for the model, the optimal sliding window length, and the overlap. The proposed model for style classification achieves an accuracy of 88%. The explainability analysis with Shapley values revealed that hand speed, pressure, and pen slant are among the top 12 important features, with other features contributing nearly equally to style classification. Finally, we explore which features are important for Arabic handwriting style detection.

Currently available dental simulators provide a wide range of visual, auditory, and haptic cues to play back the pre-recorded skill, however, they do not extract skill descriptors and do not attempt to model the skill. To ensure efficient communication of a sensorimotor skill, a model that captures the skill's main features and provides real-time feedback and guidance based on the user's expertise is desirable. To develop this model, a complex periodontal probing skill can be considered as a composition of primitives, that can be extracted from the recordings of several professionals performing the probing task. This model will be capable of evaluating the user's proficiency level to ensure adaptation and providing corresponding guidance and feedback. We developed a SVM model that characterizes the sensorimotor skill of periodontal probing by detecting the specific region of the tooth being probed. We explore the features affecting the accuracy of the model and provide a reduced feature set capable of capturing the regions with relatively high accuracy. Finally, we consider the problem of periodontal pocket detection. The SVM model trained to detect pockets was able to achieve a recall around 0.68. We discuss challenges associated with pocket detection and propose directions for future work.

A sensorimotor skill is a sequence of motions generated in response to external stimuli and aiming to accomplish a particular task. It can be communicated to reproduce the task in a distant environment with similar settings. In this work, we conceptualize a multi-modal sensorimotor skill communication system that incorporates modeling, simulation, and evaluation of the sensorimotor skill. The proposed sensorimotor skill communication system can be applied for learning a specific style of human sensorimotor skill and teaching the skill to distant learners, which can be implemented in a variety of applications such as Tele-consultation, Tele-diagnosis, Tele-treatment, Tele-monitoring, and Tele-support. To understand the processes behind the communication of sensorimotor skill we review the representation of a human sensorimotor system from the neurobiological perspective. Then we analyze the existing literature on sensorimotor skill communication systems and propose a taxonomy of currently available methods for sensorimotor skill modeling, simulation, and evaluation. Furthermore, we propose a benchmark for evaluating the quality of the sensorimotor skill communication system. We present a case study aiming to demonstrate modeling the dental sensorimotor skill of periodontal probing. Lastly, we discuss challenges and limitations and provide perspectives for future research in developing sensorimotor skill communication systems.