Vladimir Berman
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Vladimir Berman has a total of 11 co-authors. Here are the top co-authors by number of shared publications:
- Artem Bazhenov
Skolkovo Institute of Science and Technology, Moscow, Russian Federation
2 shared publications - Artem Lykov
Skolkovo Institute of Science and Technology, Moscow, Russian Federation
2 shared publications - Dzmitry Tsetserukou
Skolkovo Institute of Science and Technology
2 shared publications - Ali Alridha Abdulkarim
Skolkovo Institute of Science and Technology
1 shared publication - Miguel Altamirano Cabrera
Skolkovo Institute of Science and Technology, Moscow, Russian Federation
1 shared publication - Mikhail Konenkov
Skolkovo Institute of Science and Technology, Moscow, Russian Federation
1 shared publication
Latest Publications
- Open Access
- 11 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 712-716
CognitiveDog: Large Multimodal Model Based System to Translate Vision and Language into Action of Quadruped Robot
This paper introduces CognitiveDog, a pioneering development of quadruped robot with Large Multi-modal Model (LMM) that is capable of not only communicating with humans verbally but also physically interacting with the environment through object manipulation. The system was realized on Unitree Go1 robot-dog equipped with a custom gripper and demonstrated autonomous decision-making capabilities, independently determining the most appropriate actions and interactions with various objects to fulfill user-defined tasks. These tasks do not necessarily include direct instructions, challenging the robot to comprehend and execute them based on natural language input and environmental cues. The paper delves into the intricacies of this system, dataset characteristics, and the software architecture. Key to this development is the robot's proficiency in navigating space using Visual-SLAM, effectively manipulating and transporting objects, and providing insightful natural language commentary during task execution. Experimental results highlight the robot's advanced task comprehension and adaptability, underscoring its potential in real-world applications. The dataset used to fine-tune the robot-dog behavior generation model is provided at the following link: huggingface.co/datasets/ArtemLykov/CognitiveDog_dataset
- 11 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 712-716
Open AccessCognitiveDog: Large Multimodal Model Based System to Translate Vision and Language into Action of Quadruped Robot
This paper introduces CognitiveDog, a pioneering development of quadruped robot with Large Multi-modal Model (LMM) that is capable of not only communicating with humans verbally but also physically interacting with the environment through object manipulation. The system was realized on Unitree Go1 robot-dog equipped with a custom gripper and demonstrated autonomous decision-making capabilities, independently determining the most appropriate actions and interactions with various objects to fulfill user-defined tasks. These tasks do not necessarily include direct instructions, challenging the robot to comprehend and execute them based on natural language input and environmental cues. The paper delves into the intricacies of this system, dataset characteristics, and the software architecture. Key to this development is the robot's proficiency in navigating space using Visual-SLAM, effectively manipulating and transporting objects, and providing insightful natural language commentary during task execution. Experimental results highlight the robot's advanced task comprehension and adaptability, underscoring its potential in real-world applications. The dataset used to fine-tune the robot-dog behavior generation model is provided at the following link: huggingface.co/datasets/ArtemLykov/CognitiveDog_dataset
- Open Access
- 11 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 238-242
DogSurf: Quadruped Robot Capable of GRU-based Surface Recognition for Blind Person Navigation
This paper introduces DogSurf - a newapproach of using quadruped robots to help visually impaired people navigate in real world. The presented method allows the quadruped robot to detect slippery surfaces, and to use audio and haptic feedback to inform the user when to stop. A state-of-the-art GRU-based neural network architecture with mean accuracy of 99.925% was proposed for the task of multiclass surface classification for quadruped robots. A dataset was collected on a Unitree Go1 Edu robot. The dataset and code have been posted to the public domain.
- 11 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 238-242
Open AccessDogSurf: Quadruped Robot Capable of GRU-based Surface Recognition for Blind Person Navigation
This paper introduces DogSurf - a newapproach of using quadruped robots to help visually impaired people navigate in real world. The presented method allows the quadruped robot to detect slippery surfaces, and to use audio and haptic feedback to inform the user when to stop. A state-of-the-art GRU-based neural network architecture with mean accuracy of 99.925% was proposed for the task of multiclass surface classification for quadruped robots. A dataset was collected on a Unitree Go1 Edu robot. The dataset and code have been posted to the public domain.