Jesus Bermudez-Cameo
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Jesus Bermudez-Cameo has a total of 23 co-authors. Here are the top co-authors by number of shared publications:
- Jose Jesus Guerrero
Aragón Institute for Engineering Research (I3A), University of Zaragoza, Zaragoza, Spain
12 shared publications - Gonzalo López-Nicolás
Universidad de Zaragoza
5 shared publications - Bruno Berenguel-Baeta
Instituto de Investigacion Ingenieria Aragon Universidad Zaragoza Zaragoza Spain
4 shared publications - Alejandro Perez-Yus
Departamento de Informatica e Ingenieria de Sistemas, Universidad de Zaragoza, Zaragoza Spain 50018
3 shared publications Gonzalo Lopez-Nicolas
2 shared publicationsAlberto Badias-Herbera
Universidad de Zaragoza
1 shared publication
Latest Publications
- Open Access
- 17 July 2024
- Published by Universidad de Zaragoza in Jornada de Jóvenes Investigadores del I3A
- Vol. 12
Enhancing Realism in Simulated Prosthetic Vision by Introducing Temporal Models
Recent studies have demonstrated the effectiveness of computer vision techniques in assisting patients with visual prostheses. Evaluating these techniques requires the use of Simulated Prosthetic Vision (SPV). In this work, we propose an approach that introduces biologically-inspired temporal models to enhance the realism of SPV in real-time experimental frameworks.
- 17 July 2024
- Published by Universidad de Zaragoza in Jornada de Jóvenes Investigadores del I3A
- Vol. 12
Open AccessEnhancing Realism in Simulated Prosthetic Vision by Introducing Temporal Models
Recent studies have demonstrated the effectiveness of computer vision techniques in assisting patients with visual prostheses. Evaluating these techniques requires the use of Simulated Prosthetic Vision (SPV). In this work, we propose an approach that introduces biologically-inspired temporal models to enhance the realism of SPV in real-time experimental frameworks.
- Open Access
- 17 July 2024
- Published by Universidad de Zaragoza in Jornada de Jóvenes Investigadores del I3A
- Vol. 12
Integración de la plataforma CoppeliaSim para el desarrollo de entornos virtuales de capacitación en cirugía asistida por el robot Da Vinci
En este trabajo se presenta el desarrollo de un entorno virtual para la simulación de la operativa del robot quirúrgico DaVinci, que se utiliza en procedimientos de cirugía mínimamente invasiva. Su uso precisa de un entrenamiento intenso por lo que es fundamental el desarrollo de herramientas de simulación.
- 17 July 2024
- Published by Universidad de Zaragoza in Jornada de Jóvenes Investigadores del I3A
- Vol. 12
Open AccessIntegración de la plataforma CoppeliaSim para el desarrollo de entornos virtuales de capacitación en cirugía asistida por el robot Da Vinci
En este trabajo se presenta el desarrollo de un entorno virtual para la simulación de la operativa del robot quirúrgico DaVinci, que se utiliza en procedimientos de cirugía mínimamente invasiva. Su uso precisa de un entrenamiento intenso por lo que es fundamental el desarrollo de herramientas de simulación.
- Open Access
Convolution kernel adaptation to calibrated fisheye
Convolution kernels are the basic structural component of convolutional neural networks (CNNs). In the last years there has been a growing interest in fisheye cameras for many applications. However, the radially symmetric projection model of these cameras produces high distortions that affect the performance of CNNs, especially when the field of view is very large. In this work, we tackle this problem by proposing a method that leverages the calibration of cameras to deform the convolution kernel accordingly and adapt to the distortion. That way, the receptive field of the convolution is similar to standard convolutions in perspective images, allowing us to take advantage of pre-trained networks in large perspective datasets. We show how, with just a brief fine-tuning stage in a small dataset, we improve the performance of the network for the calibrated fisheye with respect to standard convolutions in depth estimation and semantic segmentation.
Open AccessConvolution kernel adaptation to calibrated fisheye
Convolution kernels are the basic structural component of convolutional neural networks (CNNs). In the last years there has been a growing interest in fisheye cameras for many applications. However, the radially symmetric projection model of these cameras produces high distortions that affect the performance of CNNs, especially when the field of view is very large. In this work, we tackle this problem by proposing a method that leverages the calibration of cameras to deform the convolution kernel accordingly and adapt to the distortion. That way, the receptive field of the convolution is similar to standard convolutions in perspective images, allowing us to take advantage of pre-trained networks in large perspective datasets. We show how, with just a brief fine-tuning stage in a small dataset, we improve the performance of the network for the calibrated fisheye with respect to standard convolutions in depth estimation and semantic segmentation.
- Open Access
- 22 January 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 15251-15267
RASPV: A Robotics Framework for Augmented Simulated Prosthetic Vision
One of the main challenges of visual prostheses is to augment the perceived information to improve the experience of its wearers. Given the limited access to implanted patients, in order to facilitate the experimentation of new techniques, this is often evaluated via Simulated Prosthetic Vision (SPV) with sighted people. In this work, we introduce a novel SPV framework and implementation that presents major advantages with respect to previous approaches. First, it is integrated into a robotics framework, which allows us to benefit from a wide range of methods and algorithms from the field (e.g. object recognition, obstacle avoidance, autonomous navigation, deep learning). Second, we go beyond traditional image processing with 3D point clouds processing using an RGB-D camera, allowing us to robustly detect the floor, obstacles and the structure of the scene. Third, it works either with a real camera or in a virtual environment, which gives us endless possibilities for immersive experimentation through a head-mounted display. Fourth, we incorporate a validated temporal phosphene model that replicates time effects into the generation of visual stimuli. Finally, we have proposed, developed and tested several applications within this framework, such as avoiding moving obstacles, providing a general understanding of the scene, staircase detection, helping the subject to navigate an unfamiliar space, and object and person detection. We provide experimental results in real and virtual environments. The code is publicly available at https://www.github.com/aperezyus/RASPV
- 22 January 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 15251-15267
Open AccessRASPV: A Robotics Framework for Augmented Simulated Prosthetic Vision
One of the main challenges of visual prostheses is to augment the perceived information to improve the experience of its wearers. Given the limited access to implanted patients, in order to facilitate the experimentation of new techniques, this is often evaluated via Simulated Prosthetic Vision (SPV) with sighted people. In this work, we introduce a novel SPV framework and implementation that presents major advantages with respect to previous approaches. First, it is integrated into a robotics framework, which allows us to benefit from a wide range of methods and algorithms from the field (e.g. object recognition, obstacle avoidance, autonomous navigation, deep learning). Second, we go beyond traditional image processing with 3D point clouds processing using an RGB-D camera, allowing us to robustly detect the floor, obstacles and the structure of the scene. Third, it works either with a real camera or in a virtual environment, which gives us endless possibilities for immersive experimentation through a head-mounted display. Fourth, we incorporate a validated temporal phosphene model that replicates time effects into the generation of visual stimuli. Finally, we have proposed, developed and tested several applications within this framework, such as avoiding moving obstacles, providing a general understanding of the scene, staircase detection, helping the subject to navigate an unfamiliar space, and object and person detection. We provide experimental results in real and virtual environments. The code is publicly available at https://www.github.com/aperezyus/RASPV
- 25 June 2023
- Published by Springer Nature
- p. 288-299
Calibration of Non-Central Conical Catadioptric Systems from Parallel Lines
- 25 June 2023
- Published by Springer Nature
- p. 288-299
Calibration of Non-Central Conical Catadioptric Systems from Parallel Lines
- Open Access
- 10 June 2022
- Published by Elsevier in Data in Brief
- Vol. 43, 108375
Non-central panorama indoor dataset
- 10 June 2022
- Published by Elsevier in Data in Brief
- Vol. 43, 108375
Open AccessNon-central panorama indoor dataset
- Open Access
- 22 December 2020
- Published by Universidad de Zaragoza in Jornada de Jóvenes Investigadores del I3A
- Vol. 8
Omnidirectional Image Data-Set for Computer Vision Applications
In this paper we present an image data-set of different omnidirectional systems. The images include full information of colour, depth, instance segmentation and room layout. This dataset aims to help in the training and test of different neural networks and development of computer vision algorithms.
- 22 December 2020
- Published by Universidad de Zaragoza in Jornada de Jóvenes Investigadores del I3A
- Vol. 8
Open AccessOmnidirectional Image Data-Set for Computer Vision Applications
In this paper we present an image data-set of different omnidirectional systems. The images include full information of colour, depth, instance segmentation and room layout. This dataset aims to help in the training and test of different neural networks and development of computer vision algorithms.
- 1 October 2020
- Published by IOP Publishing in Journal of Neural Engineering
- Vol. 17 (5) , 056002
Influence of field of view in visual prostheses design: Analysis with a VR system
Objective. Visual prostheses are designed to restore partial functional vision in patients with total vision loss. Retinal visual prostheses provide limited capabilities as a result of low resolution, limited field of view and poor dynamic range. Understanding the influence of these parameters in the perception results can guide prostheses research and design. Approach. In this work, we evaluate the influence of field of view with respect to spatial resolution in visual prostheses, measuring the accuracy and response time in a search and recognition task. Twenty-four normally sighted participants were asked to find and recognize usual objects, such as furniture and home appliance in indoor room scenes. For the experiment, we use a new simulated prosthetic vision system that allows simple and effective experimentation. Our system uses a virtual-reality environment based on panoramic scenes. The simulator employs a head-mounted display which allows users to feel immersed in the scene by perceiving the entire scene all around. Our experiments use public image datasets and a commercial head-mounted display. We have also released the virtual-reality software for replicating and extending the experimentation. Main results. Results show that the accuracy and response time decrease when the field of view is increased. Furthermore, performance appears to be correlated with the angular resolution, but showing a diminishing return even with a resolution of less than 2.3 phosphenes per degree. Significance. Our results seem to indicate that, for the design of retinal prostheses, it is better to concentrate the phosphenes in a small area, to maximize the angular resolution, even if that implies sacrificing field of view.
- 1 October 2020
- Published by IOP Publishing in Journal of Neural Engineering
- Vol. 17 (5) , 056002
Influence of field of view in visual prostheses design: Analysis with a VR system
Objective. Visual prostheses are designed to restore partial functional vision in patients with total vision loss. Retinal visual prostheses provide limited capabilities as a result of low resolution, limited field of view and poor dynamic range. Understanding the influence of these parameters in the perception results can guide prostheses research and design. Approach. In this work, we evaluate the influence of field of view with respect to spatial resolution in visual prostheses, measuring the accuracy and response time in a search and recognition task. Twenty-four normally sighted participants were asked to find and recognize usual objects, such as furniture and home appliance in indoor room scenes. For the experiment, we use a new simulated prosthetic vision system that allows simple and effective experimentation. Our system uses a virtual-reality environment based on panoramic scenes. The simulator employs a head-mounted display which allows users to feel immersed in the scene by perceiving the entire scene all around. Our experiments use public image datasets and a commercial head-mounted display. We have also released the virtual-reality software for replicating and extending the experimentation. Main results. Results show that the accuracy and response time decrease when the field of view is increased. Furthermore, performance appears to be correlated with the angular resolution, but showing a diminishing return even with a resolution of less than 2.3 phosphenes per degree. Significance. Our results seem to indicate that, for the design of retinal prostheses, it is better to concentrate the phosphenes in a small area, to maximize the angular resolution, even if that implies sacrificing field of view.
- Open Access
OmniSCV: An Omnidirectional Synthetic Image Generator for Computer Vision
Omnidirectional and 360° images are becoming widespread in industry and in consumer society, causing omnidirectional computer vision to gain attention. Their wide field of view allows the gathering of a great amount of information about the environment from only an image. However, the distortion of these images requires the development of specific algorithms for their treatment and interpretation. Moreover, a high number of images is essential for the correct training of computer vision algorithms based on learning. In this paper, we present a tool for generating datasets of omnidirectional images with semantic and depth information. These images are synthesized from a set of captures that are acquired in a realistic virtual environment for Unreal Engine 4 through an interface plugin. We gather a variety of well-known projection models such as equirectangular and cylindrical panoramas, different fish-eye lenses, catadioptric systems, and empiric models. Furthermore, we include in our tool photorealistic non-central-projection systems as non-central panoramas and non-central catadioptric systems. As far as we know, this is the first reported tool for generating photorealistic non-central images in the literature. Moreover, since the omnidirectional images are made virtually, we provide pixel-wise information about semantics and depth as well as perfect knowledge of the calibration parameters of the cameras. This allows the creation of ground-truth information with pixel precision for training learning algorithms and testing 3D vision approaches. To validate the proposed tool, different computer vision algorithms are tested as line extractions from dioptric and catadioptric central images, 3D Layout recovery and SLAM using equirectangular panoramas, and 3D reconstruction from non-central panoramas.
Open AccessOmniSCV: An Omnidirectional Synthetic Image Generator for Computer Vision
Omnidirectional and 360° images are becoming widespread in industry and in consumer society, causing omnidirectional computer vision to gain attention. Their wide field of view allows the gathering of a great amount of information about the environment from only an image. However, the distortion of these images requires the development of specific algorithms for their treatment and interpretation. Moreover, a high number of images is essential for the correct training of computer vision algorithms based on learning. In this paper, we present a tool for generating datasets of omnidirectional images with semantic and depth information. These images are synthesized from a set of captures that are acquired in a realistic virtual environment for Unreal Engine 4 through an interface plugin. We gather a variety of well-known projection models such as equirectangular and cylindrical panoramas, different fish-eye lenses, catadioptric systems, and empiric models. Furthermore, we include in our tool photorealistic non-central-projection systems as non-central panoramas and non-central catadioptric systems. As far as we know, this is the first reported tool for generating photorealistic non-central images in the literature. Moreover, since the omnidirectional images are made virtually, we provide pixel-wise information about semantics and depth as well as perfect knowledge of the calibration parameters of the cameras. This allows the creation of ground-truth information with pixel precision for training learning algorithms and testing 3D vision approaches. To validate the proposed tool, different computer vision algorithms are tested as line extractions from dioptric and catadioptric central images, 3D Layout recovery and SLAM using equirectangular panoramas, and 3D reconstruction from non-central panoramas.
- Open Access
- 1 July 2017
- Published by Elsevier in Pattern Recognition Letters
- Vol. 94, 30-37
Exploiting line metric reconstruction from non-central circular panoramas
- 1 July 2017
- Published by Elsevier in Pattern Recognition Letters
- Vol. 94, 30-37
Open AccessExploiting line metric reconstruction from non-central circular panoramas