GCGianluca Cernigliaro

Gianluca Cernigliaro

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Gianluca Cernigliaro has a total of 18 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Capítulo 7. Realidad virtual social y comunicaciones holográficas en 3D: oportunidades y retos pendientes en el sector de la educación

    by Mario Montagud Climent, Gianluca Cernigliaro, Miguel Arevalillo-Herráez, Miguel García-Pineda, Jaume Segura-Garcia, Sergi Fernández Langa

    En los últimos años se está explorando el uso y adopción de tecnologías innovadoras en el sector de la educación y aprendizaje. Asimismo, modelos de educación y docencia online están ganando protagonismo, ya sea debido a una implantación voluntaria o forzosa de programas de educación remota y/o híbrida. Este auge ha hecho palpable las limitaciones de los sistemas de comunicaciones audiovisuales 2D, como la videoconferencia, en varios sentidos: confort, calidad de interacción, conciencia situacional, (co-)presencia, etc. Este trabajo introduce un nuevo medio de comunicación, interacción y colaboración que promete ser un candidato idóneo para superar estas limitaciones haciendo uso de tecnologías inmersivas: la Realidad Virtual (RV) Social. En primer lugar, se aportará una revisión de evidencias científicas recientes que vislumbran y demuestran potenciales beneficios de este medio para diferentes casos de uso de interés, en comparación al uso de sistemas de videoconferencia 2D tradicionales. Asimismo, se destacarán los potenciales beneficios que puede aportar la disponibilidad de representaciones holográficas 3D de los usuarios en comparación al uso de avatares sintéticos (y por tanto, poco realistas) en entornos de RV Social. A continuación, se destacarán una serie de retos a nivel tecnológico y de experiencia de usuario a superar con tal de conseguir una implantación efectiva y masiva de este nuevo medio de comunicación. Palabras clave: realidad virtual social, comunicaciones holográficas, metaverso, holoportación, educación inmersiva, educación virtual.


  • Open Access

    Multiparty Holomeetings: Toward a New Era of Low-Cost Volumetric Holographic Meetings in Virtual Reality

    by Sergi Fernandez Langa, Mario Montagud, Gianluca Cernigliaro, David Rincon Rivera

    Fueled by advances in multi-party communications, increasingly mature immersive technologies being adopted, and the COVID-19 pandemic, a new wave of social virtual reality (VR) platforms have emerged to support socialization, interaction, and collaboration among multiple remote users who are integrated into shared virtual environments. Social VR aims to increase levels of (co-)presence and interaction quality by overcoming the limitations of 2D windowed representations in traditional multi-party video conferencing tools, although most existing solutions rely on 3D avatars to represent users. This article presents a social VR platform that supports real-time volumetric holographic representations of users that are based on point clouds captured by off-the-shelf RGB-D sensors, and it analyzes the platform’s potential for conducting interactive holomeetings (i.e., holoconferencing scenarios). This work evaluates such a platform’s performance and readiness for conducting meetings with up to four users, and it provides insights into aspects of the user experience when using single-camera and low-cost capture systems in scenarios with both frontal and side viewpoints. Overall, the obtained results confirm the platform’s maturity and the potential of holographic communications for conducting interactive multi-party meetings, even when using low-cost systems and single-camera capture systems in scenarios where users are sitting or have a limited translational movement along the X, Y, and Z axes within the 3D virtual environment (commonly known as 3 Degrees of Freedom plus, 3DoF+).


  • Open Access

    Multi-party Holomeetings: Toward a New Era of Low-Cost Volumetric Holographic Meetings in Virtual Reality

    by Sergi Fernández, Mario Montagud, Gianluca Cernigliaro, David Rincón

    Fueled by advances in multi-party communications, increasingly mature immersive technologies being adopted, and the COVID-19 pandemic, a new wave of social virtual reality (VR) platforms have emerged to support socialization, interaction, and collaboration among multiple remote users who are integrated into shared virtual environments. Social VR aims to increase levels of (co-)presence and interaction quality by overcoming the limitations of 2D windowed representations in traditional multi-party video conferencing tools, although most existing solutions rely on 3D avatars to represent users. This article presents a social VR platform that supports real-time volumetric holographic representations of users that are based on point clouds captured by off-the-shelf RGB-D sensors, and it analyzes the platform's potential for conducting interactive holomeetings (i.e., holoconferencing scenarios). This work evaluates such a platform's performance and readiness for conducting meetings with up to four users, and it provides insights into aspects of the user experience when using single-camera and low-cost capture systems in scenarios with both frontal and side viewpoints. Overall, the obtained results confirm the platform's maturity and the potential of holographic communications for conducting interactive multi-party meetings, even when using low-cost systems and single-camera capture systems in scenarios where users are sitting or have a limited translational movement along the X, Y, and Z axes within the 3D virtual environment (commonly known as 3 Degrees of Freedom plus, 3DoF+)

  • Toward Hyper-Realistic and Interactive Social VR Experiences in Live TV Scenarios

    by Sergi Fernandez Langa, Mario Montagud Climent, Gianluca Cernigliaro, David Rincon Rivera

    Social Virtual Reality (VR) allows multiple distributed users getting together in shared virtual environments to socially interact and collaborate. This article explores the applicability and potential of Social VR in the broadcast sector, focusing on a live TV show use case, by providing three main contributions: 1) a novel and lightweight social VR platform; 2) a professional piece of VR content to recreate an interactive live TV show; and 3) an analysis of the performance and user experience. The Social VR platform includes different innovative and outstanding features compared to state-of-the-art solutions. It allows a real-time integration of remote users in shared virtual environments, using realistic volumetric representations and affordable capturing systems, thus not relying on the use of synthetic avatars. It supports a seamless and rich integration of heterogeneous media formats, including 3D scenarios, dynamic volumetric representation of users and (live/stored) stereoscopic 2D and 180°/360° videos. In addition, it enables low-latency interaction between volumetric users and a video-based presenter (Chroma keying) and a dynamic control of the media playout to adapt to the session’s evolution. The article also describes the production process of an immersive an interactive TV show to demonstrate the platform’s capabilities and its potential benefits. On the one hand, the results from objective tests show the satisfactory performance of the platform. On the other hand, the promising results from user tests support the potential impact of the presented platform, opening up new opportunities in the broadcast sector.


  • Depth video coding for free viewpoint video oriented to the synthetic view perceptual quality

    by G Cernigliaro, F. Jaureguizar, J. Cabrera, N. Garcia

    In this paper we propose a novel depth encoding algorithm based on the synthetic view perceptual quality optimization. In Free Viewpoint Video, depth sequences are never shown to the observer but they are used for the view synthesis. Due to the compression quality losses, the depth distortion generates errors in the synthetic view pixel position. We propose to encode the depth sequences by a novel approach, divided into two parts. The first one is a rate distortion optimization method based on the minimization of the synthetic view pixel position error. The second one is an extension of the first one and improves the performance taking into account the perceptual distortion, evaluated by exploiting the Human Visual System characteristics described by the Just Noticeable Distortion. However, the Just Noticeable Distortion is a model designed for the traditional video, hence we also propose a Just Noticeable Pixel Displacement evaluation method which, considering the synthetic view perceptual distortion, is able to estimate when an error in the synthetic view pixel position is not noticed. The results show how the proposed algorithm not only improves the synthetic view quality measured by the Video Quality Metric (highly correlated to the subjective quality) but also the objective quality measured by the PSNR, with an achieved improvement of 0.3 dB with a corresponding bit saving of 13%.

  • Low Complexity Mode Decision and Motion Estimation for H.264/AVC Based Depth Maps Encoding in Free Viewpoint Video

    by Gianluca Cernigliaro, Fernando Jaureguizar, Julian Cabrera, Narciso Garcia

    Within free viewpoint video, the 3-D reconstruction of the scene is created from a high number of viewpoints. Every viewpoint is represented by a traditional sequence, called texture, and its associated depth information. This is known as a View plus Depth environment. In this paper, a novel low complexity mode decision and motion estimation algorithm for the H.264/AVC based encoding of depth sequences is proposed. Given that a texture sequence and its associated depth represent the same scene from the same point of view, they should have similar motion characteristics. The complexity reduction of the depth encoding, in the proposed algorithm, is obtained by taking advantage of the texture motion information that has been previously processed by a traditional H.264/AVC encoder. The characteristics of depth and texture sequences are analyzed, focusing on similarities and differences that are properly managed to design an algorithm able to detect when the motion information of the texture might be usefully exploited in the encoding of the corresponding depth sequence. The proposed method is able to achieve the same objective quality, measured by means of the PSNR and the VQM, than a traditional H.264/AVC encoder with a reduction of up to 58% of the computational burden.


  • Open Access

    Depth perceptual video coding for free viewpoint video based on H.264/AVC

    by G. Cernigliaro, M. Naccari, F. Jaureguizar, J. Cabrera, N. Garcia

    A novel scheme for depth sequences compression, based on a perceptual coding algorithm, is proposed. A depth sequence describes the object position in the 3D scene, and is used, in Free Viewpoint Video, for the generation of synthetic video sequences. In perceptual video coding the human visual system characteristics are exploited to improve the compression efficiency. As depth sequences are never shown, the perceptual video coding, assessed over them, is not effective. The proposed algorithm is based on a novel perceptual rate distortion optimization process, assessed over the perceptual distortion of the rendered views generated through the encoded depth sequences. The experimental results show the effectiveness of the proposed method, able to obtain a very considerable improvement of the rendered view perceptual quality.