Mickael Raulet
Mickael Raulet has a total of 68 co-authors. Here are the top co-authors by number of shared publications:
- Thomas Guionnet
ATEME
9 shared publications - Christophe Burdinat
ATEME, Vélizy-Villacoublay, France
4 shared publications - Hervé Yviquel
Universidade Estadual de Campinas (UNICAMP)
3 shared publications - Marc Rivière
ATEME
3 shared publications Matthieu Wipliez
IETR, INSA of Rennes, 20 avenue des buttes de Coësmes, 35200 Rennes, France
3 shared publicationsOlivier Deforges
IETR/INSA. UMR CNRS 6164, F-35043 Rennes, France
3 shared publications
Latest Publications
- Open Access
- 18 February 2025
- Published by Association for Computing Machinery (ACM)
- p. 40-46
NEURAL VIDEO COMPRESSION OVERVIEW, PERFORMANCE AND CHALLENGES
- 18 February 2025
- Published by Association for Computing Machinery (ACM)
- p. 40-46
Open AccessNEURAL VIDEO COMPRESSION OVERVIEW, PERFORMANCE AND CHALLENGES
- Open Access
- 11 February 2024
- Published by Association for Computing Machinery (ACM)
- p. 85-86
AV1-Compatible Film Grain Modeling for HEVC Decoders
- 11 February 2024
- Published by Association for Computing Machinery (ACM)
- p. 85-86
Open AccessAV1-Compatible Film Grain Modeling for HEVC Decoders
- Open Access
- 11 February 2024
- Published by Association for Computing Machinery (ACM)
- p. 98
AI-based monocular depth map estimation applied to a video encoding pipeline
Depth information is used in many applications, including computational photography, especially in smartphones, scene analysis and 3D reconstruction. Obviously, depth information is useful for 3D related applications. It may seem less related to 2D applications such as traditional 2D video compression. However, it is demonstrated in this paper that depth information is a practical and useful addition to a video compression pipeline. In a first part, the problem of depth map computation is considered. For a long time, depth estimation required specific image features such as stereo pairs, specific camera motion or particular structures in the captured scene. More recently though, artificial intelligence (AI) unlocked fully generic depth estimation in monocular images. Thanks to careful algorithmic and implementation optimization, a real-time depth map computation method is proposed. In a second part, the usefulness of depth map estimation is considered through the example of frame interpolation, illustrated by experimental results. Finally it is discussed how depth maps can be an elementary analysis serving several steps in an encoding pipeline.
- 11 February 2024
- Published by Association for Computing Machinery (ACM)
- p. 98
Open AccessAI-based monocular depth map estimation applied to a video encoding pipeline
Depth information is used in many applications, including computational photography, especially in smartphones, scene analysis and 3D reconstruction. Obviously, depth information is useful for 3D related applications. It may seem less related to 2D applications such as traditional 2D video compression. However, it is demonstrated in this paper that depth information is a practical and useful addition to a video compression pipeline. In a first part, the problem of depth map computation is considered. For a long time, depth estimation required specific image features such as stereo pairs, specific camera motion or particular structures in the captured scene. More recently though, artificial intelligence (AI) unlocked fully generic depth estimation in monocular images. Thanks to careful algorithmic and implementation optimization, a real-time depth map computation method is proposed. In a second part, the usefulness of depth map estimation is considered through the example of frame interpolation, illustrated by experimental results. Finally it is discussed how depth maps can be an elementary analysis serving several steps in an encoding pipeline.
- Open Access
- 11 February 2024
- Published by Association for Computing Machinery (ACM)
- p. 87
MV-HEVC
Multiview High Efficiency Video Coding (MV-HEVC) is an HEVC extension focused on efficiently coding spatially related images, such as a left eye and right eye views of 3D stereoscopic content. MV-HEVC was released in the second version of HEVC back in October 2014 [2]. MV-HEVC was created alongside another extension named SHVC, which is already used in ATSC 3.0 use cases since 2018 [1]. The two extensions share many fundamentals, codified in an annex for common specifications for multi-layer extensions. Their base principle is scalability: A traditional HEVC decoder can rely on the base layer only, hence providing backward compatibility, but a more elaborate decoder can use the second layer as well to improve the rendition. The MV-HEVC format recently gained widespread attention with Apple announcing support for 3D movies on the Apple Vision Pro at WWDC23 [9][8]. Apple provided public guidelines on stereo video encoding [3], packaging [5], and streaming [4] as well as on providing parallax information to improve caption placement [6]. Apple also organized Apple Vision Pro developer labs [7]. This presentation will describe the MV-HEVC standard and how it works in theory. An implementation of MV-HEVC [10] will also be studied to assess performance in practice in industrial settings. Deployment aspects such as packaging and captioning will be discussed. Finally, 3D-specific optimization strategies will be analyzed, including software architecture and rate control.
- 11 February 2024
- Published by Association for Computing Machinery (ACM)
- p. 87
Open AccessMV-HEVC
Multiview High Efficiency Video Coding (MV-HEVC) is an HEVC extension focused on efficiently coding spatially related images, such as a left eye and right eye views of 3D stereoscopic content. MV-HEVC was released in the second version of HEVC back in October 2014 [2]. MV-HEVC was created alongside another extension named SHVC, which is already used in ATSC 3.0 use cases since 2018 [1]. The two extensions share many fundamentals, codified in an annex for common specifications for multi-layer extensions. Their base principle is scalability: A traditional HEVC decoder can rely on the base layer only, hence providing backward compatibility, but a more elaborate decoder can use the second layer as well to improve the rendition. The MV-HEVC format recently gained widespread attention with Apple announcing support for 3D movies on the Apple Vision Pro at WWDC23 [9][8]. Apple provided public guidelines on stereo video encoding [3], packaging [5], and streaming [4] as well as on providing parallax information to improve caption placement [6]. Apple also organized Apple Vision Pro developer labs [7]. This presentation will describe the MV-HEVC standard and how it works in theory. An implementation of MV-HEVC [10] will also be studied to assess performance in practice in industrial settings. Deployment aspects such as packaging and captioning will be discussed. Finally, 3D-specific optimization strategies will be analyzed, including software architecture and rate control.
- 1 August 2023
- Published by Society of Motion Picture and Television Engineers (SMPTE) in SMPTE Motion Imaging Journal
- Vol. 132 (7) , 39-44
Encoding and Storing Only Once: The Road to CMAF Adoption
The spectacular growth in video streaming consumption over the past decade has relied on Hypertext Transfer Protocol (HTTP) adaptive streaming (HAS), implemented by a variety of standards linked to several competing technological ecosystems. To serve this fragmented market and reach a heterogeneous set of target devices, operators have to decline their services into many flavors, leading to a complex video delivery infrastructure with many redundancies. As an extensible format for encoding and packaging, the Common Media Application Format (CMAF) standard emerged in 2016 from a collaborative industry effort to simplify and streamline HTTP-based streaming media, bringing the promise of encoding and storing the media only once, as an additional step toward video streaming sustainability. From the standard publication to its fulfillment of promises, CMAF is gradually overcoming a set of technological and economic challenges. This article details the primary considerations for its implementation, including device rollout, encryption scheme and low-latency support, and also evaluates the infrastructure footprint reduction for a typical operator.
- 1 August 2023
- Published by Society of Motion Picture and Television Engineers (SMPTE) in SMPTE Motion Imaging Journal
- Vol. 132 (7) , 39-44
Encoding and Storing Only Once: The Road to CMAF Adoption
The spectacular growth in video streaming consumption over the past decade has relied on Hypertext Transfer Protocol (HTTP) adaptive streaming (HAS), implemented by a variety of standards linked to several competing technological ecosystems. To serve this fragmented market and reach a heterogeneous set of target devices, operators have to decline their services into many flavors, leading to a complex video delivery infrastructure with many redundancies. As an extensible format for encoding and packaging, the Common Media Application Format (CMAF) standard emerged in 2016 from a collaborative industry effort to simplify and streamline HTTP-based streaming media, bringing the promise of encoding and storing the media only once, as an additional step toward video streaming sustainability. From the standard publication to its fulfillment of promises, CMAF is gradually overcoming a set of technological and economic challenges. This article details the primary considerations for its implementation, including device rollout, encryption scheme and low-latency support, and also evaluates the infrastructure footprint reduction for a typical operator.
- Open Access
- 7 June 2023
- Published by Association for Computing Machinery (ACM)
- p. 13-15
Audience Aware Streaming: New Dynamics in OTT distribution
Current OTT linear deployments are rather static infrastructures. The setup can be altered occasionally by an operator manipulation, based on anticipated audience or events. In this article, several real time optimizations are presented to decrease the traffic and hence to achieve energy and costs savings. Finally, the potential of central orchestration between encoding and CDN is outlined.
- 7 June 2023
- Published by Association for Computing Machinery (ACM)
- p. 13-15
Open AccessAudience Aware Streaming: New Dynamics in OTT distribution
Current OTT linear deployments are rather static infrastructures. The setup can be altered occasionally by an operator manipulation, based on anticipated audience or events. In this article, several real time optimizations are presented to decrease the traffic and hence to achieve energy and costs savings. Finally, the potential of central orchestration between encoding and CDN is outlined.
- Open Access
- 7 May 2023
- Published by Association for Computing Machinery (ACM)
- p. 124-125
Sustainable TV Distribution by Delivering Universal DVB-I TV Services
- 7 May 2023
- Published by Association for Computing Machinery (ACM)
- p. 124-125
Open AccessSustainable TV Distribution by Delivering Universal DVB-I TV Services
- Open Access
- 7 May 2023
- Published by Association for Computing Machinery (ACM)
- p. 78-84
AI-BASED LIGHT PARALLEL VIDEO ENCODER
This paper presents a software framework for end-to-end learned video coding. The main goal is to provide the research community with a platform adapted to practical applications. To accomplish this purpose, several features have been integrated, including basic utilities such as color conversion and advanced functions such as overlapping patch-coding to enable flexible memory consumption and adaptation to various hardware parallelization capabilities. The MS-SSIM function has been altered to fit this approach, and the rationale behind this modification is explained. This framework is meant to serve as a basis for validation and comparison of state-of-the-art end-to-end learned video codecs. Therefore, the codec part is a module that can be replaced while keeping the framework structure, and performance metrics are included. Experimental results are provided to illustrate the effectiveness of the framework.
- 7 May 2023
- Published by Association for Computing Machinery (ACM)
- p. 78-84
Open AccessAI-BASED LIGHT PARALLEL VIDEO ENCODER
This paper presents a software framework for end-to-end learned video coding. The main goal is to provide the research community with a platform adapted to practical applications. To accomplish this purpose, several features have been integrated, including basic utilities such as color conversion and advanced functions such as overlapping patch-coding to enable flexible memory consumption and adaptation to various hardware parallelization capabilities. The MS-SSIM function has been altered to fit this approach, and the rationale behind this modification is explained. This framework is meant to serve as a basis for validation and comparison of state-of-the-art end-to-end learned video codecs. Therefore, the codec part is a module that can be replaced while keeping the framework structure, and performance metrics are included. Experimental results are provided to illustrate the effectiveness of the framework.
- 1 March 2023
- Published by Society of Motion Picture and Television Engineers (SMPTE) in SMPTE Motion Imaging Journal
- Vol. 132 (2) , 40-50
ATSC 3.0, DVB-I, and TV 3.0 Services via 5G Broadcast—System Design and Reference Tools
5G broadcast brings the promise of an independent or complementary linear TV experience, which can reuse existing terrestrial broadcast infrastructure to serve high definition (HD) or 4K live content to mobile devices, possibly independent of a mobile subscription. To benefit fully from this new capability, the design of a service layer is essential, including service discovery procedures and delivery protocols over IP multicast. This article examines the set of the different standardized service layers brought by the 3GPP, Advanced Television Systems Committee (ATSC), and Digital Video Broadcasting (DVB), which could target different regions, ecosystems, or regulatory requirements. To support media service providers, a full ecosystem of tools is now emerging, including the Reference Tools from the 5G Media Action Group (5G-MAG) and the GPAC open-source solution. We will introduce the consolidated work from 3GPP and 5G-MAG to make this vision a reality, in terms of standardization and development of reference tools. We will detail how DVB-I services over 5G broadcast can now be experimented with commodity tools and commercial devices. We will also identify the potential synergies with ATSC 3.0 A/3311and the possibilities for Brazil’s TV 3.0 project,2for which Real-time Object delivery over Unidirectional Transport (ROUTE)/dynamic adaptive streaming over HTTP (DASH) is the transport layer of choice and 5G broadcast is a candidate for the physical layer.
- 1 March 2023
- Published by Society of Motion Picture and Television Engineers (SMPTE) in SMPTE Motion Imaging Journal
- Vol. 132 (2) , 40-50
ATSC 3.0, DVB-I, and TV 3.0 Services via 5G Broadcast—System Design and Reference Tools
5G broadcast brings the promise of an independent or complementary linear TV experience, which can reuse existing terrestrial broadcast infrastructure to serve high definition (HD) or 4K live content to mobile devices, possibly independent of a mobile subscription. To benefit fully from this new capability, the design of a service layer is essential, including service discovery procedures and delivery protocols over IP multicast. This article examines the set of the different standardized service layers brought by the 3GPP, Advanced Television Systems Committee (ATSC), and Digital Video Broadcasting (DVB), which could target different regions, ecosystems, or regulatory requirements. To support media service providers, a full ecosystem of tools is now emerging, including the Reference Tools from the 5G Media Action Group (5G-MAG) and the GPAC open-source solution. We will introduce the consolidated work from 3GPP and 5G-MAG to make this vision a reality, in terms of standardization and development of reference tools. We will detail how DVB-I services over 5G broadcast can now be experimented with commodity tools and commercial devices. We will also identify the potential synergies with ATSC 3.0 A/3311and the possibilities for Brazil’s TV 3.0 project,2for which Real-time Object delivery over Unidirectional Transport (ROUTE)/dynamic adaptive streaming over HTTP (DASH) is the transport layer of choice and 5G broadcast is a candidate for the physical layer.
- 1 January 2023
- Published by Society of Motion Picture and Television Engineers (SMPTE)
- p. 16-22
The future of video compression - Moving beyond hybrid codecs with machine learning
The consumption of video content on the internet is increasing at a constant pace, along with an increase of video quality. As an answer to the ever-growing demand for high quality video, compression technology improves steadily. About every decade, a new major video compression standard is issued, providing a decrease of bitrate by a factor two. Interestingly, the technology does not change radically between codecs generations. Instead, the same principles are re-used and pushed further. There has been several attempts to depart from this model, but none achieved to be competitive. Recently, the research community has started focusing on deep learning-based strategies. Could it be the new contender to the classical approach? This paper analyzes the benefits and limitations of deep learning-based video compression methods, and investigates practical aspects such as rate control, delay, memory consumption and power consumption. Overlapping patch-based end-to-end video compression strategy is proposed to overcome memory limitations.
- 1 January 2023
- Published by Society of Motion Picture and Television Engineers (SMPTE)
- p. 16-22
The future of video compression - Moving beyond hybrid codecs with machine learning
The consumption of video content on the internet is increasing at a constant pace, along with an increase of video quality. As an answer to the ever-growing demand for high quality video, compression technology improves steadily. About every decade, a new major video compression standard is issued, providing a decrease of bitrate by a factor two. Interestingly, the technology does not change radically between codecs generations. Instead, the same principles are re-used and pushed further. There has been several attempts to depart from this model, but none achieved to be competitive. Recently, the research community has started focusing on deep learning-based strategies. Could it be the new contender to the classical approach? This paper analyzes the benefits and limitations of deep learning-based video compression methods, and investigates practical aspects such as rate control, delay, memory consumption and power consumption. Overlapping patch-based end-to-end video compression strategy is proposed to overcome memory limitations.