Article Dans Une Revue IEEE Transactions on Image Processing Année : 2025

Exploiting Latent Properties to Optimize Neural Codecs

Résumé

End-to-end image and video codecs are becoming increasingly competitive, compared to traditional compression techniques that have been developed through decades of manual engineering efforts. These trainable codecs have many advantages over traditional techniques, such as their straightforward adaptation to perceptual distortion metrics and high performance in specific fields thanks to their learning ability. However, current state-of-the-art neural codecs do not fully exploit the benefits of vector quantization and the existence of the entropy gradient in decoding devices. In this paper, we propose to leverage these two properties (vector quantization and entropy gradient) to improve the performance of off-the-shelf codecs. Firstly, we demonstrate that using non-uniform scalar quantization cannot improve performance over uniform quantization. We thus suggest using predefined optimal uniform vector quantization to improve performance. Secondly, we show that the entropy gradient, available at the decoder, is correlated with the reconstruction error gradient, which is not available at the decoder. We therefore use the former as a proxy to enhance compression performance. Our experimental results show that these approaches save between 1 to 3% of the rate for the same quality across various pretrained methods. In addition, the entropy gradient based solution improves traditional codec performance significantly as well.
Fichier principal
Vignette du fichier
Exploiting_Latent_Properties_to_Optimize_Neural_Codecs.pdf (6) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04945981 , version 1 (23-02-2025)

Identifiants

Citer

Muhammet Balcilar, Bharath Bhushan Damodaran, Karam Naser, Franck Galpin, Pierre Hellier. Exploiting Latent Properties to Optimize Neural Codecs. IEEE Transactions on Image Processing, 2025, IEEE transactions on image processing, 34, pp.306 - 319. ⟨10.1109/tip.2024.3522813⟩. ⟨hal-04945981⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

More