When training a Learned Image Compression model, the loss function is minimized such that the encoder and the decoder attain a target Rate-Distorsion trade-off. Therefore, a distinct model shall be trained and stored at the transmitter and receiver for each target rate, fostering the quest for efficient variable bitrate compression schemes. This paper proposes plugging Low-Rank Adapters into a transformer-based pre-trained LIC model and training them to meet different target rates. With our method, encoding an image at a variable rate is as simple as training the corresponding adapters and plugging them into the frozen pre-trained model. Our experiments show performance comparable with state-of-the-art fixed-rate LIC models at a fraction of the training and deployment cost. We publicly released the code at https://github.com/EIDOSLAB/ALICE.

ALICE: Adapt your Learnable Image Compression modEl for variable bitrates

Spadaro, Gabriele
First
;
Presta, Alberto;Fiandrotti, Attilio;Grangetto, Marco;Tartaglione, Enzo
2024-01-01

Abstract

When training a Learned Image Compression model, the loss function is minimized such that the encoder and the decoder attain a target Rate-Distorsion trade-off. Therefore, a distinct model shall be trained and stored at the transmitter and receiver for each target rate, fostering the quest for efficient variable bitrate compression schemes. This paper proposes plugging Low-Rank Adapters into a transformer-based pre-trained LIC model and training them to meet different target rates. With our method, encoding an image at a variable rate is as simple as training the corresponding adapters and plugging them into the frozen pre-trained model. Our experiments show performance comparable with state-of-the-art fixed-rate LIC models at a fraction of the training and deployment cost. We publicly released the code at https://github.com/EIDOSLAB/ALICE.
2024
2024 IEEE International Conference on Visual Communications and Image Processing, VCIP 2024
Tokyo, Japan
2024
2024 IEEE International Conference on Visual Communications and Image Processing, VCIP 2024
Institute of Electrical and Electronics Engineers Inc.
1
5
9798331529543
Spadaro, Gabriele; Ali, Muhammad Salman; Presta, Alberto; Pilo, Giommaria; Bae, Sung-Ho; Giraldo, Jhony H.; Fiandrotti, Attilio; Grangetto, Marco; Tar...espandi
File in questo prodotto:
File Dimensione Formato  
ALICE_Adapt_your_Learnable_Image_Compression_modEl_for_variable_bitrates.pdf

Accesso riservato

Tipo di file: PDF EDITORIALE
Dimensione 1.27 MB
Formato Adobe PDF
1.27 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2318/2068455
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact