TY  - CONF
AU  - Mingyi Yang
AU  - Luis Herranz
AU  - Fei Yang
AU  - Luka Murn
AU  - Marc Gorriz Blanch
AU  - Shuai Wan
AU  - Fuzheng Yang
AU  - Marta Mrak
A2  - ICASSP
PY  - 2023//
TI  - Semantic Preprocessor for Image Compression for Machines
BT  - IEEE International Conference on Acoustics, Speech and Signal Processing
N2  - Visual content is being increasingly transmitted and consumed by machines rather than humans to perform automated content analysis tasks. In this paper, we propose an image preprocessor that optimizes the input image for machine consumption prior to encoding by an off-the-shelf codec designed for human consumption. To achieve a better trade-off between the accuracy of the machine analysis task and bitrate, we propose leveraging pre-extracted semantic information to improve the preprocessor’s ability to accurately identify and filter out task-irrelevant information. Furthermore, we propose a two-part loss function to optimize the preprocessor, consisted of a rate-task performance loss and a semantic distillation loss, which helps the reconstructed image obtain more information that contributes to the accuracy of the task. Experiments show that the proposed preprocessor can save up to 48.83% bitrate compared with the method without the preprocessor, and save up to 36.24% bitrate compared to existing preprocessors for machine vision.
UR  - https://ieeexplore.ieee.org/document/10096472
UR  - http://dx.doi.org/10.1109/ICASSP49357.2023.10096472
N1  - MACO; LAMP
ID  - Mingyi Yang2023
ER  -