%0 Conference Proceedings
%T Accelerating Transformer-Based Scene Text Detection and Recognition via Token Pruning
%A Sergi Garcia Bordils
%A Dimosthenis Karatzas
%A Marçal Rusiñol
%B 17th International Conference on Document Analysis and Recognition
%D 2023
%V 14192
%F Sergi Garcia Bordils2023
%O DAG
%O exported from refbase (http://158.109.8.37/show.php?record=3907), last updated on Tue, 30 Jan 2024 15:53:50 +0100
%X Scene text detection and recognition is a crucial task in computer vision with numerous real-world applications. Transformer-based approaches are behind all current state-of-the-art models and have achieved excellent performance. However, the computational requirements of the transformer architecture makes training these methods slow and resource heavy. In this paper, we introduce a new token pruning strategy that significantly decreases training and inference times without sacrificing performance, striking a balance between accuracy and speed. We have applied this pruning technique to our own end-to-end transformer-based scene text understanding architecture. Our method uses a separate detection branch to guide the pruning of uninformative image features, which significantly reduces the number of tokens at the input of the transformer. Experimental results show how our network is able to obtain competitive results on multiple public benchmarks while running at significantly higher speeds.
%K Scene Text Detection
%K Scene Text Recognition
%K Transformer Acceleration
%U https://link.springer.com/chapter/10.1007/978-3-031-41731-3_7
%P 106-121