Domain-Specific Optimisations for Image Processing on FPGAs

Citation

Ali T, Bhowmik D & Nicol R (2023) Domain-Specific Optimisations for Image Processing on FPGAs. Journal of Signal Processing Systems, 95, pp. 1167-1179. https://doi.org/10.1007/s11265-023-01888-2

Abstract
Image processing algorithms on FPGAs have increasingly become more pervasive in real-time vision applications. Such algorithms are computationally complex and memory intensive, which can be severely limited by available hardware resources. Optimisations are therefore necessary to achieve better performance and efficiency. We hypothesise that, unlike generic computing optimisations, domain-specific image processing optimisations can improve performance significantly. In this paper, we propose three domain-specific optimisation strategies that can be applied to many image processing algorithms. The optimisations are tested on popular image-processing algorithms and convolution neural networks on CPU/GPU/FPGA and the impact on performance, accuracy and power are measured. Experimental results show major improvements over the baseline non-optimised versions for both convolution neural networks (MobileNetV2 & ResNet50), Scale-Invariant Feature Transform (SIFT) and filter algorithms. Additionally, the optimised FPGA version of SIFT significantly outperformed an optimised GPU implementation when energy consumption statistics are taken into account.

Keywords
Domain-specific optimisation; FPGA; Real-time image processing; SIFT; Convolutional neural network optimisations

Journal
Journal of Signal Processing Systems: Volume 95

• Domain‑Specific Optimisations for Image Processing on FPGAs