open access publication

Conference Paper, 2024

PDA-RWSR: Pixel-Wise Degradation Adaptive Real-World Super-Resolution

2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), ISBN 979-8-3503-1892-0, Volume 00, Pages 4085-4095, 10.1109/wacv57701.2024.00405

Contributors

Aakerberg, Andreas 0000-0002-3911-2638 (Corresponding author) [1] Helou, Majed El 0000-0002-7469-2404 [2] Nasrollahi, Kamal 0000-0002-1953-0429 [1] [3] Moeslund, Thomas Baltzer 0000-0001-7584-5209 [1]

Affiliations

  1. [1] Aalborg University
  2. [NORA names: AAU Aalborg University; University; Denmark; Europe, EU; Nordic; OECD];
  3. [2] ETH Zurich
  4. [NORA names: Switzerland; Europe, Non-EU; OECD];
  5. [3] Milestone Systems, Denmark
  6. [NORA names: Denmark; Europe, EU; Nordic; OECD]

Abstract

While many methods have been proposed to solve the Super-Resolution (SR) problem of Low-Resolution (LR) images with complex unknown degradations, their performance still drops significantly when evaluated on images with challenging real-world degradations. One often overlooked factor contributing to this, is the presence of spatially varying degradations in real LR images. To address this issue, we propose a novel degradation pipeline capable of generating paired LR/High-Resolution (HR) images with spatially varying noise, a key contributor to reduced image quality. Furthermore, to fully leverage such training data, we novelly propose a Pixel-Wise Degradation Adaptive Real-World Super-Resolution (PDA-RWSR) framework. Specifically, we design a new Restormer-based Real-World Super-Resolution (RWSR) model capable of adapting the reconstruction process based on pixel-wise degradation features extracted by a new supervised degradation estimation model. Along with our proposed method, we also introduce a new challenging real-world Spatially Variant Super-Resolution (SVSR) benchmarking dataset, where the images are degraded by complex noise of varying intensity and type, to evaluate the robustness of existing RWSR methods. Comprehensive experiments on synthetic and the proposed challenging real dataset demonstrates the superiority of our method over the current State-of-The-Art (SoTA). The SVSR dataset is available at https://doi.org/10.5281/zenodo.10044260.

Keywords

Comprehensive experiments, HR, LR images, SOTA, SVSR, complex noise, data, dataset, degradation, degradation features, estimation model, experiments, factors, features, image quality, images, intensity, issues, low resolution, method, model, noise, performance, pipeline, presence, problem, problem of low resolution, process, quality, real-world super-resolution, reconstruction, reconstruction process, reduced image quality, robustness, spatially, spatially varying noise, state-of-the-art, super-resolution, superiority, training data, type

Data Provider: Digital Science