HiDAnet: RGB-D Salient Object Detection via Hierarchical Depth Awareness - Institut de Chimie du CNRS Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Image Processing Année : 2023

HiDAnet: RGB-D Salient Object Detection via Hierarchical Depth Awareness

Résumé

RGB-D saliency detection aims to fuse multi-modal cues to accurately localize salient regions. Existing works often adopt attention modules for feature modeling, with few methods explicitly leveraging fine-grained details to merge with semantic cues. Thus, despite the auxiliary depth information, it is still challenging for existing models to distinguish objects with similar appearances but at distinct camera distances. In this paper, from a new perspective, we propose a novel Hierarchical Depth Awareness network (HiDAnet) for RGB-D saliency detection. Our motivation comes from the observation that the multigranularity properties of geometric priors correlate well with the neural network hierarchies. To realize multi-modal and multi-level fusion, we first use a granularity-based attention scheme to strengthen the discriminatory power of RGB and depth features separately. Then we introduce a unified cross dual-attention module for multi-modal and multi-level fusion in a coarse-to-fine manner. The encoded multi-modal features are gradually aggregated into a shared decoder. Further, we exploit a multi-scale loss to take full advantage of the hierarchical information. Extensive experiments on challenging benchmark datasets demonstrate that our HiDAnet performs favorably over the state-of-the-art methods by large margins. The source code can be found in https://github.com/Zongwei97/HIDANet/.
Fichier principal
Vignette du fichier
TIP.pdf (5.3 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04045138 , version 1 (24-03-2023)

Identifiants

Citer

Zongwei Wu, Guillaume Allibert, Fabrice Meriaudeau, Chao Ma, Cédric Demonceaux. HiDAnet: RGB-D Salient Object Detection via Hierarchical Depth Awareness. IEEE Transactions on Image Processing, 2023, 32, pp.2160 - 2173. ⟨10.1109/TIP.2023.3263111⟩. ⟨hal-04045138⟩
107 Consultations
84 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More