TY - JOUR
T1 - S3RNet
T2 - Sparse Spatial-Spectral Representation With Hybrid Knowledge Distillation for Efficient Multispectral and Hyperspectral Image Fusion
AU - Hsu, Chih Chung
AU - Lee, Chia Ming
AU - Lin, Yu Fan
AU - Ni, Chih Chien
AU - Kang, Li Wei
N1 - Publisher Copyright:
© 2026 IEEE.
PY - 2026
Y1 - 2026
N2 - Multispectral image (MSI) and hyperspectral image (HSI) fusion is a key enabler for real-time and near real-time remote sensing analysis, where low-resolution HSI (LR-HSI) must be combined with high-resolution MSI (HR-MSI) under tight computational and bandwidth constraints. Although recent deep learning based fusion methods have achieved impressive performance, many of them rely on deep and heavy architectures that are difficult to deploy on resource-limited platforms and are highly sensitive to noise corruption. To address these issues, we propose the Sparse Spatial-Spectral Representation Network (S3RNet). The proposed framework introduces three main components as follows. 1) A multibranch fusion network that captures specialized and complementary spatial-spectral features across parallel branches. 2) A dense feature aggregation block that exploits dense connectivity for efficient feature extraction and propagation. 3) A spatial-spectral adaptive weight block that learns content-aware sparse representations to suppress noise and enhance robustness. In addition, we develop a hybrid online knowledge distillation strategy that transfers knowledge from a high-capacity teacher network to a lightweight student network, striking a favorable balance between reconstruction fidelity and model complexity. Extensive experiments and analyses demonstrate that S^{3}$RNet delivers state-of-the-art fusion accuracy, strong robustness to various noise levels, and competitive runtime, making it well suited for practical remote sensing applications that require efficient MS-HS image fusion.
AB - Multispectral image (MSI) and hyperspectral image (HSI) fusion is a key enabler for real-time and near real-time remote sensing analysis, where low-resolution HSI (LR-HSI) must be combined with high-resolution MSI (HR-MSI) under tight computational and bandwidth constraints. Although recent deep learning based fusion methods have achieved impressive performance, many of them rely on deep and heavy architectures that are difficult to deploy on resource-limited platforms and are highly sensitive to noise corruption. To address these issues, we propose the Sparse Spatial-Spectral Representation Network (S3RNet). The proposed framework introduces three main components as follows. 1) A multibranch fusion network that captures specialized and complementary spatial-spectral features across parallel branches. 2) A dense feature aggregation block that exploits dense connectivity for efficient feature extraction and propagation. 3) A spatial-spectral adaptive weight block that learns content-aware sparse representations to suppress noise and enhance robustness. In addition, we develop a hybrid online knowledge distillation strategy that transfers knowledge from a high-capacity teacher network to a lightweight student network, striking a favorable balance between reconstruction fidelity and model complexity. Extensive experiments and analyses demonstrate that S^{3}$RNet delivers state-of-the-art fusion accuracy, strong robustness to various noise levels, and competitive runtime, making it well suited for practical remote sensing applications that require efficient MS-HS image fusion.
KW - Hyperspectral image
KW - image fusion
KW - knowledge distillation (KD)
KW - multispectral image (MSI)
KW - real-time processing
KW - remote sensing
KW - sparse representation
KW - teacher-student learning
UR - https://www.scopus.com/pages/publications/105039093410
UR - https://www.scopus.com/pages/publications/105039093410#tab=citedBy
U2 - 10.1109/JSTARS.2026.3692909
DO - 10.1109/JSTARS.2026.3692909
M3 - Article
AN - SCOPUS:105039093410
SN - 1939-1404
VL - 19
SP - 20451
EP - 20470
JO - IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
JF - IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
ER -