Self-Learning Hyperspectral and Multispectral Image Fusion via Adaptive Residual Guided Subspace Diffusion Model
Jian Zhu, He Wang, Yang Xu, Zebin Wu, and Zhihui Wei
Nanjing University of Science and Technology
- Environment setup
conda create -n args python=3.9
conda activate args
- Requirements installation
pip install -r requirements.txt
python sample_subspace.py --mode 'semi'
refer to ARGS-Diff-train to train the spatial and spectral networks
-
Place the
pavia.mat
file into thedata
folder. This file should contain the following keys:LR-HSI
,HR-MSI
, and optionallyHR-HSI
. -
Copy the pretrained model file
ema_0.9999_030000.pt
from the training project ARGS-Diff-trainspatial_train_result/pavia/
to theckpt/pavia/
directory of the current project, and rename it tospa.pt
. -
Modify line 46 in
sample_subspace.py
to use"pavia"
, then run:python sample_subspace.py --mode 'semi'
Some of the codes are built upon denoising-diffusion-pytorch and MIAE.