Wavelet-based Bi-dimensional Aggregation Network for SAR Image Change Detection

The proposed WSM employs Discrete Wavelet Transform (DWT) and Inverse Discrete Wavelet Transform (IDWT) to facilitate down-sampling in the attention mechanism. The wavelet transform enables feature extraction at both coarse and fine-grained scales, while also ensuring that the down-sampling is invertible. Due to the simple structure and high computational efficiency of Haar wavelet, it can quickly complete the downsampling operation. Furthermore, SAR change images often exhibit considerable sharp high-frequency information while Haar wavelet is adept at effectively capturing these high-frequency components[14]. Thus, we select Haar wavelet to conduct the downsample operation. The structure of this module is shown in Fig. 2.

To efficiently process the input feature $X\in\mathbb{R}^{H\times W\times C}$, we first reduce its channel dimensions to $\widetilde{X}\in\mathbb{R}^{H\times W\times\frac{C}{4}}$ using a learnable transformation matrix $W_{d}\in\mathbb{R}^{C\times\frac{C}{4}}$. Following this channel reduction, we apply DWT with the Haar wavelet to down-sample $\widetilde{X}$, and decompose it into four distinct subbands.

Haar wavelet is composed of the low-pass filter $f_{L}=\left(\frac{1}{\sqrt{2}},\frac{1}{\sqrt{2}}\right)$ and high-pass filter $f_{H}=\left(\frac{1}{\sqrt{2}},-\frac{1}{\sqrt{2}}\right)$. We first encode $\widetilde{X}$ into two subbands $X_{L}$ and $X_{H}$ along the rows. Subsequently, these subbands are processed using the same filters along the columns, resulting in four wavelet subbands: $X_{LL},X_{LH},X_{HL},$ and $X_{HH}$. Here, $X_{LL}\in\mathbb{R}^{\frac{H}{2}\times\frac{W}{2}\times\frac{C}{4}}$ encodes the low-frequency components, and contains coarse-grained structural information. $X_{LH},X_{HL},X_{HH}\in\mathbb{R}^{\frac{H}{2}\times\frac{W}{2}\times\frac{C}{4}}$ represent the high-frequency components, and describe fine-grained textures.

We then concatenate these four subbands along the channel dimension to get $\hat{X}$:

The concatenated output $\hat{X}$ is transformed into Key ($K^{w}$) and Value ($V^{w}$) matrices through the convolutional layer, while the Query ($Q$) remains the original input image $X$. In this case, wavelet-based multi-head self-attention computes the interaction across these elements for each head as follows:

where ${K}_{i}^{w}$ denotes the down-sampled key, ${V}_{i}^{w}$ denotes the down-sampled value, and ${D_{h}}$ represents the dimension of each head.

To enhance the output of the wavelet-based self-attention block, we apply the IDWT to $\hat{X}$ to produce $X^{\boldsymbol{r}}$. The reconstructed $X^{\boldsymbol{r}}$ mirrors the details of the original input image, providing excellent local contextualization and an expanded receptive field. The final output integrates the contributions of each attention head with this reconstructed map. This integration is essential for effectively capturing information across multiple scales.

The overall operation can be formulated as follows:

where ${N_{h}}$ represents the number of attention heads, and ${W}^{O}$ is the transformation matrix that combines all the heads and the reconstructed image into a single output tensor. The use of wavelet transform in the self-attention mechanism significantly enhances the ability to contextualize information over longer ranges with a reduced computational load compared to conventional self-attention modules. This approach ensures that both global coherence and local detail are preserved and emphasized in the model’s outputs.

To enhance the non-linear representation capabilities and effectively capture both spatial and channel dependencies, we develop Bi-dimensional Aggregation Module (BAM), as depicted in Fig. 3. This module includes two branches: the channel aggregation branch and the spatial aggregation branch.

Channel Aggregation: In this branch, average pooling is applied in the spatial dimension of input features $X\in\mathbb{R}^{{H\times{W}\times{C}}}$ to aggregate global representations. Subsequently, a fully connected layer (FC) coupled with a GELU activation function reduces the channel dimensions from $C$ to $\frac{C}{r}$, producing an intermediate output $\hat{X}$. Here, $r$, the reduction ratio, is set to 2. This is followed by FC layer and Sigmoid activation function to generate the output of the channel attention branch, $X^{C}\in\mathbb{R}^{1\times 1\times C}$.

Spatial Aggregation: First, a linear transformation, together with a GELU activation, transforms the channel dimension to $\frac{C}{r}$, while the spatial dimensions remain unchanged. The resulting intermediate output, $\widetilde{X}$, is then concatenated with $\hat{X}$ to form $\widetilde{X}^{\prime}\in\mathbb{R}^{H\times W\times\frac{2C}{r}}$. The process culminates similarly to the channel attention branch, resulting in the final output $X^{S}\in\mathbb{R}^{H\times W\times 1}$.

The outputs of both branches, $X^{C}$ and $X^{S}$, are merged through an element-wise summation, ensuring the final output retains the same dimensions as the original input $X$. This integration optimally combines the refined channel and spatial information, enhancing the overall feature representation while maintaining focus on both global context and local details.

To validate the effectiveness of the proposed WBANet, we conducted comprehensive experiments on three distinct SAR datasets: Chao Lake, the Yellow River, and Sulzberger Datasets. Chao Lake Dataset: This dataset includes images of Chao Lake in China, captured in May 2020 using the Sentinel-1 sensor. This period coincides with the highest recorded water levels in the lake’s history, providing a dynamic range of changes to detect. Sulzberger Dataset: Captured by the European Space Agency’s Envisat satellite over five days in March 2011, this dataset documents the breakup of an ice shelf, offering a unique perspective on drastic natural events. Yellow River Dataset: This dataset focuses on the Yellow River Estuary in China, with data collected from June 2008 to June 2009 using the Radarset-2 SAR sensor. This dataset is particularly challenging due to the pronounced speckle noise.

The hierarchical fuzzy c-means algorithm could classify pixels into changed, unchanged, and intermediate categories. Pixels from the changed and unchanged groups are randomly selected as training data, while intermediate group pixels are the test data. For a thorough assessment of our model, we employed five commonly used evaluation metrics: False Positives (FP), False Negatives (FN), Overall Error (OE), Percentage of Correct Classification (PCC), and the Kappa Coefficient (KC).

We evaluated our WBANet against five state-of-the-art methods: CWNN [15], SAFNet [16], DDNet [17], LANTNet [18], and CAMixer [11], implemented using default parameters from their studies. All the experiments, except for the CWNN running with Matlab, were conducted on the Google Colab platform with Python 3.10.12, PyTorch 2.1.0, and an NVIDIA Tesla T4 GPU with 15 GB of memory.

Quantitative results are detailed in Table I. For the Chao Lake dataset, our WBANet excels in all metrics except false negatives (FN), with significant improvements in the Kappa Coefficient (KC) by 24.37%, 3.83%, 2.34%, 1.18%, and 0.82% over CWNN, SAFNet, DDNet, LANTNet, and CAMixer, respectively. On the Sulzberger dataset, WBANet outperforms other methods in overall error (OE), PCC, and KC. Although CAMixer and CWNN show lower FP and FN rates respectively, they both register higher OEs compared to our WBANet. Similarly, on the Yellow River dataset, WBANet leads in all metrics apart from FN. Notably, it enhances the KC value by 5.69%, 4.46%, 4.39%, 2.79%, and 2.35% over CWNN, SAFNet, DDNet, LANTNet, and CAMixer, respectively. While CWNN records a lower FN rate, it lags significantly behind in FP and OE.

Fig. 4 illustrates the visual comparison of change maps produced by different methods on three datasets. Compared to the baseline methods, such as CWNN and SAFNet, our WBANet generates change maps that are visually closer to the ground truth and contain less noise. For instance, in the Yellow River dataset, where speckle noise greatly impacts performance, it is challenging to produce accurate change maps. Here, the performance of CWNN and SAFNet is notably degraded, while DDNet, LANTNet, and CAMixer frequently misclassify changed pixels as unchanged.

Experimental results on three SAR datasets confirm that our proposed WBANet outperforms other state-of-the-art methods. The effectiveness of our WSM and BAM demonstrates significant contributions to attention feature extraction and non-linear representation modeling.

To evaluate the effectiveness of the proposed Wavelet-based Self-attention Block and Bi-dimensional Aggregation Module, ablation experiments were performed on three datasets. We designed three variants: (1) Basic Network, which is the WBANet without the WSM and BAM; (2) w/o WSM, which omits the Wavelet-based Self-attention Module; and (3) w/o BAM, which lacks the Bi-dimensional Aggregation Module. The results in Table II clearly show that both the WSM and the BAM significantly enhance the non-linear representation capabilities, thereby improving change detection performance.

Additionally, we utilized the t-SNE [19] tool to visualize feature characteristics before and after applying the Wavelet-based Self-attention Block. As depicted in Fig. 5, the representations post-application display more distinct, well-defined clusters compared to the original input.

The number of Wavelet-based Bi-dimensional Aggregation Blocks, denoted as $N$, is a crucial parameter. We explored the relationship between $N$ and the Percentage of Correct Classification (PCC) by varying $N$ from 0 to 8. As illustrated in Fig. 6, PCC consistently improves with an increase in the number of Wavelet-based Bi-dimensional Aggregation Blocks up to 5. However, beyond this point, PCC begins to decline due to the increased model complexity. Consequently, we optimized $N$ for different datasets: $N=5$ for the Chao Lake dataset, $N=2$ for the Sulzberger dataset, and $N=4$ for the Yellow River dataset.