Image denoising is a fundamental task in computer vision, particularly in medical ultrasound (US) imaging, where speckle noise significantly degrades image quality. Although recent advancements in deep neural networks have led to substantial improvements in denoising for natural images, these methods cannot be directly applied to US speckle noise, as it is not purely random. Instead, US speckle arises from complex wave interference within the body microstructure, making it tissue-dependent. This dependency means that obtaining two independent noisy observations of the same scene, as required by pioneering Noise2Noise, is not feasible. Additionally, blind-spot networks also cannot handle US speckle noise due to its high spatial dependency. To address this challenge, we introduce Speckle2Self, a novel self-supervised algorithm for speckle reduction using only single noisy observations. The key insight is that applying a multi-scale perturbation (MSP) operation introduces tissue-dependent variations in the speckle pattern across different scales, while preserving the shared anatomical structure. This enables effective speckle suppression by modeling the clean image as a low-rank signal and isolating the sparse noise component. To demonstrate its effectiveness, Speckle2Self is comprehensively compared with conventional filter-based denoising algorithms and SOTA learning-based methods, using both realistic simulated US images and human carotid US images. Additionally, data from multiple US machines are employed to evaluate model generalization and adaptability to images from unseen domains.
Overview of the proposed despeckling framework. (a) Overall training process. (b) Inference using the trained despeckling model. The network generates despeckled images directly from original US images.
Compare different despeckling methods side by side using the slider below. (If the views become unsynchronized after switching methods, please switch to another frame to refresh.)
Drag the slider to compare the results of different despeckling methods side by side. Use the slider to select different B-mode slices.
Quantitative comparison of different methods for US speckle reduction in terms of PSNR, SSIM, Homogeneity (Hom), and LPIPS. The best-performing method for each metric, trained without clean images, is highlighted in bold. The supervised method results are marked in a gray shade. Note that for clinical carotid images, the Noise2Noise and supervised Noise2True methods are not applicable.
@article{li2025speckle2self,
title={Speckle2Self: Self-supervised ultrasound speckle reduction without clean data},
author={Li, Xuesong and Navab, Nassir and Jiang, Zhongliang},
journal={Medical Image Analysis},
pages={103755},
year={2025},
publisher={Elsevier}
}