Skip to Main content Skip to Navigation
Journal articles

A model selection approach to signal denoising using Kullback's symmetric divergence

Abstract : We consider the determination of a soft/hard coefficients threshold for signal recovery embedded in additive Gaussian noise. This is closely related to the problem of variable selection in linear regression. Viewing the denoising problem as a model selection one, we propose a new information theoretical model selection approach to signal denoising. We first construct a statistical model for the unknown signal and then try to find the best approximating model (corresponding to the denoised signal) from a set of candidates. We adopt the Kullback's symmetric divergence as a measure of similarity between the unknown model and the candidate model. The best approximating model is the one that minimizes an unbiased estimator of this divergence. The advantage of a denoising method based on model selection over classical thresholding approaches, resides in the fact that the threshold is determined automatically without the need to estimate the noise variance. The proposed denoising method, called KICc-denoising (Kullback Information Criterion corrected) is compared with cross validation (CV), minimum description length (MDL) and the classical methods SureShrink and VisuShrink via a simulation study based on three different type of signals: chirp, seismic and piecewise polynomial.
Complete list of metadatas
Contributor : Karine El Rassi <>
Submitted on : Wednesday, March 5, 2008 - 4:37:56 PM
Last modification on : Tuesday, June 30, 2020 - 4:04:07 PM
Long-term archiving on: : Friday, September 28, 2012 - 10:45:26 AM


Files produced by the author(s)




Maïza Bekara, Luc Knockaert, Abd-Krim Seghouane, Gilles Fleury. A model selection approach to signal denoising using Kullback's symmetric divergence. Signal Processing, Elsevier, 2006, Vol. 86, pp. 1400 -1409. ⟨10.1016/j.sigpro.2005.03.023⟩. ⟨hal-00260925⟩



Record views


Files downloads