A model selection approach to signal denoising using Kullback's symmetric divergence

Abstract : We consider the determination of a soft/hard coefficients threshold for signal recovery embedded in additive Gaussian noise. This is closely related to the problem of variable selection in linear regression. Viewing the denoising problem as a model selection one, we propose a new information theoretical model selection approach to signal denoising. We first construct a statistical model for the unknown signal and then try to find the best approximating model (corresponding to the denoised signal) from a set of candidates. We adopt the Kullback's symmetric divergence as a measure of similarity between the unknown model and the candidate model. The best approximating model is the one that minimizes an unbiased estimator of this divergence. The advantage of a denoising method based on model selection over classical thresholding approaches, resides in the fact that the threshold is determined automatically without the need to estimate the noise variance. The proposed denoising method, called KICc-denoising (Kullback Information Criterion corrected) is compared with cross validation (CV), minimum description length (MDL) and the classical methods SureShrink and VisuShrink via a simulation study based on three different type of signals: chirp, seismic and piecewise polynomial.
Complete list of metadatas

https://hal-supelec.archives-ouvertes.fr/hal-00260925
Contributor : Karine El Rassi <>
Submitted on : Wednesday, March 5, 2008 - 4:37:56 PM
Last modification on : Thursday, March 29, 2018 - 11:06:03 AM
Long-term archiving on : Friday, September 28, 2012 - 10:45:26 AM

File

pspj06.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Maïza Bekara, Luc Knockaert, Abd-Krim Seghouane, Gilles Fleury. A model selection approach to signal denoising using Kullback's symmetric divergence. Signal Processing, Elsevier, 2006, Vol. 86, pp. 1400 -1409. ⟨10.1016/j.sigpro.2005.03.023⟩. ⟨hal-00260925⟩

Share

Metrics

Record views

392

Files downloads

201