Gradient of the Mutual Information in Stochastic Systems: A Functional Approach

Mahboobeh Sedighizad | Babak Seyfe

---

URL :   http://research.shahed.ac.ir/WSR/WebPages/Report/PaperView.aspx?PaperID=137385
Date :  2019/09/09
Publish in :    IEEE Signal Processing Letters
DOI :  https://doi.org/10.1109/LSP.2019.2937758
Link :  http://dx.doi.org/10.1109/LSP.2019.2937758
Keywords :Gradient of the mutual information, functional representation, correlation, log-likelihood function

Abstract :

---

In this letter, using a general functional model for the stochastic systems we show that, the gradient of the mutual informationwith respect to any arbitrary system parameters can be computed in general. Relying on this viewpoint, the validity condition of one of the main available results on the gradient of the mutual information is investigated. Also, the result on the general additive noise system model in the literature is recovered as a special case.