On Dependence Measures Based on $f$-Divergence and $\Phi$-Entropy

2026-10-22来源 arXiv math.ITEnglish
arXiv:2503.03754v3 Announce Type: replace Abstract: We study dependence measures induced by $\Phi$-divergence (also known as $ f$-divergence in the literature) for finite random variables. We define conditional $\Phi$-mutual information through an exact chain rule and develop its structural properties and variational representations. But in general it lacks conditional symmetry and deterministic self-reduction. To tackle this, we introduce max-$\Phi$-mutual information $\wIPhi$, a variational envelope obtained by optimizing over $\IPhi$ quantities containing auxiliary random variables, which restores both properties and satisfies a subadditive chain rule. Both quantities reduce to Shannon's mutual information when $\Phi(t)=t\log t$. For smooth convex generators with $\Phi(0)

原文:https://www.a8q9.cn/en/article/on-dependence-measures-based-on-f-divergence-and-phi-entropy-a4820d.html

相关文章