There are no universally accepted definitions of R\'enyi conditional entropy and R\'enyi mutual information, although motivated by different applications, several definitions have been proposed in the literature. In this paper, we consider a family of two-parameter R\'enyi conditional entropy and a family of two-parameter R\'enyi mutual information. By performing a change of variables for the parameters, the two-parameter R\'enyi conditional entropy we study coincides precisely with the definition introduced by Hayashi and Tan [IEEE Trans. Inf. Theory, 2016], and it also emerges naturally as the classical specialization of the three-parameter quantum R\'enyi conditional entropy recently put forward by Rubboli, Goodarzi, and Tomamichel [arXiv:2410.21976 (2024)]. We establish several fundamental properties of the two-parameter R\'enyi conditional entropy, including monotonicity with respect to the parameters and variational expression. The associated two-parameter R\'enyi mutual information considered in this paper is new and it unifies three commonly used variants of R\'enyi mutual information. For this quantity, we prove several important properties, including the non-negativity, additivity, data processing inequality, monotonicity with respect to the parameters, variational expression, as well as convexity and concavity. Finally, we demonstrate that these two-parameter R\'enyi information quantities can be used to characterize the strong converse exponents in privacy amplification and soft covering problems under R\'enyi divergence of order $\alpha \in (0, \infty)$.
翻译:尽管针对不同应用场景,文献中已提出多种定义,但Rényi条件熵与Rényi互信息至今尚未形成普遍接受的定义标准。本文研究一类双参数Rényi条件熵族与双参数Rényi互信息族。通过对参数进行变量替换,我们所研究的双参数Rényi条件熵与Hayashi和Tan在《IEEE信息论汇刊》(2016年)提出的定义完全一致,同时也自然地作为Rubboli、Goodarzi和Tomamichel近期在arXiv:2410.21976(2024年)提出的三参数量子Rényi条件熵的经典特例而出现。我们建立了双参数Rényi条件熵的若干基本性质,包括参数单调性与变分表达式。本文提出的关联双参数Rényi互信息是全新定义,它统一了三种常用的Rényi互信息变体。针对该信息量,我们证明了若干重要性质:非负性、可加性、数据处理不等式、参数单调性、变分表达式,以及凸性与凹性。最后,我们证明这些双参数Rényi信息量可用于刻画在阶数α∈(0,∞)的Rényi散度下,隐私放大与软覆盖问题中的强逆指数特性。