Back to Search
Start Over
Operational Interpretation of Rényi Information Measures via Composite Hypothesis Testing Against Product and Markov Distributions.
- Source :
-
IEEE Transactions on Information Theory . Feb2018, Vol. 64 Issue 2, p1064-1082. 19p. - Publication Year :
- 2018
-
Abstract
- We revisit the problem of asymmetric binary hypothesis testing against a composite alternative hypothesis. We introduce a general framework to treat such problems when the alternative hypothesis adheres to certain axioms. In this case, we find the threshold rate, the optimal error and strong converse exponents (at large deviations from the threshold), and the second order asymptotics (at small deviations from the threshold). We apply our results to find the operational interpretations of various Rényi information measures. In case the alternative hypothesis is comprised of bipartite product distributions, we find that the optimal error and strong converse exponents are determined by the variations of Rényi mutual information. In case the alternative hypothesis consists of tripartite distributions satisfying the Markov property, we find that the optimal exponents are determined by the variations of Rényi conditional mutual information. In either case, the relevant notion of Rényi mutual information depends on the precise choice of the alternative hypothesis. As such, this paper also strengthens the view that different definitions of Rényi mutual information, conditional entropy, and conditional mutual information are adequate depending on the context in which the measures are used. [ABSTRACT FROM AUTHOR]
- Subjects :
- *MARKOV processes
*STOCHASTIC processes
*AXIOMS
*ENTROPY
*MATHEMATICAL analysis
Subjects
Details
- Language :
- English
- ISSN :
- 00189448
- Volume :
- 64
- Issue :
- 2
- Database :
- Academic Search Index
- Journal :
- IEEE Transactions on Information Theory
- Publication Type :
- Academic Journal
- Accession number :
- 127409003
- Full Text :
- https://doi.org/10.1109/TIT.2017.2776900