Back to Search
Start Over
A general rate-distortion converse bound for entropy-constrained scalar quantization
- Source :
- ISIT
- Publication Year :
- 2016
- Publisher :
- IEEE, 2016.
-
Abstract
- We derive a lower bound on the smallest output entropy that can be achieved via scalar quantization of a source with given expected quadratic distortion. As the allowed distortion tends to zero, the bound converges to the output entropy achieved by a uniform quantizer, thereby recovering the result by Gish and Pierce that uniform quantizers are asymptotically optimal. The proposed derivation applies for any memoryless source that has a probability density function (pdf), a finite differential entropy, and whose integer part has a finite entropy. In contrast to Gish and Pierce, we do not require any additional constraints on the continuity or decay of the source pdf.
- Subjects :
- Entropy power inequality
Differential entropy
Shannon's source coding theorem
Mathematical analysis
Maximum entropy probability distribution
0202 electrical engineering, electronic engineering, information engineering
Min entropy
020206 networking & telecommunications
02 engineering and technology
Quantum relative entropy
Joint quantum entropy
Entropy rate
Mathematics
Subjects
Details
- Database :
- OpenAIRE
- Journal :
- 2016 IEEE International Symposium on Information Theory (ISIT)
- Accession number :
- edsair.doi...........e817d967a3da2e129f00de13688330bd
- Full Text :
- https://doi.org/10.1109/isit.2016.7541396