Refine
Year of publication
- 2009 (2)
Document Type
- Preprint (2)
Has Fulltext
- yes (2)
Is part of the Bibliography
- no (2)
Keywords
- Entropie <Informationstheorie> (2) (remove)
Optimal quantization for the one-dimensional uniform distribution with Rényi -α-entropy constraints
(2009)
We establish the optimal quantization problem for probabilities under constrained Rényi-α-entropy of the quantizers. We determine the optimal quantizers and the optimal quantization error of one-dimensional uniform distributions including the known special cases α = 0 (restricted codebook size) and α = 1 (restricted Shannon entropy).
We consider the problem of optimal quantization with norm exponent r > 0 for Borel probabilities on R<sup>d</sup> under constrained Rényi-α-entropy of the quantizers. If the bound on the entropy becomes large, then sharp asymptotics for the optimal quantization error are well-known in the special cases α = 0 (memory-constrained quantization) and α = 1 (Shannon-entropy-constrained quantization). In this paper we determine sharp asymptotics for the optimal quantization error under large entropy bound with entropy parameter α ∈ [1+r/d, ∞]. For α ∈ [0,1+r/d[ we specify the asymptotical order of the optimal quantization error under large entropy bound. The optimal quantization error decays exponentially fast with the entropy bound and the exact decay rate is determined for all α ∈ [0, ∞].