High-Resolution Scalar Quantization with Rényi Entropy Constraint

  • We consider optimal scalar quantization with $r$th power distortion and constrained R\'enyi entropy of order $\alpha$. For sources with absolutely continuous distributions the high rate asymptotics of the quantizer distortion has long been known for $\alpha=0$ (fixed-rate quantization) and $\alpha=1$ (entropy-constrained quantization). These results have recently been extended to quantization with R\'enyi entropy constraint of order $\alpha \ge r+1$. Here we consider the more challenging case $\alpha\in [-\infty,0)\cup (0,1)$ and for a large class of absolutely continuous source distributions we determine the sharp asymptotics of the optimal quantization distortion. The achievability proof is based on finding (asymptotically) optimal quantizers via the companding approach, and is thus constructive.

Download full text files

Export metadata

  • Export Bibtex
  • Export RIS
  • Export XML

Additional Services

Share in Twitter Search Google Scholar
Author:Wolfgang Kreitmeier, Tamas Linder
Document Type:Preprint
Year of Completion:2011
Date of Publication (online):2011/07/08
Publishing Institution:Universität Passau
Release Date:2011/07/08
Tag:Companding; Rényi entropy; high-resolution asymptotics; optimal quantization
GND Keyword:Entropie; Maßtheorie; Quantisierung
This is a preprint of an article accepted for publication in the IEEE Transactions on Information Theory Journal, ISSN: 0018-9448. The original publication is available at http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=18 
Source:IEEE Transactions on Information Theory Journal, ISSN: 0018-9448
Institutes:Fakultät für Informatik und Mathematik / Mitarbeiter Lehrstuhl/Einrichtung der Fakultät für Informatik und Mathematik
Dewey Decimal Classification:5 Naturwissenschaften und Mathematik / 51 Mathematik / 510 Mathematik
MSC-Classification:28-XX MEASURE AND INTEGRATION (For analysis on manifolds, see 58-XX) / 28Dxx Measure-theoretic ergodic theory [See also 11K50, 11K55, 22D40, 37Axx, 47A35, 54H20, 60Fxx, 60G10] / 28D20 Entropy and other invariants
41-XX APPROXIMATIONS AND EXPANSIONS (For all approximation theory in the complex domain, see 30E05 and 30E10; for all trigonometric approximation and interpolation, see 42A10 and 42A15; for numerical approximation, see 65Dxx) / 41Axx Approximations and expansions / 41A46 Approximation by arbitrary nonlinear expressions; widths and entropy
62-XX STATISTICS / 62Hxx Multivariate analysis [See also 60Exx] / 62H30 Classification and discrimination; cluster analysis [See also 68T10]
94-XX INFORMATION AND COMMUNICATION, CIRCUITS / 94Axx Communication, information / 94A17 Measures of information, entropy
94-XX INFORMATION AND COMMUNICATION, CIRCUITS / 94Axx Communication, information / 94A29 Source coding [See also 68P30]
open_access (DINI-Set):open_access
Licence (German):License LogoStandardbedingung laut Einverständniserklärung

$Rev: 13581 $