Rate–distortion theory
View article: Causal Contextual Prediction for Learned Image Compression
Causal Contextual Prediction for Learned Image Compression Open
Over the past several years, we have witnessed impressive progress in the field of learned image compression. Recent learned image codecs are commonly based on autoencoders, that first encode an image into low-dimensional latent representa…
View article
Transform Quantization for CNN (Convolutional Neural Network) Compression Open
In this paper, we compress convolutional neural network (CNN) weights post-training via transform quantization. Previous CNN quantization techniques tend to ignore the joint statistics of weights and activations, producing sub-optimal CNN …
View article
Just-Noticeable Difference-Based Perceptual Optimization for JPEG Compression Open
The Quantization table in JPEG, which specifies the quantization scale for each discrete cosine transform (DCT) coefficient, plays an important role in image codec optimization. However, the generic quantization table design that is based …
View article
Rethinking Lossy Compression: The Rate-Distortion-Perception Tradeoff Open
Lossy compression algorithms are typically designed and analyzed through the lens of Shannon's rate-distortion theory, where the goal is to achieve the lowest possible distortion (e.g., low MSE or high SSIM) at any given bit rate. However,…
View article
A Rate-Distortion view of human pragmatic reasoning Open
What computational principles underlie human pragmatic reasoning? A prominent approach to pragmatics is the Rational Speech Act (RSA) framework, which formulates pragmatic reasoning as probabilistic speakers and listeners recursively reaso…
View article
A Lower Bound on the Differential Entropy of Log-Concave Random Vectors with Applications Open
We derive a lower bound on the differential entropy of a log-concave random variable X in terms of the p-th absolute moment of X. The new bound leads to a reverse entropy power inequality with an explicit constant, and to new bounds on the…
View article
Information-Theoretic Foundations of Mismatched Decoding Open
Shannon's channel coding theorem characterizes the maximal rate of information that can be reliably transmitted over a communication channel when optimal encoding and decoding strategies are used. In many scenarios, however, practical cons…
View article
Distributed Binary Detection With Lossy Data Compression Open
International audience
View article
Rate Allocation in Predictive Video Coding Using a Convex Optimization Framework Open
Optimal rate allocation is among the most challenging tasks to perform in the context of predictive video coding, because of the dependencies between frames induced by motion compensation. In this paper, using a recursive rate-distortion m…
View article
Energy-Distortion Exponents in Lossy Transmission of Gaussian Sources Over Gaussian Channels Open
Lossy transmission of Gaussian sources over energy limited Gaussian point-to-point and broadcast channels is studied under the infinite bandwidth regime, i.e., when the number of channel uses is unlimited. Using previously known asymptotic…
View article
Rate-Distortion Optimization Using Adaptive Lagrange Multipliers Open
In current standardized hybrid video encoders, the Lagrange multiplier determination model is a key component in rate-distortion optimization. This originated some 20 years ago based on an entropy-constrained high-rate approximation and ex…
View article
Coarse to Fine Rate Control For Region-Based 3D Point Cloud Compression Open
We modify the video-based point cloud compression standard (V-PCC) by mapping the patches to seven regions and encoding the geometry and color video sequences of each region. We then propose a coarse to fine rate control algorithm for this…
View article
Quantum Rate-Distortion Coding of Relevant Information Open
Rate-distortion theory provides bounds for compressing data produced by an information source to a specified encoding rate that is strictly less than the source's entropy. This necessarily entails some loss, or distortion, between the orig…
View article
Rate-distortion-perception tradeoff of variable-length source coding for general information sources Open
Blau and Michaeli recently introduced a novel concept for inverse problems of signal processing, that is, the perception-distortion tradeoff. We introduce their tradeoff into the rate distortion theory of variable-length lossy source codin…
View article
The Shannon Lower Bound Is Asymptotically Tight Open
The Shannon lower bound is one of the few lower bounds on the rate-distortion\nfunction that holds for a large class of sources. In this paper, it is\ndemonstrated that its gap to the rate-distortion function vanishes as the\nallowed disto…
View article
Mutual Information, the Linear Prediction Model, and CELP Voice Codecs Open
We write the mutual information between an input speech utterance and its reconstruction by a code-excited linear prediction (CELP) codec in terms of the mutual information between the input speech and the contributions due to the short-te…
View article
Rate-distortion theory of neural coding and its implications for working memory Open
Rate-distortion theory provides a powerful framework for understanding the nature of human memory by formalizing the relationship between information rate (the average number of bits per stimulus transmitted across the memory channel) and …
View article
Optimal Adaptive Quantization Based on Temporal Distortion Propagation Model for HEVC Open
Optimal adaptive quantization is one of the key points to optimize the coding efficiency of video encoders. The latest block-based video compression standards, such as high-efficiency video coding (HEVC), extensively use predictive coding …
View article
Lossy Compression with Gaussian Diffusion Open
We consider a novel lossy compression approach based on unconditional diffusion generative models, which we call DiffC. Unlike modern compression schemes which rely on transform coding and quantization to restrict the transmitted informati…
View article
Rate Distortion Functions and Rate Distortion Function Lower Bounds for Real-World Sources Open
Although Shannon introduced the concept of a rate distortion function in 1948, only in the last decade has the methodology for developing rate distortion function lower bounds for real-world sources been established. However, these recent …
View article
Rate-Distortion Modeling for Bit Rate Constrained Point Cloud Compression Open
As being one of the main representation formats of 3D real world and well-suited for virtual reality and augmented reality applications, point clouds have gained a lot of popularity. In order to reduce the huge amount of data, a considerab…
View article
Rateless Lossy Compression via the Extremes Open
We begin by presenting a simple lossy compressor operating at near-zero rate: The encoder merely describes the indices of the few maximal source components, while the decoder’s reconstruction is a natural estimate of the source components …
View article
Gradient-Based Tone Mapping for Rate-Distortion Optimized Backward-Compatible High Dynamic Range Compression Open
This paper addresses the problem of designing a global tone mapping operator for rate distortion optimized backward compatible compression of high dynamic range (HDR) images. We address the problem of tone mapping design for two different …
View article
Fast and adaptive mode decision and CU partition early termination algorithm for intra-prediction in HEVC Open
High Efficiency Video Coding (HEVC or H.265), the latest international video coding standard, displays a 50% bit rate reduction with nearly equal quality and dramatically higher coding complexity compared with H.264. Unlike other fast algo…
View article
Perceptually Adaptive Lagrangian Multiplier for HEVC Guided Rate-Distortion Optimization Open
Recent video coding standards typically use the Rate-distortion optimization (RDO) method, which is essential to appropriately perform mode decisions during encoding process. The newest standard high efficiency video coding (HEVC) introduc…
View article
A Cluster-Based Approach to Compression of Quality Scores Open
Massive amounts of sequencing data are being generated thanks to advances in sequencing technology and a dramatic drop in the sequencing cost. Storing and sharing this large data has become a major bottleneck in the discovery and analysis …
View article
An upper bound to zero-delay rate distortion via Kalman filtering for vector Gaussian sources Open
We deal with zero-delay source coding of a vector Gaussian autoregressive (AR) source subject to an average mean squared error (MSE) fidelity criterion. Toward this end, we consider the nonanticipative rate distortion function (NRDF) which…
View article
Exponent Function for Source Coding with Side Information at the Decoder at Rates below the Rate Distortion Function Open
We consider the rate distortion problem with side information at the decoder posed and investigated by Wyner and Ziv. The rate distortion function indicating the trade-off between the rate on the data compression and the quality of data ob…
View article
Rate-Distortion Optimal Transform Coefficient Selection for Unoccupied Regions in Video-Based Point Cloud Compression Open
This paper presents a novel method to determine rate-distortion optimized\ntransform coefficients for efficient compression of videos generated from point\nclouds. The method exploits a generalized frequency selective extrapolation\napproa…
View article
R-D spatio-temporal adaptive quantization based on temporal distortion backpropagation in HEVC Open
International audience