论文标题
根据信息理论，关于条件框架间视频编码的好处和挑战
On Benefits and Challenges of Conditional Interframe Video Coding in Light of Information Theory
论文作者
论文摘要
用于图像和视频压缩的变异自动编码器的兴起为许多精心设计的编码技术打开了大门。这里的一个示例是有条件的框架编码的可能性。在这里，不是在知道预测信号的条件下传输当前框架，而不是在原始帧和预测帧之间传输残差（通常是通过运动补偿获得）。实际上，可以使用条件自动编码器直接实施条件编码，这在最近的工作中也显示出良好的结果。在本文中，我们提供了针对框架中的条件编码的信息理论分析，并证明了与传统剩余编码相比的案例收益。我们还展示了由于数据处理定理或量化而导致的，由于网络结构，由于网络结构而在预测信号路径中可能发生的信息瓶颈的效果。我们证明有条件的编码对剩余编码具有理论上的好处，但是在某些情况下，预测信号的小信息瓶颈很快就取消了好处。
The rise of variational autoencoders for image and video compression has opened the door to many elaborate coding techniques. One example here is the possibility of conditional interframe coding. Here, instead of transmitting the residual between the original frame and the predicted frame (often obtained by motion compensation), the current frame is transmitted under the condition of knowing the prediction signal. In practice, conditional coding can be straightforwardly implemented using a conditional autoencoder, which has also shown good results in recent works. In this paper, we provide an information theoretical analysis of conditional coding for inter frames and show in which cases gains compared to traditional residual coding can be expected. We also show the effect of information bottlenecks which can occur in practical video coders in the prediction signal path due to the network structure, as a consequence of the data-processing theorem or due to quantization. We demonstrate that conditional coding has theoretical benefits over residual coding but that there are cases in which the benefits are quickly canceled by small information bottlenecks of the prediction signal.
