Institute of Electrical and Electronics Engineers, IEEE Transactions on Information Theory, 8(64), p. 5862-5878, 2018
2017 IEEE International Symposium on Information Theory (ISIT)
DOI: 10.1109/isit.2017.8006828
Full text: Download
We establish the rate region of an extended Gray-Wyner system for 2-DMS $(X,Y)$ with two additional decoders having complementary causal side information. This extension is interesting because in addition to the operationally significant extreme points of the Gray-Wyner rate region, which include Wyner's common information, G{á}cs-K{̈o}rner common information and information bottleneck, the rate region for the extended system also includes the K{̈o}rner graph entropy, the privacy funnel and excess functional information, as well as three new quantities of potential interest, as extreme points. To simplify the investigation of the 5-dimensional rate region of the extended Gray-Wyner system, we establish an equivalence of this region to a 3-dimensional mutual information region that consists of the set of all triples of the form $(I(X;U),\,I(Y;U),\,I(X,Y;U))$ for some $p_{U|X,Y}$. We further show that projections of this mutual information region yield the rate regions for many settings involving a 2-DMS, including lossless source coding with causal side information, distributed channel synthesis, and lossless source coding with a helper. ; Comment: 18 pages, 3 figures