Preprint 4/2020

Properties of Unique Information

Johannes Rauh and Maik Schünemann

Contact the author: Please use for correspondence this email.
Submission date: 06. Jan. 2020
Pages: 18
MSC-Numbers: 94A15, 94A17
Keywords and phrases: information decomposition, Unique Information
Download full preprint: PDF (233 kB)
Link to arXiv:See the arXiv entry of this preprint.

Abstract:
We study the measure of unique information UI(T : X Y ) defined by Bertschinger et al. (2014) within the framework of information decompositions. We study uniqueness and support of the solutions to the optimization problem underlying the definition of UI. We give necessary conditions for non-uniqueness of solutions with full support in terms of the cardinalities of T, X and Y and in terms of conditional independence constraints. Our results help to speed up the computation of UI(T : X Y ), most notably in the case where T is binary. In the case that all variables are binary, we obtain a complete picture where the optimizing probability distributions lie.

08.01.2020, 15:56