Confounding Ghost Channels and Causality: A New Approach to Causal Information Flows

Nihat Ay

Contact the author: Please use for correspondence this email.
Submission date: 07. Jul. 2020
Pages: 28
Bibtex
Keywords and phrases: information flow, causality, mutual information, conditional mutual information, filtration
Download full preprint: PDF (852 kB)

Abstract:
Information theory provides a fundamental framework for the quantification of information flows through channels, formally Markov kernels. However, quantities such as mutual information and conditional mutual information do not necessarily reflect the causal nature of such flows. We argue that this is often the result of conditioning based on sigma algebras that are not associated with the given channels. We propose a version of the (conditional) mutual information based on families of sigma algebras that are coupled with the underlying channel. This leads to filtrations which allow us to prove a corresponding causal chain rule as a basic requirement within the presented approach.