Search

MiS Preprint Repository

We have decided to discontinue the publication of preprints on our preprint server as of 1 March 2024. The publication culture within mathematics has changed so much due to the rise of repositories such as ArXiV (www.arxiv.org) that we are encouraging all institute members to make their preprints available there. An institute's repository in its previous form is, therefore, unnecessary. The preprints published to date will remain available here, but we will not add any new preprints here.

MiS Preprint
26/2017

Tropical Limits of Probability Spaces, Part I: The Intrinsic Kolmogorov-Sinai Distance and the Asymptotic Equipartition Property

Rostislav Matveev and Jacobus Willem Portegies

Abstract

The entropy of a finite probability space $X$ measures the observable cardinality of large independent products $X^{\otimes n}$ of the probability space. If two probability spaces $X$ and $Y$ have the same entropy, there is an almost measure-preserving bijection between large parts of $X^{\otimes n}$ and $Y^{\otimes n}$. In this way, $X$ and $Y$ are asymptotically equivalent.

It turns out to be challenging to generalize this notion of asymptotic equivalence to configurations of probability spaces, which are collections of probability spaces with measure-preserving maps between some of them.

In this article we introduce the intrinsic Kolmogorov-Sinai distance on the space of configurations of probability spaces. Concentrating on the large-scale geometry we pass to the asymptotic Kolmogorov-Sinai distance. It induces an asymptotic equivalence relation on sequences of configurations of probability spaces. We will call the equivalence classes tropical probability spaces.

In this context we prove an Asymptotic Equipartition Property for configurations. It states that tropical configurations can always be approximated by homogeneous configurations. In addition, we show that the solutions to certain Information-Optimization problems are Lipschitz-continuous with respect to the asymptotic Kolmogorov-Sinai distance. It follows from these two statements that in order to solve an Information-Optimization problem, it suffices to consider homogeneous configurations.

Finally, we show that spaces of trajectories of length $n$ of certain stochastic processes, in particular stationary Markov chains, have a tropical limit.

Received:
Apr 3, 2017
Published:
Apr 4, 2017
MSC Codes:
60A10, 51F99
Keywords:
Tropical Probability Spaces, Asymptotic Equipartition Property, Kolmogorov-Sinai Distance

Related publications

Preprint
2017 Repository Open Access
Rostislav Matveev and Jacobus W. Portegies

Tropical limits of probability spaces, part I : the intrinsic Kolmogorov-Sinai distance and the asymptotic equipartition property