Delve into the future of research at MiS with our preprint repository. Our scientists are making groundbreaking discoveries and sharing their latest findings before they are published. Explore repository to stay up-to-date on the newest developments and breakthroughs.
MiS Preprint
31/2013
Maximal Information Divergence from Statistical Models defined by Neural Networks
Guido Montúfar, Johannes Rauh and Nihat Ay
Abstract
We review recent results about the maximal values of the Kullback-Leibler information divergence from statistical models defined by neural networks, including naïve Bayes models, restricted Boltzmann machines, deep belief networks, and various classes of exponential families. We illustrate approaches to compute the maximal divergence from a given model starting from simple sub- or super-models. We give a new result for deep and narrow belief networks with finite-valued units.
Maximal information divergence from statistical models defined by neural networks
In: Geometric science of information : first international conference, GSI 2013, Paris, France, August 28-30, 2013. Proceedings / Frank Nielsen... (eds.) Berlin [u. a.] : Springer, 2013. - pp. 759-766 (Lecture notes in computer science ; 8085)
