Former Research Group

Information Theory of Cognitive Systems - Publications

Explore the scholarly works of the "Information Theory of Cognitive Systems" group. Browse journal articles, contributions in books and conference proceedings, academic theses, or discover our research through preprints.


Preprint
2025 Repository Open Access
Thomas Kahle, Hal Schenck, Bernd Sturmfels and Maximilian Wiesmann

The likelihood correspondence

inJournal
2024 Repository Open Access
Mareike Dressler, Marina Garrote-López, Guido Montúfar, Kemal Rose and Johannes Müller

Algebraic optimization of sequential decision problems

In: Journal of symbolic computation, 121 (2024), p. 102241
Preprint
2024 Repository Open Access
Thomas Kahle, Lukas Kühne, Leonie Mühlherr, Bernd Sturmfels and Maximilian Wiesmann

Arrangements and likelihood

inJournal
2024 Journal Open Access
Johannes Müller and Guido Montúfar

Geometry and convergence of natural policy gradient methods

In: Information geometry, 7 (2024) 1 supplement, pp. 485-523
Academic
2024 Repository Open Access
Johannes Müller

Geometry of optimization in Markov decision processes and neural network based PDE solvers

Dissertation, Universität Leipzig, 2024
inJournal
2023 Journal Open Access
Nihat Ay

On the locality of the natural gradient for learning in deep Bayesian networks

In: Information geometry, 6 (2023) 1, pp. 1-49
inJournal
2023 Journal Open Access
Tobias Boege, Thomas Kahle, Andreas Kretschmer and Frank Röttger

The geometry of Gaussian double Markovian distributions

In: Scandinavian journal of statistics, 50 (2023) 2, pp. 665-696
inJournal
2023 Journal Open Access
Joshua Garland, Keyan Ghazi-Zahedi, Jean-Gabriel Young, Laurent Hébert-Dufresne and Mirta Galesic

Correction: 'Impact and dynamics of hate and counter speech online' [In: EPJ data science, 11(2022),3]

In: EPJ data science, 12 (2023), p. 27
inJournal
2023 Journal Open Access
Jürgen Jost and Walter Wenzel

Geometric algebra for sets with betweenness relations

In: Beiträge zur Algebra und Geometrie, 64 (2023) 3, pp. 555-579
inJournal
2023 Journal Open Access
Jesse van Oostrum, Johannes Müller and Nihat Ay

Invariance properties of the natural gradient in overparametrised systems

In: Information geometry, 6 (2023) 1, pp. 51-67
inJournal
2022 Journal Open Access
Eleonora Andreotti and Raffaella Mulas

Signless normalized Laplacian for hypergraphs

In: Electronic journal of graph theory and applications, 10 (2022) 2, pp. 485-500
inBook
2022 Repository Open Access
Nihat Ay, Nils Bertschinger, Jürgen Jost, Eckehard Olbrich and Johannes Rauh

Information and complexity, or: Where is the information?

In: Complexity and emergence : Lake Como School of Advanced Studies, Italy, July 22-27, 2018 / Sergio Albeverio... (eds.)
Cham : Springer, 2022. - pp. 87-105
(Springer proceedings in mathematics and statistics ; 383)
inJournal
2022 Journal Open Access
Patrick W. Dondl, Johannes Müller and Marius Zeinhofer

Uniform convergence guarantees for the deep ritz method for nonlinear problems

In: Advances in continuous and discrete models : theory and modern applications, 2022 (2022), p. 49
inJournal
2022 Journal Open Access
Joshua Garland, Keyan Ghazi-Zahedi, Jean-Gabriel Young, Laurent Hébert-Dufresne and Mirta Galesic

Impact and dynamics of hate and counter speech online

In: EPJ data science, 11 (2022), p. 3
inBook
2022 Repository Open Access
Johannes Müller and Marius Zeinhofer

Error estimates for the Deep Ritz Method with boundary penalty

In: 3rd annual conference on mathematical and scientific machine learning : 15-17 August 2022, Peking University, Beijing, China
[s. l.] : PMLR, 2022. - pp. 215-230
(Proceedings of machine learning research ; 190)
inBook
2022 Repository Open Access
Johannes Müller and Marius Zeinhofer

Notes on exact boundary values in residual minimisation

In: 3rd annual conference on mathematical and scientific machine learning : 15-17 August 2022, Peking University, Beijing, China
[s. l.] : PMLR, 2022. - pp. 231-240
(Proceedings of machine learning research ; 190)
Preprint
2022 Repository Open Access
Johannes Müller and Guido Montúfar

Solving infinite-horizon POMDPs with memoryless stochastic policies in state-action space

inBook
2022 Repository Open Access
Johannes Müller and Guido Montúfar

The geometry of memoryless stochastic policy optimization in infinite-horizon POMDPs

In: ICLR 2022 : Tenth international conference on learning representations ; 25th April 2022
[s. l.] : ICLR, 2022. - pp. 1-45
inJournal
2022 Repository Open Access
Csongor Várady, Riccardo Volpi, Luigi Malagò and Nihat Ay

Natural reweighted wake-sleep

In: Neural networks, 155 (2022), pp. 574-591
inJournal
2021 Journal Open Access
Nihat Ay

Confounding ghost channels and causality : a new approach to causal information flows

In: Vietnam journal of mathematics, 49 (2021) 2, pp. 547-576
inJournal
2021 Journal Open Access
Nihat Ay, Hoang Xuan Phu and Michael Struwe

Preface : special issue dedicated to Jürgen Jost's 65th birthday

In: Vietnam journal of mathematics, 49 (2021) 2, pp. 237-240
inBook
2021 Repository Open Access
Robert-George Colt, Csongor Várady, Riccardo Volpi and Luigi Malagò

Automatic feature extraction for heartbeat anomaly detection

In: Machine learning for pharma and healthcare applications (PharML 2020) : ECML PKDD 2020 workshop ; September 14
2021.
inBook
2021 Repository Open Access
Ionas Erb and Nihat Ay

The information-geometric perspective of compositional data analysis

In: Advances in compositional data analysis : Festschrift in Honour of Vera Pawlowsky-Glahn / Peter Filzmoser... (eds.)
Cham : Springer, 2021. - pp. 21-43
inJournal
2021 Repository Open Access
Domenico Felice and Nihat Ay

Towards a canonical divergence within information geometry

In: Information geometry, 4 (2021) 1, pp. 65-130
inJournal
2021 Journal Open Access
Jörg Fingerhut, Javier Gomez-Lavin, Claudia Winklmayr and Jesse J. Prinz

The aesthetic self : the importance of aesthetic taste in music and art for our perceived identity

In: Frontiers in psychology, 11 (2021), p. 577703
inJournal
2021 Repository Open Access
Tobias Fritz, Paolo Perrone and Sharwin Rezagholi

Probability, valuations, hyperspace : three monads on top and the support as a morphism

In: Mathematical structures in computer science, 31 (2021) 8, pp. 850-897
inJournal
2021 Journal Open Access
Keyan Ghazi-Zahedi, John Rieffel, Syn Schmitt and Helmut Hauser

Editorial : Recent trends in morphological computation

In: Frontiers in robotics and AI, 8 (2021), p. 708206
Preprint
2021 Repository Open Access
Carlotta Langer and Nihat Ay

Apportionment of work among environment, body and brain of an agent

inJournal
2021 Journal Open Access
Carlotta Langer and Nihat Ay

How morphological computation shapes integrated information in embodied agents

In: Frontiers in psychology, 12 (2021), p. 716433
inJournal
2021 Repository Open Access
Santiago Muiños-Landin, Keyan Ghazi-Zahedi and Frank Cichos

Reinforcement learning of artificial microswimmers

In: Science robotics, 6 (2021) 52, eabd9285
inJournal
2021 Repository Open Access
Ugur Tirnakli, Constantino Tsallis and Nihat Ay

Approaching a large deviation theory for complex systems

In: Nonlinear dynamics : an international journal of nonlinear dynamics and chaos in engineering systems, 106 (2021) 3, pp. 2537-2546
inBook
2021 Repository Open Access
Juan Pablo Vigneaux

Entropy under disintegrations

In: Geometric science of information : 5th international conference, GSI 2021, Paris, France, July 21-23, 2021, proceedings / Frank Nielsen... (eds.)
Cham : Springer, 2021. - pp. 340-349
(Lecture notes in computer science ; 12829)
inBook
2021 Repository Open Access
Juan Pablo Vigneaux

Information cohomology of classical vector-valued observables

In: Geometric science of information : 5th international conference, GSI 2021, Paris, France, July 21-23, 2021, proceedings / Frank Nielsen... (eds.)
Cham : Springer, 2021. - pp. 537-546
(Lecture notes in computer science ; 12829)
inJournal
2020 Journal Open Access
Nihat Ay, Daniel Polani and Nathaniel Virgo

Information decomposition based on cooperative game theory

In: Kybernetika, 56 (2020) 5, pp. 979-1014
inJournal
2020 Journal Open Access
Nihat Ay

Ingredients for robustness

In: Theory in biosciences, 139 (2020) 4, pp. 309-318
inJournal
2020 Journal Open Access
Nihat Ay and Milan StudenÔy

Special issue in memory of František Matúš : editorial

In: Kybernetika, 56 (2020) 5, pp. 843-849
inJournal
2020 Journal Open Access
Nihat Ay and Milan StudenÔy

Special issue in memory of František Matúš : editorial

In: Kybernetika, 56 (2020) 6, pp. 1015-1021
inJournal
2020 Journal Open Access
Daniel Bennequin and Juan Pablo Vigneaux

A functional equation related to generalized entropies and the modular group

In: Aequationes mathematicae, 94 (2020) 6, pp. 1201-1212
inBook
2020
Luca Carlini, Nihat Ay and Christiane Görgen

A numerical efficiency analysis of a common ancestor condition

In: Mathematical aspects of computer and information sciences : 8th international conference, MACIS 2019, Gebze-Istanbul, Turkey, November 13-15, 2019 ; revised selected papers / Daniel Slamanig... (eds.)
Cham : Springer, 2020. - pp. 357-363
(Lecture notes in computer science ; 11989)
inJournal
2020 Journal Open Access
Diego Cifuentes, Thomas Kahle and Pablo A. Parrilo

Sums of squares in Macaulay2

In: Journal of software for algebra and geometry, 10 (2020) 1, pp. 17-24
inJournal
2020 Journal Open Access
Tobias Fritz and Paolo Perrone

Monads, partial evaluations, and rewriting

In: Electronic notes in theoretical computer science, 352 (2020), pp. 129-148
inJournal
2020 Repository Open Access
Tobias Fritz and Paolo Perrone

Stochastic order on metric spaces and the ordered Kantorovich monad

In: Advances in mathematics, 366 (2020), p. 107081
inBook
2020 Repository Open Access
Joshua Garland, Keyan Ghazi-Zahedi, Jean-Gabriel Young, Laurent Hébert-Dufresne and Mirta Galesic

Countering hate on social media : large scale classification of hate and counter speech

In: Proceedings of the fourth workshop on online abuse and harms / Seyi Akiwowo (ed.)
[s.l.] : Association for Computational Linguistics, 2020. - pp. 102-112
inJournal
2020 Journal Open Access
Daniel F. B. Haeufle, Katrin Stollenmaier, Isabelle Heinrich, Syn Schmitt and Keyan Ghazi-Zahedi

Morphological computation increases from lower- to higher-level of biological motor control hierarchy

In: Frontiers in robotics and AI, 7 (2020), p. 135
inJournal
2020 Journal Open Access
Petru Hlihor, Riccardo Volpi and Luigi Malagò

Evaluating the robustness of defense mechanisms based on autoencoder reconstructions against Carlini-Wagner adversarial attacks

In: Proceedings of the northern lights deep learning workshop, 1 (2020), p. 5173
inJournal
2020
Thomas Kahle, Frank Röttger and Rainer Schwabe

Geometrie optimaler Versuchspläne

In: Mitteilungen der Deutschen Mathematiker-Vereinigung, 28 (2020) 2, pp. 71-76
inJournal
2020 Journal Open Access
David C. Krakauer, Nils Bertschinger, Eckehard Olbrich, Jessica C. Flack and Nihat Ay

The information theory of individuality

In: Theory in biosciences, 139 (2020) 2, pp. 209-223
inJournal
2020 Journal Open Access
Carlotta Langer and Nihat Ay

Complexity as causal information integration

In: Entropy, 22 (2020) 10, p. 1107
inBook
2020 Repository Open Access
Johannes Müller and Marius Zeinhofer

Deep Ritz revisited

In: ICLR 2020 workshop on integration of deep neural models and differential equations : Millennium Hall, Addis Ababa, Ethiopia ; 26th April 2020
[S. L.] : ICLR, 2020.
inBook
2020 Repository Open Access
Johannes Müller

On the space-time expressivity of ResNets

In: ICLR 2020 workshop on integration of deep neural models and differential equations : Millennium Hall, Addis Ababa, Ethiopia ; 26th April 2020
[S. L.] : ICLR, 2020.
Preprint
2020 Repository Open Access
Juan Pablo Vigneaux

A homological characterization of generalized multinomial coefficients related to the entropic chain rule

inJournal
2020 Journal Open Access
Juan Pablo Vigneaux

Generalized information structures and their cohomology

In: Theory and applications of categories, 35 (2020) 38, pp. 1476-1529
inJournal
2020 Journal Open Access
Claudia Winklmayr, Albert B. Kao, Joseph B. Bak-Coleman and Pawel Romanczuk

The wisdom of stalemates : consensus and clustering as filtering mechanisms for improving collective accuracy

In: Proceedings of the Royal Society of London / B, 287 (2020) 1938, p. 20201802
inJournal
2020
Olaf Witkowski, Takashi Ikegami, Nathaniel Virgo, Mizuki Oka and Hiroyuki Iizuka

Artificial life : next generation perspectives - echoes from the 2018 conference in Tokyo (editorial introduction to the ALIFE 2018 special issue)

In: Artificial life, 26 (2020) 1, pp. 1-4
inBook
2019 Repository Open Access
Nihat Ay, Johannes Rauh and Guido Montúfar

A continuity result for optimal memoryless planning in POMDPs

In: RLDM 2019 : 4th multidisciplinary conference on reinforcement learning and decision making ; July 7-10, 2019 ; Montréal, Canada
Montréal, Canada : University, 2019. - pp. 362-365
inJournal
2019 Repository Open Access
Tobias Boege, Alessio D'Alì, Thomas Kahle and Bernd Sturmfels

The geometry of Gaussoids

In: Foundations of computational mathematics, 19 (2019) 4, pp. 775-812
inJournal
2019 Journal Open Access
Domenico Felice and Nihat Ay

Canonical divergence for flat α-connections : classical and quantum

In: Entropy, 21 (2019) 9, p. 831
inJournal
2019 Journal Open Access
Domenico Felice, Stefano Mancini and Nihat Ay

Canonical divergence for measuring classical and quantum complexity

In: Entropy, 21 (2019) 4, p. 435
inBook
2019 Repository Open Access
Domenico Felice and Nihat Ay

Divergence functions in information geometry

In: Geometric science of information : 4th international conference, GSI 2019, Toulouse, France, August 27-29, 2019, proceedings / Frank Nielsen... (eds.)
Cham : Springer, 2019. - pp. 433-442
(Lecture notes in computer science ; 11712)
inJournal
2019 Journal Open Access
Tobias Fritz and Paolo Perrone

A probability monad as the colimit of spaces of finite samples

In: Theory and applications of categories, 34 (2019) 7, pp. 170-220
Book
2019
Keyan Ghazi-Zahedi

Morphological intelligence : measuring the body's contribution to intelligence

Cham : Springer, 2019. - xiii, 180
ISBN: 978-3-030-20620-8, ISBN: 978-3-030-20621-5
inBook
2019 Repository Open Access
Thomas Kahle, Johannes Rauh and Seth Sullivant

Algebraic aspects of conditional independence and graphical models

In: Handbook of graphical models / Marloes Maathuis... (eds.)
Boca Raton : CRC Press, 2019. - pp. 61-80
(Chapman & Hall/CRC handbooks of modern statistical methods)
inJournal
2019 Repository Open Access
Carlos Mariscal, Ana Barahona, Nathanael Aubert-Kato, Arsev Umur Aydinoglu, Stuart Barlett, María Luz Cárdenas, Kuhan Chandru, Carol Cleland, Benjamin T. Cocanougher, Nathaniel Comfort, Athel Cornish-Bowden, Terrence Deacon, Tom Froese, Donato Giovannelli, John Hernlund, Piet Hut, Jun Kimura, Marie-Christine Maurel, Nancy Merino, Alvaro Moreno, Mayuko Nakagawa, Juli Peretó, Nathaniel Virgo, Olaf Witkowski and H. James Cleaves

Hidden concepts in the history and philosophy of origins-of-life studies : a workshop report

In: Origins of life and evolution of the biosphere, 49 (2019) 3, pp. 111-145
inBook
2019 Repository Open Access
Guido Montúfar, Johannes Rauh and Nihat Ay

Task-agnostic constraining in average reward POMDPs

In: Task-agnostic reinforcement learning : workshop at ICLR, 06 May 2019, New Orleans
[S. L.] : ICLR, 2019.
Preprint
2019 Repository Open Access
Paolo Perrone

Notes on category theory with examples from basic mathematics

Academic
2019 Repository Open Access
Sacha Sokoloski

Implementing Bayesian inference with neural networks

Dissertation, Universität Leipzig, 2019
Academic
2019 Repository Open Access
Juan Pablo Vigneaux

Topology of statistical systems : a cohomological approach to information theory

Dissertation, Universität Paris, 2019
Preprint
2018 Repository Open Access
Eleonora Andreotti, Daniel Remondini and Armando Bazzani

Equivalence between spectral properties of graphs with and without loops

Book
2018
Nihat Ay, Paolo Gibilisco and František Matúš (Eds.)

Information geometry and its applications : on the occasion of Shun-ichi Amari's 80th Birthday, IGAIA IV Liblice, Czech Republic, June 2016

Cham : Springer, 2018. - x, 456
(Springer proceedings in mathematics and statistics ; 252)
ISBN: 978-3-319-97797-3, ISBN: 978-3-319-97798-0
inJournal
2018 Repository Open Access
Nihat Ay, Jürgen Jost, Hông Vân Lê and Lorenz J. Schwachhöfer

Parametrized measure models

In: Bernoulli, 24 (2018) 3, pp. 1692-1725
Book
2018
Nihat Ay, David C. Krakauer and Jessica C. Flack

Robustness, causal networks, and experimental design

Princeton : Princeton University Press, 2018.
Preprint
2018 Repository Open Access
Domenico Felice and Nihat Ay

Dynamical systems induced by canonical divergence in dually flat manifolds

inJournal
2018 Repository Open Access
Domenico Felice, Carlo Cafaro and Stefano Mancini

Information geometric methods for complexity

In: Chaos, 28 (2018) 3, p. 032101
Preprint
2018 Repository Open Access
Tobias Fritz and Paolo Perrone

A criterion for Kan extensions of lax monoidal functors

inJournal
2018 Journal Open Access
Tobias Fritz and Paolo Perrone

Bimonoidal structure of probability monads

In: Electronic notes in theoretical computer science, 341 (2018), pp. 121-149
inBook
2018 Journal Open Access
Keyan Ghazi-Zahedi, Carlotta Langer and Nihat Ay

Morphological computation : synergy of body and brain [Entropy, 19 (2017) 9, 456]

In: Information decomposition of target effects from multi-source interactions : [collected articles from the special issue published in Entropy] / Joseph T. Lizier... (eds.)
Basel : MDPI, 2018. - pp. 267-281
Academic
2018
Keyan Ghazi-Zahedi

Morphological intelligence : information-theoretic quantifications of the morphological contribution to intelligence

Habilitation, Universität Leipzig, 2018
inJournal
2018 Journal Open Access
Thomas Kahle and Mateusz Michałek

Obstructions to combinatorial formulas for plethysm

In: The electronic journal of combinatorics, 25 (2018) 1, P1.41
inBook
2018 Repository Open Access
Carlotta Langer and Nihat Ay

Comparison and connection between the joint and the conditional generalized iterative scaling algorithm

In: Proceedings of the 11th workshop on uncertainty processing WUPES '18, June 6-9, 2018 / Václav Kratochvíl (ed.)
Praha : MatfyzPress, 2018. - pp. 105-116
inBook
2018 Repository Open Access
Guido Montúfar, Johannes Rauh and Nihat Ay

Uncertainty and stochasticity of optimal policies

In: Proceedings of the 11th workshop on uncertainty processing WUPES '18, June 6-9, 2018 / Václav Kratochvíl (ed.)
Praha : MatfyzPress, 2018. - pp. 133-140
Academic
2018 Repository Open Access
Paolo Perrone

Categorical probability and stochastic dominance in metric spaces

Dissertation, Universität Leipzig, 2018
inJournal
2018 Journal Open Access
Milajiguli Rexiti, Domenico Felice and Stefano Mancini

The volume of two-qubit states by information geometry

In: Entropy, 20 (2018) 2, p. 146
Preprint
2018 Repository Open Access
Septimia Sârbu, Riccardo Volpi, Alexandra Peşte and Luigi Malagò

Learning in variational autoencoders with Kullback-Leibler and Renyi integral bounds

inBook
2018 Repository Open Access
Lorenz J. Schwachhöfer, Nihat Ay, František Matúš and Hông Vân Lê

Congruent families and invariant tensors

In: Information geometry and its applications : on the occasion of Shun-ichi Amari's 80th Birthday, IGAIA IV Liblice, Czech Republic, June 2016 / Nihat Ay... (eds.)
Cham : Springer, 2018. - pp. 157-187
(Springer proceedings in mathematics and statistics ; 252)
Book
2017
Nihat Ay, Jürgen Jost, Hông Vân Lê and Lorenz J. Schwachhöfer

Information geometry

Cham : Springer, 2017. - xi, 407
(Ergebnisse der Mathematik und ihrer Grenzgebiete. 3. Folge / A series of modern surveys in mathematics ; 64)
ISBN: 978-3-319-56477-7, ISBN: 978-3-319-56478-4
inBook
2017 Repository Open Access
Nihat Ay, Jürgen Jost, Hông Vân Lê and Lorenz J. Schwachhöfer

Parametrized measure models

In: Information geometry
Cham : Springer, 2017. - pp. 121-184
(Ergebnisse der Mathematik und ihrer Grenzgebiete. 3. Folge / A series of modern surveys in mathematics ; 64)
Academic
2017
Yuri Cassio Campbell-Borges

Large deviation results for likelihood ratios and hypothesis testing on quantum spin chains

Dissertation, Universität Leipzig, 2017
inJournal
2017 Journal Open Access
Ralf Der and Georg Martius

Self-organized behavior generation for musculoskeletal robots

In: Frontiers in neurorobotics, 11 (2017), p. 8
inJournal
2017 Journal Open Access
Keyan Ghazi-Zahedi, Carlotta Langer and Nihat Ay

Morphological computation : synergy of body and brain

In: Entropy, 19 (2017) 9, p. 456
inBook
2017 Repository Open Access
Keyan Ghazi-Zahedi, Raphael Deimel, Guido Montúfar, Vincent Wall and Oliver Brock

Morphological computation : the good, the bad, and the ugly

In: 2017 IEEE/RSJ international conference on intelligent robots and systems (IROS) : Vancouver, BC, Canada ; September 24-28, 2017
New York, NY : IEEE, 2017. - pp. 464-469
Preprint
2017 Repository Open Access
Keyan Ghazi-Zahedi

NMODE - Neuro-MODule evolution

inJournal
2017
Daniel Cavalcanti Jeronymo, Yuri Cassio Campbell-Borges and Leandro dos Santos Coelho

Image forgery detection by semi-automatic wavelet soft-thresholding with error level analysis

In: Expert systems with applications, 85 (2017), pp. 348-356
inJournal
2017 Journal Open Access
Thomas Kahle, Kaie Kubjas, Mario Kummer and Zvi Rosen

The geometry of rank-one tensor completion

In: SIAM journal on applied algebra and geometry, 1 (2017) 1, pp. 200-221
inJournal
2017 Journal Open Access
Maxinder S. Kanwal, Joshua A. Grochow and Nihat Ay

Comparing information-theoretic measures of complexity in Boltzmann machines

In: Entropy, 19 (2017) 7, p. 310
inJournal
2017 Journal Open Access
Guido Montúfar and Jason Morton

Dimension of marginals of Kronecker product models

In: SIAM journal on applied algebra and geometry, 1 (2017) 1, pp. 126-151
inBook
2017 Repository Open Access
Guido Montúfar and Johannes Rauh

Geometry of policy improvement

In: Geometric science of information : Third International Conference, GSI 2017, Paris, France, November 7-9, 2017, proceedings / Frank Nielsen... (eds.)
Cham : Springer, 2017. - pp. 282-290
(Lecture notes in computer science ; 10589)
inJournal
2017 Repository Open Access
Guido Montúfar and Johannes Rauh

Hierarchical models as marginals of hierarchical models

In: International journal of approximate reasoning, 88 (2017), pp. 531-546
inBook
2017 Repository Open Access
Guido Montúfar

Notes on the number of linear regions of deep neural networks

In: 2017 international conference on sampling theory and applications (SampTA) / Gholamreza Anbarjafari... (eds.)
Piscataway, NJ : IEEE, 2017. - pp. 156-159
inJournal
2017 Repository Open Access
Guido Montúfar, Jason Morton and Johannes Rauh

Restricted Boltzmann machines [In: Algebraic statistics ; 16 April - 22 April 2017 ; report no. 20/2017]

In: Oberwolfach reports, 14 (2017) 2, pp. 1241-1242
inBook
2017
Guido Montúfar, Keyan Ghazi-Zahedi and Nihat Ay

Stochasticity of optimal policies for POMDPs

In: RLDM 2017 : 3rd multidisciplinary conference on reinforcement learning and decision making ; June 11-14, 2017 ; Ann Arbor, Michigan, USA
Michigan : University, 2017. - T97
inBook
2017
Alexandra Peşte, Luigi Malagò and Septimia Sârbu

An explanatory analysis of the geometry of latent variables learned by variational auto-encoders

In: NIPS 2017 : Workshop on bayesian deep learning
La Jolla, CA : Neural Information Processing Systems, 2017. - p. 76
inJournal
2017 Repository Open Access
Sacha Sokoloski

Implementing a Bayes filter in a neural circuit : the case of unknown stimulus dynamics

In: Neural computation, 29 (2017) 9, pp. 2450-2490
Book
2016
Nihat Ay, Paolo Gibilisco and František Matúš (Eds.)

International conference on information geometry and its applications IV : Liblice, June 12-17, 2016 ; in honor of Shun-ichi Amari

Praha : Matfyzpress, 2016. - xii, 70
ISBN: 978-80-7378-316-7
inJournal
2016 Journal Open Access
Ralf Der

In search for the neural mechanisms of individual development : behavior-driven differential Hebbian learning

In: Frontiers in robotics and AI, 2 (2016), p. 37
inJournal
2016 Journal Open Access
Keyan Ghazi-Zahedi, Daniel F. B. Haeufle, Guido Montúfar, Syn Schmitt and Nihat Ay

Evaluating morphological computation in muscle and DC-motor driven models of hopping movements

In: Frontiers in robotics and AI, 3 (2016), p. 42
inBook
2016
Georg Martius, Rafael Hostettler, Alois Knoll and Ralf Der

Compliant control for soft robots : emergent behavior of a tendon driven anthropomorphic arm

In: 2016 IEEE/RSJ international conference on intelligent robots and systems (IROS) : October 9-14 2016 ; Daejeon, Korea
New York, NY : IEEE, 2016. - pp. 767-773
inBook
2016 Repository Open Access
Guido Montúfar

Geometry of Boltzmann machines

In: International conference on information geometry and its applications IV : Liblice, June 12-17, 2016 ; in honor of Shun-ichi Amari / Nihat Ay... (eds.)
Praha : Matfyzpress, 2016. - pp. 25-25
Preprint
2016 Repository Open Access
Guido Montúfar, Keyan Ghazi-Zahedi and Nihat Ay

Information theoretically aided reinforcement learning for embodied agents

inJournal
2016 Journal Open Access
Guido Montúfar and Johannes Rauh

Mode poset probability polytopes

In: Journal of algebraic statistics, 7 (2016) 1, pp. 1-13
inJournal
2016 Repository Open Access
Paolo Perrone and Nihat Ay

Hierarchical quantification of synergy in channels

In: Frontiers in robotics and AI, 2 (2016), p. 35
Preprint
2016 Repository Open Access
Paolo Perrone and Nihat Ay

Iterative scaling algorithm for channels

inJournal
2016 Repository Open Access
Oliver Pfante, Nils Bertschinger, Eckehard Olbrich, Nihat Ay and Jürgen Jost

Wie findet man eine geeignete Beschreibungsebene für ein komplexes System?

In: Jahrbuch der Max-Planck-Gesellschaft, 2016 (2016), Forschungsbericht - Max-Planck-Institut für Mathematik in den Naturwissenschaften
inJournal
2016 Repository Open Access
Leiba Rodman, Ilya M. Spitkovsky, Arleta Szkoła and Stephan Weis

Continuity of the maximum-entropy inference : convex geometry and numerical ranges approach

In: Journal of mathematical physics, 57 (2016), p. 1
inJournal
2016 Journal Open Access
Yuzuru Sato and Nihat Ay

Information flow in learning a coin-tossing game

In: Nonlinear theory and its applications, 7 (2016) 2, pp. 118-125
inBook
2016 Repository Open Access
Lorenz J. Schwachhöfer, Nihat Ay, František Matúš and Hông Vân Lê

Parametrized measure models and a generalization of Chentsov's theorem

In: International conference on information geometry and its applications IV : Liblice, June 12-17, 2016 ; in honor of Shun-ichi Amari / Nihat Ay... (eds.)
Praha : Matfyzpress, 2016. - pp. 17-17
inBook
2015
Shun'ichi Amari and Nihat Ay

Standard divergence in manifold of dual affine connections

In: Geometric science of information : second international conference, GSI 2015, Palaiseau, France, October 28-30, 2015, proceedings / Frank Nielsen... (eds.)
Cham : Springer, 2015. - pp. 320-325
(Lecture notes in computer science ; 9389)
inJournal
2015 Journal Open Access
Nihat Ay and Shun'ichi Amari

A novel approach to canonical divergences within information geometry

In: Entropy, 17 (2015) 12, pp. 8111-8129
inJournal
2015 Journal Open Access
Nihat Ay

Geometric design principles for brains of embodied agents

In: Künstliche Intelligenz : KI, 29 (2015) 4, pp. 389-399
inJournal
2015 Repository Open Access
Nihat Ay, Jürgen Jost, Hông Vân Lê and Lorenz J. Schwachhöfer

Information geometry and sufficient statistics

In: Probability theory and related fields, 162 (2015) 1-2, pp. 327-364
inJournal
2015 Journal Open Access
Nihat Ay

Information geometry on complexity and stochastic interaction

In: Entropy, 17 (2015) 4, pp. 2432-2458
inJournal
2015 Repository Open Access
Nihat Ay and Wolfgang Löhr

The Umwelt of an embodied agent : a measure-theoretic definition

In: Theory in biosciences, 134 (2015) 3-4, pp. 105-116
Academic
2015 Repository Open Access
Holger Bernigau

Causal models over infinite graphs and their application to the sensorimotor loop : general stochastic aspects and gradient methods for optimal control

Dissertation, Universität Leipzig, 2015
inJournal
2015 Repository Open Access
Holger Bernigau, Michael J. Kastoryano and Jens Eisert

Mutual information area laws for thermal free fermions

In: Journal of statistical mechanics, 2015 (2015) 2, P02008
inJournal
2015 Repository Open Access
Ralf Der and Georg Martius

Novel plasticity rule can explain the development of sensorimotor intelligence

In: Proceedings of the National Academy of Sciences of the United States of America, 112 (2015) 45, E6224-E6232
inBook
2015 Repository Open Access
Keyan Ghazi-Zahedi and Johannes Rauh

Quantifying morphological computation based on an information decomposition of the sensorimotor loop

In: Proceedings of the european conference on artificial life 2015, ECAL 2015 / Paul Andrews... (eds.)
Cambridge, MA : MIT Press, 2015. - pp. 70-77
inJournal
2015 Journal Open Access
Georg Martius and Eckehard Olbrich

Quantifying emergent behavior of autonomous robots

In: Entropy, 17 (2015) 10, pp. 7266-7297
inBook
2015 Repository Open Access
Guido Montúfar

A comparison of neural network architectures

In: Deep learning Workshop, ICML '15, Vauban Hall at Lille Grande Palais, France, July 10 and 11, 2015
2015.
inJournal
2015 Journal Open Access
Guido Montúfar, Keyan Ghazi-Zahedi and Nihat Ay

A theory of cheap control in embodied systems

In: PLoS computational biology, 11 (2015) 9, e1004427
inBook
2015 Repository Open Access
Guido Montúfar

Deep narrow Boltzmann machines are universal approximators

In: Third international conference on learning representations - ICLR 2015 : May 7-9 2015, San Diego, CA. USA
San Diego : ICLR, 2015.
inJournal
2015 Journal Open Access
Guido Montúfar and Jason Morton

Discrete restricted Boltzmann machines

In: Journal of machine learning research, 16 (2015), pp. 653-672
Preprint
2015 Repository Open Access
Guido Montúfar, Keyan Ghazi-Zahedi and Nihat Ay

Geometry and determinism of optimal stationary control in partially observable Markov decision processes

inJournal
2015 Journal Open Access
Guido Montúfar, Nihat Ay and Keyan Ghazi-Zahedi

Geometry and expressive power of conditional restricted Boltzmann machines

In: Journal of machine learning research, 16 (2015), pp. 2405-2436
inBook
2015 Repository Open Access
Guido Montúfar and Johannes Rauh

Hierarchical models as marginals of hierarchical models

In: Proceedings of the 10th workshop on uncertainty processing WUPES '15, Moninec, Czech Republic, September 16-19, 2015 / Václav Kratochvíl (ed.)
Praha : Oeconomica, 2015. - pp. 131-145
inBook
2015 Repository Open Access
Guido Montúfar and Johannes Rauh

Mode poset probability polytopes

In: Proceedings of the 10th workshop on uncertainty processing WUPES '15, Moninec, Czech Republic, September 16-19, 2015 / Václav Kratochvíl (ed.)
Praha : Oeconomica, 2015. - pp. 147-154
Preprint
2015 Repository Open Access
Guido Montúfar

Universal approximation of Markov kernels by shallow stochastic feedforward networks

inJournal
2015 Repository Open Access
Guido Montúfar and Jason Morton

When does a mixture of products contain a product of mixtures?

In: SIAM journal on discrete mathematics, 29 (2015) 1, pp. 321-347
inJournal
2015 Journal Open Access
Eckehard Olbrich, Nils Bertschinger and Johannes Rauh

Information decomposition and synergy

In: Entropy, 17 (2015) 5, pp. 3501-3517
inBook
2015 Repository Open Access
Paolo Perrone and Nihat Ay

Decomposition of Markov kernels

In: Proceedings of the 10th workshop on uncertainty processing WUPES '15, Moninec, Czech Republic, September 16-19, 2015 / Václav Kratochvíl (ed.)
Praha : Oeconomica, 2015. - pp. 167-178
inJournal
2015 Repository Open Access
Oliver Pfante and Nihat Ay

Operator-theoretic identification of closed sub-systems of dynamical systems

In: An interdisciplinary journal of discontinuity, nonlinearity, and complexity, 4 (2015) 1, pp. 91-109
inJournal
2015 Journal Open Access
Christoph Salge, Nihat Ay, Daniel Polani and Mikhail Prokopenko

Zipf's law : balancing signal usage cost and communication efficiency

In: PLOS ONE, 10 (2015) 10, e0139475
inBook
2015
Lorenz J. Schwachhöfer, Nihat Ay, Jürgen Jost and Hông Vân Lê

Invariant geometric structures on statistical models

In: Geometric science of information : second international conference, GSI 2015, Palaiseau, France, October 28-30, 2015, proceedings / Frank Nielsen... (eds.)
Cham : Springer, 2015. - pp. 150-158
(Lecture notes in computer science ; 9389)
inJournal
2015 Journal Open Access
Bastian Steudel and Nihat Ay

Information-theoretic inference of common ancestors

In: Entropy, 17 (2015) 4, pp. 2304-2327
inJournal
2015 Repository Open Access
Stephan Weis, Andreas Knauf, Nihat Ay and Ming-Jing Zhao

Maximizing the divergence from a hierarchical model of quantum states

In: Open systems and information dynamics, 22 (2015) 1, p. 1550006
inBook
2015 Repository Open Access
Stephan Weis

The MaxEnt extension of a quantum Gibbs family, convex geometry and geodesics

In: Bayesian inference and maximum entropy methods in science and engineering : (MaxEnt 2014) : Clos Lucé, Amboise, France, September 21-26 2014 / Ali Mohammad-Djafari (ed.)
Melville, NY : AIP Publising, 2015. - pp. 173-180
(AIP conference proceedings ; 1641)
inBook
2014
Nihat Ay and Keyan Ghazi-Zahedi

On the causal structure of the sensorimotor loop

In: Guided self-organization : inception / Mikhail Prokopenko (ed.)
Berlin [u. a.] : Springer, 2014. - pp. 261-294
(Emergence, complexity, and computation)
inJournal
2014 Journal Open Access
Nils Bertschinger, Johannes Rauh, Eckehard Olbrich, Jürgen Jost and Nihat Ay

Quantifying unique information

In: Entropy, 16 (2014) 4, pp. 2161-2183
inBook
2014 Repository Open Access
Nils Bertschinger and Johannes Rauh

The Blackwell relation defines no lattice

In: IEEE international symposium on information theory proceedings (ISIT) 2014 : June 29-July 4, 2014 in Honolulu, USA
Piscataway, NY : IEEE, 2014. - pp. 2479-2483
inBook
2014
Ralf Der

On the role of embodiment for self-organizing robots : behavior as broken symmetry

In: Guided self-organization : inception / Mikhail Prokopenko (ed.)
Berlin [u. a.] : Springer, 2014. - pp. 193-221
(Emergence, complexity, and computation)
inJournal
2014 Repository Open Access
Thomas Kahle, Johannes Rauh and Seth Sullivant

Positive margins and primary decomposition

In: Journal of commutative algebra, 6 (2014) 2, pp. 173-208
inJournal
2014 Repository Open Access
Thomas Kahle and Johannes Rauh

Toric fiber products versus Segre products

In: Abhandlungen aus dem Mathematischen Seminar der Universität Hamburg, 84 (2014) 2, pp. 187-201
Preprint
2014 Repository Open Access
Tyll Krüger, Guido Montúfar, Ruedi Seiler and Rainer Siegmund-Schultze

Sequential recurrence-based multidimensional universal source coding of Lempel-Ziv type

inBook
2014
Georg Martius, Ralf Der and J. Michael Herrmann

Robot learning by guided self-organization

In: Guided self-organization : inception / Mikhail Prokopenko (ed.)
Berlin [u. a.] : Springer, 2014. - pp. 223-260
(Emergence, complexity, and computation)
inBook
2014 Repository Open Access
Georg Martius, Luisa Jahn, Helmut Hauser and Verena V. Hafner

Self-exploration of the Stumpy robot with predictive information maximization

In: From Animals to Animats 13 : 13th International Conference on Simulation of Adaptive Behavior, SAB 2014, Castellón, Spain, July 22-25, 2014 ; proceedings / Angel P. Del Pobil... (eds.)
New York [u.a.] : Springer, 2014. - pp. 32-42
(Lecture notes in computer science ; 8575)
inBook
2014
Guido Montúfar and Jason Morton

Geometry of hidden-visible products of statistical models

In: Algebraic Statistics 2014 : May 19-22
Chicago, IL : Illinois Institute of Technology, 2014.
inJournal
2014 Journal Open Access
Guido Montúfar, Johannes Rauh and Nihat Ay

On the Fisher metric of conditional probability polytopes

In: Entropy, 16 (2014) 6, pp. 3207-3233
inBook
2014 Repository Open Access
Guido Montúfar, Razvan Pascanu, Kyunghyun Cho and Yoshua Bengio

On the number of linear regions of deep neural networks

In: NIPS 2014 : Proceedings of the 27th international conference on neural information processing systems - volume 2 ; Montreal, Quebec, Canada, December 8th-13th
Cambridge, MA : MIT Press, 2014. - pp. 2924-2932
inJournal
2014 Journal Open Access
Guido Montúfar and Johannes Rauh

Scaling of model approximation errors and expected entropy distances

In: Kybernetika, 50 (2014) 2, pp. 234-245
inJournal
2014 Repository Open Access
Guido Montúfar

Universal approximation depth and errors of narrow belief networks with discrete units

In: Neural computation, 26 (2014) 7, pp. 1386-1407
inJournal
2014 Journal Open Access
Philipp Moritz, Jörg Reichardt and Nihat Ay

Discriminating between causal structures in Bayesian networks given partial observations

In: Kybernetika, 50 (2014) 2, pp. 284-295
inBook
2014 Repository Open Access
Razvan Pascanu, Guido Montúfar and Yoshua Bengio

On the number of inference regions of deep feed forward networks with piece-wise linear activations

In: Second international conference on learning representations - ICLR 2014 : 14-16 April 2014, Banff, Canada
Banff : ICLR, 2014.
inJournal
2014 Repository Open Access
Oliver Pfante, Eckehard Olbrich, Nils Bertschinger, Nihat Ay and Jürgen Jost

Closure measures for coarse-graining of the tent map

In: Chaos, 24 (2014), p. 013136
inJournal
2014 Repository Open Access
Oliver Pfante, Nils Bertschinger, Eckehard Olbrich, Nihat Ay and Jürgen Jost

Comparison between different methods of level identification

In: Advances in complex systems, 17 (2014) 2, p. 1450007
inBook
2014
Mikhail Prokopenko, Daniel Polani and Nihat Ay

On the cross-disciplinary nature of guided self-organisation

In: Guided self-organization : inception / Mikhail Prokopenko (ed.)
Berlin [u. a.] : Springer, 2014. - pp. 3-15
(Emergence, complexity, and computation)
inBook
2014 Repository Open Access
Johannes Rauh, Nils Bertschinger, Eckehard Olbrich and Jürgen Jost

Reconsidering unique information : towards a multivariate information decomposition

In: IEEE international symposium on information theory proceedings (ISIT) 2014 : June 29-July 4, 2014 in Honolulu, USA
Piscataway, NY : IEEE, 2014. - pp. 2232-2236
inJournal
2014 Repository Open Access
Johannes Rauh and Nihat Ay

Robustness, canalyzing functions and systems design

In: Theory in biosciences, 133 (2014) 2, pp. 63-78
Preprint
2014 Repository Open Access
Johannes Rauh and Seth Sullivant

The Markov basis of K3,N

inJournal
2014 Repository Open Access
Stephan Weis

Continuity of the maximum-entropy inference

In: Communications in mathematical physics, 330 (2014) 3, pp. 1263-1292
inJournal
2014 Journal Open Access
Stephan Weis

Erratum to: Continuity of the maximum-entropy inference

In: Communications in mathematical physics, 331 (2014) 3, pp. 1301-1301
inJournal
2014 Repository Open Access
Stephan Weis

Information topologies on non-commutative state spaces

In: Journal of convex analysis, 21 (2014) 2, pp. 339-399
Preprint
2013
Nihat Ay and Wolfgang Löhr

A measure-theoretic description of the intrinsic view of embodied agents

inBook
2013 Repository Open Access
Nihat Ay and Keyan Ghazi-Zahedi

Causal effects for prediction and deliberative decision making of embodied systems

In: Advances in cognitive neurodynamics III : proceedings of the 3rd International Conference on Cognitive Neurodynamics 2011 ; [June 9-13, 2011, Hilton Niseko Village, Hokkaido, Japan] / Yoko Yamaguchi (ed.)
Dordrecht : Springer, 2013. - pp. 499-506
(Advances in cognitive neurodynamics)
inBook
2013 Repository Open Access
Nihat Ay, Guido Montúfar and Johannes Rauh

Selection criteria for neuromanifolds of stochastic dynamics

In: Advances in cognitive neurodynamics III : proceedings of the 3rd International Conference on Cognitive Neurodynamics 2011 ; [June 9-13, 2011, Hilton Niseko Village, Hokkaido, Japan] / Yoko Yamaguchi (ed.)
Dordrecht : Springer, 2013. - pp. 147-154
(Advances in cognitive neurodynamics)
inBook
2013 Repository Open Access
Ingemar Bengtsson, Stephan Weis and Karol Zyczkowski

Geometry of the set of mixed quantum states : an apophatic approach

In: Geometric methods in physics : XXX Workshop, Bialowieza, Poland, June 26 to July 2, 2011 / Piotr Kielanowski (ed.)
Basel : Springer, 2013. - pp. 175-197
(Trends in mathematics)
inBook
2013 Repository Open Access
Nils Bertschinger, Johannes Rauh, Eckehard Olbrich and Jürgen Jost

Shared information : new insights and problems in decomposing information in complex systems

In: Proceedings of the European Conference on Complex Systems 2012 / Thomas Gilbert... (eds.)
Dordrecht : Springer, 2013. - pp. 251-269
(Springer proceedings in complexity)
inBook
2013 Journal Open Access
Ralf Der and Georg Martius

Behavior as broken symmetry in embodied self-organizing robots

In: Advances in artificial life, ECAL 2013 : proceedings of the twelfth european conference on the synthesis and simulation of living systems / Pietro Lió... (eds.)
Cambridge, MA : MIT Press, 2013. - pp. 601-608
inJournal
2013 Journal Open Access
Keyan Ghazi-Zahedi, Georg Martius and Nihat Ay

Linear combination of one-step predictive information with an external reward in an episodic policy gradient setting : a critical analysis

In: Frontiers in psychology, 4 (2013), p. 801
inJournal
2013 Journal Open Access
Keyan Ghazi-Zahedi and Nihat Ay

Quantifying morphological computation

In: Entropy, 15 (2013) 5, pp. 1887-1915
inJournal
2013 Journal Open Access
Tyll Krüger, Guido Montúfar, Ruedi Seiler and Rainer Siegmund-Schultze

Universally typical sets for ergodic sources of multidimensional data

In: Kybernetika, 49 (2013) 6, pp. 868-882
inJournal
2013
Gabriele Lohmann, Johannes Stelzer, Jane Neumann, Nihat Ay and Robert Turner

'More is different' in functional magnetic resonance imaging : a review of recent data analysis techniques

In: Brain Connectivity, 3 (2013) 3, pp. 223-239
inJournal
2013 Journal Open Access
Georg Martius, Ralf Der and Nihat Ay

Information driven self-organization of complex robotic behaviors

In: PLOS ONE, 8 (2013) 5, e63400
inJournal
2013
Georg Martius

Robustness of guided self-organization against sensorimotor disruptions

In: Advances in complex systems, 16 (2013) 2/3, p. 1350001
inBook
2013 Repository Open Access
Guido Montúfar, Johannes Rauh and Nihat Ay

Maximal information divergence from statistical models defined by neural networks

In: Geometric science of information : first international conference, GSI 2013, Paris, France, August 28-30, 2013. Proceedings / Frank Nielsen... (eds.)
Berlin [u. a.] : Springer, 2013. - pp. 759-766
(Lecture notes in computer science ; 8085)
inJournal
2013 Journal Open Access
Guido Montúfar

Mixture decompositions of exponential families using a decomposition of their sample spaces

In: Kybernetika, 49 (2013) 1, pp. 23-39
inJournal
2013 Repository Open Access
Jose Roberto C. Piqueira and Yuri Cassio Campbell-Borges

Extending SDL and LMC complexity measures to quantum states

In: Physica / A, 392 (2013) 20, pp. 5255-5259
inJournal
2013 Repository Open Access
Johannes Rauh

Generalized binomial edge ideals

In: Advances in applied mathematics, 50 (2013) 3, pp. 409-414
inJournal
2013 Journal Open Access
Johannes Rauh

Optimally approximating exponential families

In: Kybernetika, 49 (2013) 2, pp. 199-215
inBook
2013
Stephan Weis

Discontinuities in the maximum-entropy inference

In: Bayesian inference and maximum entropy methods in science and engineering / Udo von Toussaint (ed.)
Melville, NY : AIP Publising, 2013. - pp. 192-199
(AIP conference proceedings ; 1553)
Preprint
2012
Nihat Ay, Jürgen Jost, Hông Vân Lê and Lorenz J. Schwachhöfer

A characterization of the Fisher metric and the Amari-Chentsov tensor in information geometry

inJournal
2012 Journal Open Access
Nihat Ay, Ralf Der and Mikhail Prokopenko

Guided self-organization : perception-action loops of embodied systems

In: Theory in biosciences, 131 (2012) 3, pp. 125-127
inJournal
2012
Nihat Ay, Holger Bernigau, Ralf Der and Mikhail Prokopenko

Information-driven self-organization : the dynamical system approach to autonomous robot behavior

In: Theory in biosciences, 131 (2012) 3, pp. 161-179
inJournal
2012 Journal Open Access
Nihat Ay and Walter Wenzel

On solution sets of information inequalities

In: Kybernetika, 48 (2012) 5, pp. 845-864
inJournal
2012
Dominik Janzing, Joris Mooij, Kun Zhang, Jan Lemeire, Jakob Zscheischler, Povilas Daniusis, Bastian Steudel and Bernhard Schölkopf

Information-geometric approach to inferring causal directions

In: Artificial intelligence, 182/183 (2012), pp. 1-31
inJournal
2012 Journal Open Access
Thomas Kahle

Erratum to 'Neighborliness of marginal polytopes'

In: Beiträge zur Algebra und Geometrie, 53 (2012) 1, pp. 295-295
inJournal
2012
Wolfgang Löhr

Predictive models and generative complexity

In: Journal of systems science and complexity, 25 (2012) 1, pp. 30-45
inJournal
2012 Repository Open Access
Wolfgang Löhr, Arleta Szkoła and Nihat Ay

Process dimension of classical and non-commutative processes

In: Open systems and information dynamics, 19 (2012) 1, p. 1250007
inJournal
2012
Georg Martius and J. Michael Herrmann

Variants of guided self-organization for robot control

In: Theory in biosciences, 131 (2012) 3, pp. 129-137
Academic
2012
Guido Montúfar

On the expressive power of discrete mixture models, restricted Boltzmann machines, and deep belief networks - a unified mathematical treatment

Dissertation, Universität Leipzig, 2012
inBook
2012 Repository Open Access
Guido Montúfar and Johannes Rauh

Scaling of model approximation errors and expected entropy distances

In: Proceedings of the 9th workshop on uncertainty processing WUPES '12 : Marianske Lazne, Czech Republik ; 12-15th September 2012
Praha : Academy of Sciences of the Czech Republik / Institute of Information Theory and Automation, 2012. - pp. 137-148
inBook
2012 Repository Open Access
Guido Montúfar and Jason Morton

When does a mixture of products contain a product of mixtures?

In: NIPS 2012 : Deep learning and unsupervised feature learning workshop : [be held in conjunction with neural information processing systems on December 8, 2012 (TBD) at Lake Tahoe, USA]
La Jolla, CA : Neural Information Processing Systems, 2012.
inBook
2012
Philipp Moritz, Jörg Reichardt and Nihat Ay

A new common cause principle for bayesian networks

In: Proceedings of the 9th workshop on uncertainty processing WUPES '12 : Marianske Lazne, Czech Republik ; 12-15th September 2012
Praha : Academy of Sciences of the Czech Republik / Institute of Information Theory and Automation, 2012. - pp. 149-162
Preprint
2012 Repository Open Access
Johannes Rauh

The convex support of the k-star model

inJournal
2012 Repository Open Access
Stephan Weis

Duality of non-exposed faces

In: Journal of convex analysis, 19 (2012) 3, pp. 815-835
inJournal
2012 Repository Open Access
Stephan Weis and Andreas Knauf

Entropy distance : new quantum phenomena

In: Journal of mathematical physics, 53 (2012) 10, p. 102206
inJournal
2011 Repository Open Access
Nihat Ay, Eckehard Olbrich, Nils Bertschinger and Jürgen Jost

A geometric approach to complexity

In: Chaos, 21 (2011) 3, p. 037103
inJournal
2011 Journal Open Access
Nihat Ay, Markus Müller and Arleta Szkoła

Effective complexity of stationary process realizations

In: Entropy, 13 (2011) 6, pp. 1200-1211
Preprint
2011 Repository Open Access
Yuri Cassio Campbell-Borges and Jose Roberto C. Piqueira

Classical hierarchical correlation quantification on tripartite qubit mixed state families

Book
2011
Ralf Der and Georg Martius

The playful machine : theoretical foundation and practical realization of self-organizing robots

Berlin : Springer, 2011. - XIII, 333
(Cognitive systems monographs ; 15)
ISBN: 978-3-642-20253-7, ISBN: 978-3-642-20252-0
inBook
2011
Georg Martius and J. Michael Herrmann

Tipping the scales : guidance and intrinsically motivated behavior

In: Advances in Artificial Life, ECAL 2011 : Proceedings of the Eleventh European Conference on the Synthesis and Simulation of Living Systems / Tom Lenarts (ed.)
Cambridge, MA : MIT Press, 2011. - pp. 506-513
inBook
2011
František Matúš and Johannes Rauh

Maximization of the information divergence from an exponential family and criticality

In: IEEE international symposium on information theory proceedings (ISIT) 2011 : July 31-August 5, 2011 in St. Petersburg, Russia
Piscataway, NY : IEEE, 2011. - pp. 903-907
inBook
2011 Repository Open Access
Guido Montúfar, Johannes Rauh and Nihat Ay

Expressive power and approximation errors of restricted Boltzmann machines

In: Advances in neural information processing systems 24 : NIPS 2011 ; 25th annual conference on neural information processing systems 2011, Granada, Spain December 12th - 15th / John Shawe-Taylor (ed.)
La Jolla, CA : Neural Information Processing Systems, 2011. - pp. 415-423
inJournal
2011 Repository Open Access
Guido Montúfar and Nihat Ay

Refinements of universal approximation results for deep belief networks and restricted Boltzmann machines

In: Neural computation, 23 (2011) 5, pp. 1306-1319
inJournal
2011 Repository Open Access
Michael Nussbaum and Arleta Szkoła

An asymptotic error bound for testing multiple quantum hypotheses

In: The annals of statistics, 39 (2011) 6, pp. 3211-3233
inBook
2011 Repository Open Access
Michael Nussbaum and Arleta Szkoła

Asymptotically optimal discrimination between pure quantum states

In: Theory of quantum computation, communication, and cryptography : 5th conference, TQC 2010, Leeds, UK, April 13 - 15, 2010, revised selected papers / Wim van Dam... (eds.)
Berlin [u. a.] : Springer, 2011. - pp. 1-8
(Lecture notes in computer science ; 6519)
inJournal
2011 Repository Open Access
Johannes Rauh

Finding the maximizers of the information divergence from an exponential family

In: IEEE transactions on information theory, 57 (2011) 6, pp. 3236-3247
Academic
2011 Repository Open Access
Johannes Rauh

Finding the maximizers of the information divergence from an exponential family

Dissertation, Universität Leipzig, 2011
Preprint
2011 Repository Open Access
Johannes Rauh and Nihat Ay

Robustness and conditional independence ideals

inJournal
2011 Repository Open Access
Johannes Rauh, Thomas Kahle and Nihat Ay

Support sets in exponential families and oriented matroid theory

In: International journal of approximate reasoning, 52 (2011) 5, pp. 613-626
inJournal
2010 Repository Open Access
Nihat Ay, Markus Müller and Arleta Szkoła

Effective complexity and its relation to logical depth

In: IEEE transactions on information theory, 56 (2010) 9, pp. 4593-4607
inJournal
2010 Repository Open Access
Gunnar Boldhaus, Nils Bertschinger, Johannes Rauh, Eckehard Olbrich and Konstantin Klemm

Robustness of Boolean dynamics under knockouts

In: Physical review / E, 82 (2010) 2, p. 021916
inBook
2010 Repository Open Access
Povilas Daniusis, Dominik Janzing, Joris Mooij, Jakob Zscheischler, Bastian Steudel, Kun Zhang and Bernhard Schoelkopf

Inferring deterministic causal relations

In: Proceedings of the 26th Conference on Uncertainty in Artificial Intelligence : UAI 2010, June 8-11, 2010, Avalon, CA / Peter Grünwald... (eds.)
Corvallis, Or. : AUAI Press, 2010. - pp. 143-150
inJournal
2010 Repository Open Access
Keyan Ghazi-Zahedi, Nihat Ay and Ralf Der

Higher coordination with less control : a result of information maximization in the sensorimotor loop

In: Adaptive behavior, 18 (2010) 3/4, pp. 338-355
inBook
2010
Frank Güttler, Wolfgang Rabe, Jörn Hoffmann, Martin Bogdan and Ralf Der

Transposing simulated self-organizing robots into reality using the plug and learn architecture

In: Proceedings of the International Conference on Fuzzy Computation and International Conference on Neural Computation : Valencia, Spain, October 24 - 26, 2010
[Setuball] : SciTePress - Science and Techn. Publ., 2010. - pp. 350-357
inJournal
2010 Repository Open Access
Jürgen Herzog, Takayuki Hibi, Freyja Hreinsdottir, Thomas Kahle and Johannes Rauh

Binomial edge ideals and conditional independence statements

In: Advances in applied mathematics, 45 (2010) 3, pp. 317-333
inJournal
2010 Repository Open Access
Dominik Janzing and Bastian Steudel

Justifying additive noise model-based causal discovery via algorithmic information theory

In: Open systems and information dynamics, 17 (2010) 2, pp. 189-212
inJournal
2010
Thomas Kahle

Decompositions of binomial ideals

In: Annals of the institute of statistical mathematics, 62 (2010) 4, pp. 727-745
inJournal
2010 Journal Open Access
Thomas Kahle

Neighborliness of marginal polytopes

In: Beiträge zur Algebra und Geometrie, 51 (2010) 1, pp. 45-56
Academic
2010 Repository Open Access
Thomas Kahle

On boundaries of statistical models

Dissertation, Universität Leipzig, 2010
inBook
2010
David C. Krakauer, Jessica C. Flack and Nihat Ay

Probabilistic design principles for robust multimodal communication networks

In: Modelling perception with artificial neural networks / Colin R. Tosh... (eds.)
Cambridge : Cambridge University Press, 2010. - pp. 255-268
Academic
2010 Repository Open Access
Wolfgang Löhr

Models of discrete-time stochastic processes and associated complexity measures

Dissertation, Universität Leipzig, 2010
inBook
2010 Repository Open Access
Guido Montúfar

Mixture models and representational power of RBM's, DBN's, and DBM's

In: NIPS 2010 : Deep learning and unsupervised feature learning workshop ; December 19, 2010, Hilton, Vancouver, Canada
[s. l.] : NIPS, 2010. - pp. 1-9
inJournal
2010 Repository Open Access
Markus Müller

Stationary algorithmic probability

In: Theoretical computer science, 411 (2010) 1, pp. 113-130
inJournal
2010 Repository Open Access
Michael Nussbaum and Arleta Szkoła

Exponential error rates in multiple state discrimination on a quantum spin chain

In: Journal of mathematical physics, 51 (2010) 7, p. 072203
inJournal
2010 Repository Open Access
Eckehard Olbrich, Thomas Kahle, Nils Bertschinger, Nihat Ay and Jürgen Jost

Quantifying structure in networks

In: The European physical journal / B, 77 (2010) 2, pp. 239-247
inJournal
2010
Mikhail Prokopenko, Nihat Ay, Oliver Obst and Daniel Polani

Phase transitions in least-effort communications

In: Journal of statistical mechanics, 2010 (2010) 11, P11025
inBook
2010 Repository Open Access
Bastian Steudel, Dominik Janzing and Bernhard Schoelkopf

Causal Markov condition for submodular information measures

In: COLT 2010 : Proceedings of the 23rd Annual Conference on Learning Theory, Haifa, Israel June 27-29, 2010 / Adam Taumann Kalai... (eds.)
New York : Association for Computing Machinery, 2010. - pp. 464-476
inJournal
2009
Nihat Ay

A refinement of the common cause principle

In: Discrete applied mathematics, 157 (2009) 10, pp. 2439-2457
inBook
2009
Ralf Der

Artificial life from the principle of homeokinesis

In: Proceedings of the 8th German Workshop on Artificial Life, July 30 - August 1, 2008, Leipzig, Germany / Konstantin Klemm... (eds.)
Heidelberg : Akademische Verlagsgesellschaft, 2009. - pp. 125-136
Academic
2009
Keyan Ghazi-Zahedi

Self-regulating neurons : a model for synaptic plasticity in artificial recurrent neural networks

Dissertation, Universität Osnabrück, 2009
inJournal
2009
Frank Hesse, Ralf Der and J. Michael Herrmann

Modulated exploratory dynamics can shape self-organized behavior

In: Advances in complex systems, 12 (2009) 3, pp. 273-291
inJournal
2009 Repository Open Access
Thomas Kahle, Eckehard Olbrich, Jürgen Jost and Nihat Ay

Complexity measures from interaction structures

In: Physical review / E, 79 (2009) 2, pt. 2, p. 026201
inJournal
2009 Journal Open Access
Thomas Kahle, Walter Wenzel and Nihat Ay

Hierarchical models, marginal polytopes, and linear codes

In: Kybernetika, 45 (2009) 2, pp. 189-207
inBook
2009
Wolfgang Löhr and Nihat Ay

Non-sufficient memories that are sufficient for prediction

In: Complex sciences : first international conference, Complex 2009, Shanghai, China, February 23 - 25, 2009, revised papers. Pt. 1 / Jie Zhou (ed.)
Berlin [u. a.] : Springer, 2009. - pp. 265-276
(Lecture notes of the Institute for Computer Science, Social Informatics and Telecommunications Engineering ; 4)
inJournal
2009 Repository Open Access
Wolfgang Löhr and Nihat Ay

On the generative nature of prediction

In: Advances in complex systems, 12 (2009) 2, pp. 169-194
inJournal
2009 Journal Open Access
Wolfgang Löhr

Properties of the statistical complexity functional and partially deterministic HMMs

In: Entropy, 11 (2009) 3, pp. 385-401
inJournal
2009 Repository Open Access
Markus Müller

Convex trace functions on quantum channels and the additivity conjecture

In: Physical review / A, 79 (2009) 5, p. 052332
inJournal
2009
Markus Müller

Does probability become fuzzy in small regions of spacetime?

In: Physics Letters / B, 673 (2009) 2, pp. 166-167
inJournal
2009 Repository Open Access
Markus Müller, Caroline Rogers and Rajagopal Nagarajan

Lossless quantum prefix compression for communication channels that are always open

In: Physical review / A, 79 (2009) 1, p. 012302
inJournal
2009
Markus Müller

On the quantum Kolmogorov complexity of classical strings

In: International journal of quantum information, 7 (2009) 4, pp. 701-711
inJournal
2009 Repository Open Access
Michael Nussbaum and Arleta Szkoła

The Chernoff lower bound for symmetric quantum hypothesis testing

In: The annals of statistics, 37 (2009) 2, pp. 1040-1057
inJournal
2008 Journal Open Access
K. M. R. Audenaert, Michael Nussbaum, Arleta Szkoła and Frank Verstraete

Asymptotic error rates in quantum hypothesis testing

In: Communications in mathematical physics, 279 (2008) 1, pp. 251-283
inJournal
2008 Repository Open Access
Nihat Ay and Daniel Polani

Information flows in causal networks

In: Advances in complex systems, 11 (2008) 1, pp. 17-41
inJournal
2008 Journal Open Access
Nihat Ay, Nils Bertschinger, Ralf Der, Frank Güttler and Eckehard Olbrich

Predictive information and explorative behavior of autonomous robots

In: The European physical journal / B, 63 (2008) 3, pp. 329-339
inJournal
2008
Nils Bertschinger, Eckehard Olbrich, Nihat Ay and Jürgen Jost

Autonomy : an information-theoretic perspective

In: Biosystems, 91 (2008) 2, pp. 331-345
inJournal
2008 Journal Open Access
Igor Bjelakovic, Jean-Dominique Deuschel, Tyll Krüger, Ruedi Seiler, Rainer Siegmund-Schultze and Arleta Szkoła

Typical support and Sanov large deviations of correlated states

In: Communications in mathematical physics, 279 (2008) 2, pp. 559-584
inBook
2008
Ralf Der, Frank Güttler and Nihat Ay

Predictive information and emergent cooperativity in a chain of mobile robots

In: Artificial Life XI : Proceedings of the Eleventh International Conference on the Simulation and Synthesis of Living Systems
Cambridge, MA : MIT Press, 2008. - pp. 166-172
inBook
2008
Keyan Ghazi-Zahedi, Arndt von Twickel and Frank Pasemann

YARS : A physical 3D simulator for evolving controllers for real robots

In: Simulation, modeling, and programming for autonomous robots : first international conference, SIMPSR 2008 Venice, Italy, November 3-7, 2008 proceedings / Stefano Carpin... (eds.)
New York : Springer, 2008. - pp. 75-86
(Lecture notes in artificial intelligence ; 5325)
inBook
2008 Repository Open Access
Markus Müller and Caroline Rogers

Quantum bit strings and prefix-free Hilbert spaces

In: Proceedings of the 2008 International Conference on Information Theory and Statistical Learning : ITSL 2008, Las Vegas, Nevada, USA, July 14 - 17, 2008 / Matthias Dehmer... (eds.)
[s. l.] : CSREA Press, 2008. - pp. 106-111
inJournal
2008 Repository Open Access
Markus Müller

Strongly universal quantum turing machines and invariance of Kolmogorov complexity

In: IEEE transactions on information theory, 54 (2008) 2, pp. 763-780
inJournal
2008 Journal Open Access
Eckehard Olbrich, Nils Bertschinger, Nihat Ay and Jürgen Jost

How should complexity scale with system size?

In: The European physical journal / B, 63 (2008) 3, pp. 407-415
Preprint
2007 Repository Open Access
Fatihcan M. Atay and David J. Albers

Entropy, dimension, and state mixing in a class of time-delayed dynamical systems

inJournal
2007 Repository Open Access
Nihat Ay and David C. Krakauer

Geometric robustness theory and biological networks

In: Theory in biosciences, 125 (2007) 2, pp. 93-121
inJournal
2007
Nihat Ay, Jessica C. Flack and David C. Krakauer

Robustness and complexity co-constructed in multimodal signalling networks

In: Philosophical transactions of the Royal Society of London / B, 362 (2007) 1479, pp. 441-447
inBook
2007
Keyan Ghazi-Zahedi and Frank Pasemann

Adaptive behavior control by self-regulating neurons

In: 50 years of artificial intelligence : essays dedicated to the 50th aniversary of artificial intelligence / Max Lungarella... (eds.)
Berlin : Springer, 2007. - pp. 196-205
(Lecture notes in computer science ; 4850 : Lecture notes in artificial intelligence)
inJournal
2007
Jürgen Jost, Nils Bertschinger, Eckehard Olbrich, Nihat Ay and Sidney Frankel

An information theoretic approach to system differentiation on the basis of statistical dependencies between subsystems

In: Physica / A, 378 (2007) 1, pp. 1-10
inBook
2007
Markus Müller

On the quantum complexity of classical words

In: ECCS 2007 : proceedings of the European Conference on Complex Systems 2007 ; Dresden, October 1-6, 2007
[Paris] : European Complex Systems Society, 2007. - pp. 46-46
inJournal
2007
Thomas Wennekers, Nihat Ay and Peter Andras

High-resolution multiple-unit EEG in cat auditory cortex reveals large spatio-temporal stochastic interactions

In: Biosystems, 89 (2007) 1/3, pp. 190-197
inJournal
2006 Repository Open Access
David J. Albers, J. C. Sprott and James P. Crutchfield

Persistent chaos in high dimensions

In: Physical review / E, 74 (2006) 5, p. 057201
inJournal
2006 Repository Open Access
David J. Albers and J. C. Sprott

Probability of local bifurcation type from a fixed point: a random matrix perspective

In: Journal of statistical physics, 125 (2006) 4, pp. 889-925
inJournal
2006 Repository Open Access
David J. Albers and J. C. Sprott

Routes to chaos in high-dimensional dynamical systems : a qualitative numerical study

In: Physica / D, 223 (2006) 2, pp. 194-207
inJournal
2006 Repository Open Access
David J. Albers and J. C. Sprott

Structural stability and hyperbolicity violation in high-dimensional dynamical systems

In: Nonlinearity, 19 (2006) 8, pp. 1801-1847
inBook
2006
Nihat Ay, Eckehard Olbrich, Nils Bertschinger and Jürgen Jost

A unifying framework for complexity measures of finite systems

In: ECCS'06 : proceedings of the European Conference on Complex Systems 2006 ; towards a science of complex systems / Jürgen Jost... (eds.)
Paris : European Complex Systems Society, 2006. - pp. 80-80
inJournal
2006 Journal Open Access
Nihat Ay and Andreas Knauf

Maximizing multi-information

In: Kybernetika, 42 (2006) 5, pp. 517-538
inBook
2006
Nils Bertschinger, Eckehard Olbrich, Nihat Ay and Jürgen Jost

Autonomy : an information theoretic perspective

In: Artificial life X : proceedings of the tenth international conference on the synthesis and simulation of living systems / Luis Mateus Rocha... (eds.)
Cambridge, Mass. : MIT Press, 2006. - pp. 7-12
inBook
2006
Nils Bertschinger, Eckehard Olbrich, Nihat Ay and Jürgen Jost

Information and closure in systems theory

In: Explorations in the complexity of possible life : abstracting and synthesizing the principles of living systems ; proceedings of the 7th German Workshop on Artificial Life, July 26 - 28, 2006, Jena, Germany / S. Artmann... (eds.)
Amsterdam : IOS Press, 2006. - pp. 9-19
inBook
2006 Repository Open Access
Thomas Kahle and Nihat Ay

Support sets of distributions with given interaction structure

In: 7th Workshop on Uncertainty Processing : WUPES'06 ; Mikulov, Czech Republik ; 16-20th September 2006
Praha : Academy of Sciences of the Czech Republik / Institute of Information Theory and Automation, 2006. - pp. 52-61
Preprint
2006 Repository Open Access
Yuzuru Sato and Nihat Ay

Adaptive dynamics for interacting Markovian processes

inJournal
2006
Thomas Wennekers and Nihat Ay

A temporal learning rule in recurrent systems supports high spatio-temporal stochastic interactions

In: Neurocomputing, 69 (2006) 10/12, pp. 1199-1202
inJournal
2005
Nihat Ay and Ionas Erb

On a notion of linear replicator equations

In: Journal of dynamics and differential equations, 17 (2005) 2, pp. 427-451
inJournal
2005
Thomas Wennekers and Nihat Ay

Stochastic interaction in associative nets

In: Neurocomputing, 65 (2005), pp. 387-392
inBook
1999 Repository Open Access
Frank Pasemann, Ulrich Steinmetz and Ralf Der

Homeokinesis : a new principle to back up evolution with learning

In: Computational Intelligence for Modelling, Control and Automation / Masoud Mohammadian (ed.)
Amsterdam [u.a.] : IOS Press, 1999. - pp. 43-47
(Concurrent Systems Engineering Series ; 55)