Talk
Information Theory
- Nihat Ay
Abstract
In this course, I shall concentrate on information sources. Fundamental notions of entropy will be introduced, including Shannon entropy, Kolmogorov-Sinai entropy, and the relative entropy, also known as Kullback-Leibler information. Ergodic information sources will be discussed in more detail, and the Shannon-McMillan-Breiman theorem will be presented. This course will be continued during the summer term 2013 where information channels and the fundamental coding theorems of information theory will constitute the main subject. I shall assume basic knowledge from measure and probability theory, and functional analysis.
References
- Y. Kakihara. Abstract Methods in Information Theory. Singapore: World Scientific, 1999.
- A. I. Khinchin. Mathematical Foundations of Information Theory. New York: Dover, 1957.
- T. M. Cover, J. A. Thomas. Elements of Information Theory. New York: Wiley, 1991.
Date and time info
Wednesday, 11:00 - 12:30 h
