Information Theory


Code 3.5.3125.9
Semester 9th
Flow D - Telecommunication Systems and Computer Networks
Category Obligatory by selection
Credits 4
Class Hours - Lab Hours 3 - 0
Lecturers Miltiades Anagnostou
Links Course's Website
Web Platform Class 1: BigBlueButton

Description

Entropy, relative entropy and mutual information, asymptotic equipartition property, entropy rate of a stochastic process, data compression, gambling, channel capacity, differential entropy, Gaussian channel, rate distortion theory, information theory and statistics, maximum entropy, universal source coding, Kolmogorov complexity, network information theory, application of information theory on portfolio theory, inequalities in information theory.