This lecture reviews key concepts in information theory, such as entropy and Kullback-Leibler divergence, as well as the basic ideas of information geometry. The lecture will then describe the applications of information theory in vision, such as maximum entropy models and performance bounds.
Back to Graduate Summer School: Computer Vision