INFO5147: Selected Topics in Information Theory

École Normale Supérieure de Lyon (ENS de Lyon)
Computer Science Department
Master 2 – 2019/2020

Course Description

The course “Advanced Topics in Information Theory” at the Computer Science Department at ENS de Lyon opens for the fall semester 2019. This course is taught by Samir M. Perlaza and Jean-Marie Gorce. It explores connections between information theory and other fields in physics and mathematics to tackle some selected topics including Concentration Inequalities, Detection and Estimation, Hypothesis Testing, Decision-Making Processes, Data Compression, Data Transmission, and Data Analytics.

Lecturers

• Jean-Marie Gorce (INSA de Lyon)

• Samir M. Perlaza

Schedule

• Friday 10:15 am – 12:15 pm. Salle B1 ENS de Lyon.

Evaluation

• Weekly homeworks (45 %)

• In-class work (10 %) – In the form of oral questions.

• Final Exam (45 %)

Lectures

• Lecture 1 by S. Perlaza (Sep. 13, 2019): Elements of Measure Theory
  

• Lecture 2 by S. Perlaza (Sep. 20, 2019): Measure Theoretic Probability
  

• Lecture 3 by S. Perlaza (Sep. 27, 2019): Information Measures
  

• Lecture 4 by S. Perlaza (Oct. 4, 2019): Concentration Inequalities
  

• Lecture 5 by S. Perlaza (Oct. 11, 2019): Hypothesis Testing — Part I
  

• Lecture 6 by S. Perlaza (Oct. 18, 2019): Hypothesis Testing — Part II
  

• Lecture 7 by S. Perlaza (Oct. 25, 2019): Hypothesis Testing — Part III
  

• Lecture 8 by J. M. Gorce (Nov. 8, 2019): Data Transmission (1): Point-to-Point Channels
  

• Lecture 9 by J. M. Gorce (Nov. 22, 2019): Data Transmission (2): Point-to-Point Channels
  

• Lecture 10 by J. M. Gorce (Nov. 29, 2019): Data Storage (1): Lossless Compression
  

• Lecture 11 by J. M. Gorce (Dec. 6, 2019): Data Storage (2): Lossy Compression
  

• Lecture 12 by J. M. Gorce (Dec. 13, 2019): Data Transmission in Networks: MAC and BC
  

• Lecture 13 by J. M. Gorce (Dec. 20, 2019): Data Transmission in Networks: Interference Channels and Interference Management
  

• Lecture 14 by J. M. Gorce (Jan. 10, 2020): Large Scale Networks: Stochastic-Geometry based Approaches
  

Final Exam

• Date: Jan. 17, 2020

• Place: Amphi B.

• Time: 10h15 – 15h30 with a lunch break between 12:15-13h30.