Network Information Theory
Fall 2014
Network Information Theory is a graduate-level course for students who are interested in the fundamental limits of information flow in networks and how to achieve these limits. In this course, we will spend quite some time introducing basic concept of information theory so that solid foundations are laid for further exposition. Then, we will introduce advanced topics in information theory, especially in network settings. Tentative topics include multi-user channel capacity, network coding, interactive communications, and distributed source coding.
News
- (1/9) The statement in Problem 4 a) of Homework 7 is wrong. Please skip a) in the old version, or download the updated version.
- (1/8) The final report is due at 23:59, 1/18. Please eamil the report to me. The report has to be in pdf, and has to follow either the IEEE template or the other template.
- (1/6) You can review the grading of Quiz 2 at EE2-225, from 13:20 to 14:10 on 1/13. Please bring your student ID with you. If you cannot make it, please email us to schedule another time slot if you would like to take a look.
- (12/25) The schedule of final presentation can be found here.
- (12/22) Quiz 2 takes place from 9:30 to 12:30 on 12/24 in EE2-225. Please be on time. It will be a closed book exam. Please get familiar with all the matrials, including lecture slides, reading assignments, and homeworks.
- (12/16) We will have our second quiz on 12/24 in class. It will cover Lecture 05–08 and will be a closed book exam.
- (12/9) In order to make Homework 5 more focused, Problem 3 of Homework 5 is now made optional.
- (12/3) We make slight modification on Homework 5. Please download the updated version below or here. The modification is in Problem 5.
- (11/25) You can review the grading of Quiz 1 at BL-112, from 18:30 to 20:00 on 11/26. Please bring your student ID with you. If you cannot make it, please email us to schedule another time slot if you would like to take a look.
- (11/19) [Final Project] Please report the team members, the tentative topic, and give a short desciption of what you plan to do in this form, by 11/22.
- (11/3) Quiz 1 will be a closed book exam. Please get familiar with all the matrials, including lecture slides, reading assignments, and homeworks.
- (10/31) My office hour on 11/3 (Monday) will be moved from 15:30-16:30 to 17:30-18:30.
- (10/27) We will have our first quiz on 11/5 in class. The quiz will cover up to Lecture 04.
- (10/1) In Problem 3 b) of Homework 1, we further impose a constraint that the random variables are independent. In Problem 5 b), the condition is changed. Please download the latest version below.
- (10/1) My Wednesday office hour is moved to Monday 15:30 - 16:30.
- (9/23) Tzu-Yu will hold a LaTeX tutorial session at (1) 14:20 - 15:10 and (2) 17:30 - 18:20, on 9/30 at EE2-146. Two sessions are identical.
- (9/15) Welcome!
Logistics
- Instructor:
I-Hsiang Wang
(王奕翔),
ihwang AT ntu DOT edu DOT tw
- Office Location and Office Hours:
MD-524 (明達館524室), Time: Monday 15:30 - 16:30 and Tuesday 17:30 - 18:30
-
Lecture Room and Lecture Hours:
EE2-225 (電機二館225室), Time: Tuesday 13:20 - 14:10 and Wednesday 10:20 - 12:10
- Teaching Assistant:
Tzu-Yu Chuang (莊子由), d99942022 AT ntu DOT edu DOT tw
Office hour: Tuesday 14:00 - 16:00, BL-504 (博理館504室)
Course Information
- References:
[1] A. El Gamal and Y.-H. Kim, Network Information Theory, Cambridge University Press, 2011.
[2] T. Cover and J. Thomas, Elements of Information Theory, Wiley-Interscience, 2006.
[3] R. Yeung, Information Theory and Network Coding, Springer, 2008.
[4] R. Gallager, Information Theory and Reliable Communications, Wiley, 1968.
[5] S. M. Moser, Information Theory (Lecture Notes), 4th edition, ISI Lab, ETH Zürich, Switzerland, 2014. Link
-
Prerequisites:
Probability, Linear Algebra, Principles of Communications.
Information Theory (preferably).
-
Grading:
Quiz (30%), Homework (40%), Project (30%)
Lecture Materials
-
Lecture 01: Version 1 (9/16);
Version 2 (9/17)
-
Lecture 02: (Reading: Ch 1, Moser[5]; Ch 2, Cover&Thomas[2])
Version 1 (9/23);
Version 2 (9/24);
Version 3 (9/24);
Version 4 (9/29; 9/30 typo fixed)
-
Lecture 03: (Reading: Ch 5,19, Moser[5]; Ch 3,4,5, Cover&Thomas[2]; Ch 2.4,3.5,3.6, El Gamal&Kim[1])
Version 1 (10/06);
Version 2 (10/08, typo fixed);
Version 3 (10/13, typo fixed)
-
Lecture 04: (Reading: Ch 7, Cover&Thomas[2]; Ch 9, Moser[5])
Version 1 (10/15);
Version 2 (10/21);
Version 3 (10/22; 10/23 updated);
Version 4 (10/27; 10/29 typo fixed)
-
Lecture 05: (Reading: Ch 2.2,3.3,3.4, El Gamal&Kim[1]; Ch 8,9, Cover&Thomas[2]; Ch 15,16, Moser[5])
Version 1 (11/11; 11/12 updated)
-
Lecture 06: (Reading: Ch 15, El Gamal&Kim[1]; Ch 19, Yeung[3]
Version 1 (11/18 typo fixed);
Version 2 (11/19);
Version 3 (11/25);
Version 4 (11/26 updated);
Version 5 (12/1; 12/2 updated and typo fixed)
-
Lecture 07: (Reading: Ch 4, El Gamal&Kim[1]
Version 1 (12/3);
Version 2 (12/9);
Version 3 (12/10)
-
Lecture 08: (Reading: Ch 5,8, El Gamal&Kim[1]
Version 1 (12/16);
Version 2 (12/17);
Version 3 (12/29);
Version 4 (12/31);
Version 5 (1/5)
Homeworks
The LaTeX template for homework solutions can be downloaded here.
Project Information
Exam