Scribd
Upload
49 views

Information Theory IT4592E: Dang Tuan Linh

This course focuses on key concepts in information theory such as information measures, entropy, source coding, and channel coding. The goals are to gain knowledge of how much information a source can generate and how much a channel can transmit, as well as how to compress information sources and encode information for reliable communication. The course will mathematically cover definitions of information and entropy, the source coding theorem, and the channel coding theorem. Students are expected to read materials before class, attend lectures, do homework, and be evaluated through continuous assessments, a midterm exam, and a final exam.

Uploaded by

Minh Ngô
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
49 views

Information Theory IT4592E: Dang Tuan Linh

This course focuses on key concepts in information theory such as information measures, entropy, source coding, and channel coding. The goals are to gain knowledge of how much information a source can generate and how much a channel can transmit, as well as how to compress information sources and encode information for reliable communication. The course will mathematically cover definitions of information and entropy, the source coding theorem, and the channel coding theorem. Students are expected to read materials before class, attend lectures, do homework, and be evaluated through continuous assessments, a midterm exam, and a final exam.

Uploaded by

Minh Ngô
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 10

Information Theory

IT4592E
Dang Tuan Linh
Focus and Goal

• This course focuses on definitions and implications of information,


entropy, the source coding and the channel coding

2
Goals in details
Gain knowledge:
• Information measures (definition of amount of information
and entropy)
• Information rate: amount of information that source generate
in one unit of time
• Capacity of information channel: maximum average amount
of information so that channel can transmit in one unit of
time
• Source Coding (information compression): using finite set of
symbols to represent information of source by minimum
number of symbols
• Channel Coding: information coding for reliable communication
(communication without errors)

3
Course descriptions

• Information theory explores the fundamental limits of the


representation and transmission of information.
• This course will mathematically focus on the definition and
implications of information entropy, the source coding theorem,
and the channel coding theorem.
• These concepts provide a vital background in the areas of data
compression, signal processing, controls, and pattern recognition.

4
Duty of students

• Reading the provided materials before class, print/


photo lectures, prepare questions
• Attend the full class according to the university
rules, active in the classroom
• Do homework

5
Pre-courses recommendation

• Mathematics
• Probability

6
References

• Class Slides: https://users.soict.hust.edu.vn/linhdt/it4592e/


• Information Theory and Coding, N. Abramson, McGraw-Hill Book
Co.
• Fundamentals of Information Theory and Coding Design, R. Togneri,
C. deSilva, CRC Press Co.
• A Mathematical Theory of Communications, Shannon 1948
• Elements of Information Theory, Cover and Thomas, Wiley
• Probability, Random Variables and Stochastic Processes, A.
Papoulis, McGraw-Hill
• Information Theory and Reliable Communications, R. G. Gallager,
Wiley, 1968
• Cryptography Theory and Practice, E. Stinson, CRC Press Co.

7
Course information

• Information theory
• 15 weeks, 2 lessons per week
• Evaluation:
• Continuous Assessment (30%)
• Attendance
• Midterm Exam
• Final Exam (70%)

8
Lecturer

Dang Tuan Linh, Ph.D

Department of Data Communications and Networks


School of Information and Communication Technology
Hanoi University of Science and Technology
Address: B1 - 501
Email: [email protected]

9
Question?

10

You might also like