Study-Unit Description

Study-Unit Description


CODE CCE5102

 
TITLE Information Theory and Coding

 
UM LEVEL 05 - Postgraduate Modular Diploma or Degree Course

 
MQF LEVEL Not Applicable

 
ECTS CREDITS 6

 
DEPARTMENT Communications and Computer Engineering

 
DESCRIPTION This study-unit covers the fundamental areas of information theory and coding. The student will develop and understand the necessary theoretical background that s/he can apply to coding structures in communication channels and various communication systems. In general, the study-unit consists of three parts.

The first part deals with the concept of information sources and channels, and covers in detail fundamental topics like Entropy, Mutual Information, Relative Entropy, Shannon’s first and second coding theorems, Rate Distortion Theory and Channel Capacity. The practical aspect in this part deals with data compression as in Huffman and Arithmetic Coding.

The second part deals with the design and analyses of error correcting codes. As such it starts with a review of abstract algebra, which is then used to describe Linear Block Codes, Cyclic Codes, BCH and RS Codes and their decoding algorithms, Soft decision decoding of Block Codes, Convolutional Codes, Turbo Codes, Low-Density Parity-Check Codes, Trellis Coded Modulation, and ARQ Strategies.

The third and final part deals with special topics in information theory and coding mainly, Joint Source-Channel Coding and Error Control in Variable Length Codes.

Learning Outcomes:

By the end of the study-unit the student will be able to:
- Compute basic information theory and coding calculations.
- Analyse and interpret the mathematical complexity of various code structures.
- Given a communication system scenario, analyse and evaluate via computer simulation various coding schemes to determine the optimal choice of code involving the various parameters of code efficiency, complexity and error resilience.

Main Text/s and any supplementary readings:

- Lin S, G Costillo D.J. 2004 Error Control Coding 2nd Ed., Prentice Hall, ISBN 978-0130426727.
- Wells R.B., 1999. Applied Coding and Information Theory for Engineers, Prentice Hall, ISBN 0-13-961327-7.
- Reed I S, Chen X 1999. Error-Control Coding for data Networks, Springer,ISBN: 978-0-7923-8528-8.

 
STUDY-UNIT TYPE Lecture

 
METHOD OF ASSESSMENT
Assessment Component/s Sept. Asst Session Weighting
Practical No 20%
Examination (3 Hours) Yes 80%

 
LECTURER/S Victor Buttigieg

 

 
The University makes every effort to ensure that the published Courses Plans, Programmes of Study and Study-Unit information are complete and up-to-date at the time of publication. The University reserves the right to make changes in case errors are detected after publication.
The availability of optional units may be subject to timetabling constraints.
Units not attracting a sufficient number of registrations may be withdrawn without notice.
It should be noted that all the information in the description above applies to study-units available during the academic year 2023/4. It may be subject to change in subsequent years.

https://www.um.edu.mt/course/studyunit