University of Malta

Study-Unit Description
UOM Main Page
Apply - Admissions 2016
Campus Map button


TITLE Information Theory and Coding

LEVEL 05 - Postgraduate Modular Diploma or Degree Course


DEPARTMENT Communications and Computer Engineering

DESCRIPTION This study-unit covers fundamental topics in information theory and coding. The unit covers the necessary theoretical background that can be applied to coding structures in communication channels and various communication systems. The study-unit consists of two parts.

The first part deals with the concept of information sources and channels, and covers in detail fundamental topics including entropy, mutual information, relative entropy, Shannon’s first and second coding theorems, rate distortion theory, data compression and channel capacity.

The second part deals with the design and analysis of error correcting codes. Linear block, cyclic, convolutional and capacity achieving codes will be considered together with corresponding encoding and decoding algorithms.

Learning Outcomes:

By the end of the study-unit the student will be able to:
- Compute basic information theory and coding calculations;
- Analyse and interpret the mathematical structure of various codes;
- Implement various decoders;
- Given a communication system scenario, analyse and evaluate via computer simulation various coding schemes to determine the optimal choice of code involving the various parameters of code efficiency, complexity and error resilience.

Main Text/s and any supplementary readings:

- Lin S, G Costillo D.J. 2004 Error Control Coding 2nd Ed., Prentice Hall, ISBN 978-0130426727.
- Wells R.B., 1999. Applied Coding and Information Theory for Engineers, Prentice Hall, ISBN 0-13-961327-7.

Supplementary Reading:
- MacKay D.J.C., 2003. Information Theory, Inference and Learning Algorithms, Cambridge University Press, ISBN 978-0521642989.


Assessment Component/s Resit Availability Weighting
Assignment Yes 15%
Examination (2 Hours) Yes 85%

LECTURER/S Johann A. Briffa

The University makes every effort to ensure that the published Courses Plans, Programmes of Study and Study-Unit information are complete and up-to-date at the time of publication. The University reserves the right to make changes in case errors are detected after publication.
The availability of optional units may be subject to timetabling constraints.
Units not attracting a sufficient number of registrations may be withdrawn without notice.
It should be noted that all the information in the study-unit description above applies to the academic year 2017/8, if study-unit is available during this academic year, and may be subject to change in subsequent years.
Study-unit Registration Forms 2017/8


For Undergraduate (Day) and Postgraduate students.


Academic Advisors 2017/8


Academic Advisors for ICT 1st year students (Intake 2017/8), NOW available

Faculty of ICT Timetables


ICT Timetables are available from Here.

Health and Safety Regulations for Labs Form

The Faculty of ICT Health and Safety Regulations for Laboratories form can be found here



Log In back to UoM Homepage