المحاضرة الثالثة: نظرية المعلومات

Source coding
Introduction:
An important problem in communications is the efficient representation of data
generated by a discrete source. The process by which this representation is
accomplished is called source encoding. The device that performs the representation is
called a source encoder.
Our primary interest is in the development of an efficient source encoder that
satisfies two functional requirements:
1. The code words produced by the encoder are in binary form.
2. The source code is uniquely decodable, so that the original source sequence can be
reconstructed perfectly from the encoded binary sequence.
Source coding does not change or alter the source entropy, i.e. the average number of
information bits per source symbol. In this sense source entropy is a fundamental
Source coding
Introduction:
An important problem in communications is the efficient representation of data
generated by a discrete source. The process by which this representation is
accomplished is called source encoding. The device that performs the representation is
called a source encoder.
Our primary interest is in the development of an efficient source encoder that
satisfies two functional requirements:
1. The code words produced by the encoder are in binary form.
2. The source code is uniquely decodable, so that the original source sequence can be
reconstructed perfectly from the encoded binary sequence.
Source coding does not change or alter the source entropy, i.e. the average number of
information bits per source symbol. In this sense source entropy is a fundamental