انت هنا الان : شبكة جامعة بابل > موقع الكلية > نظام التعليم الالكتروني > مشاهدة المحاضرة

المحاضرة الثانية: نظرية المعلومات

Share |
الكلية كلية تكنولوجيا المعلومات     القسم قسم البرامجيات     المرحلة 2
أستاذ المادة حوراء شريف حمزة حسين       06/03/2018 06:52:06

Information is the reduction of uncertainty. Imagine your friend invites you to dinner for the first time. When you arrive at the building where he lives you find that you have misplaced his apartment number. He lives in a building with 4 floors and 8 apartments on each floor. If a neighbor passing by tells you that your friend lives on the top floor, your uncertainty about where he lives reduces from 32 choices to 8. By reducing your uncertainty, the neighbor has conveyed information to you 2 bits. How can we quantify the amount of information? Information theory is the branch of mathematics that describes how uncertainty should be quantified, manipulated and represented
The most fundamental quantity in information theory is entropy measures the amount of uncertainty of an unknown or random quantity. The entropy of a random variable X is defined to be:

Information is the reduction of uncertainty. Imagine your friend invites you to dinner for the first time. When you arrive at the building where he lives you find that you have misplaced his apartment number. He lives in a building with 4 floors and 8 apartments on each floor. If a neighbor passing by tells you that your friend lives on the top floor, your uncertainty about where he lives reduces from 32 choices to 8. By reducing your uncertainty, the neighbor has conveyed information to you 2 bits. How can we quantify the amount of information? Information theory is the branch of mathematics that describes how uncertainty should be quantified, manipulated and represented
The most fundamental quantity in information theory is entropy measures the amount of uncertainty of an unknown or random quantity. The entropy of a random variable X is defined to be:


المادة المعروضة اعلاه هي مدخل الى المحاضرة المرفوعة بواسطة استاذ(ة) المادة . وقد تبدو لك غير متكاملة . حيث يضع استاذ المادة في بعض الاحيان فقط الجزء الاول من المحاضرة من اجل الاطلاع على ما ستقوم بتحميله لاحقا . في نظام التعليم الالكتروني نوفر هذه الخدمة لكي نبقيك على اطلاع حول محتوى الملف الذي ستقوم بتحميله .
download lecture file topic