Introduction to Information Theory
Complexity ExplorerFree
Important information
 Course
 Online
 When:
Flexible
This tutorial introduces fundamental concepts in information theory. Information theory has made considerable impact in complex systems, and has in part coevolved with complexity science. Research areas ranging from ecology and biology to aerospace and information technology have all seen benefits from the growth of information theory.
Starts  Location 

Flexible 
Online

What you'll learn on the course
Logic  Maths  Probability  Information Processing  
Information  Computation  Forms of Information  Formula of Information  
Mutual Information  Communication C 
Course programme
In this tutorial, students will follow the development of information theory from bits to modern application in computing and communication. Along the way Seth Lloyd introduces valuable topics in information theory such as mutual information, boolean logic, channel capacity, and the natural relationship between information and entropy.
Lloyd coherently covers a substantial amount of material while limiting discussion of the mathematics involved. When formulas or derivations are considered, Lloyd describes the mathematics such that less advanced math students will find the tutorial accessible. Prerequisites for this tutorial are an understanding of logarithms, and at least a year of highschool algebra.
 Introduction
 Forms of Information
 Information and Probability
 Fundamental Formula of Information
 Computation and Logic: Information Processing
 Mutual Information
 Communication Capacity
 Shannon's Coding Theorem
 The Manifold Things Information Measures
 Homework