IS2000 | Principles of Information Science
  • Home
  • Schedule
  • Labs
    • Lab - SQL, SQLite
    • Lab - R
    • Lab - Decision Analysis
  • Assignments
    • Assignment 1
    • Assignment 2
    • Assignment 3
    • Assignment 4
    • Assignment 5
    • Assignment 6
    • Assignment 7
    • Assignment 8
    • Assignment 9
    • Assignment 10
    • Assignment 11
    • Practicum A
    • Practicum B
    • Blog
  • Policies
    • Attendance
    • Collaboration
    • Exam Rules
    • Assessments
    • Grading
    • Academic Integrity
  • Resources
    • Lecture Notes >
      • Information Science as a Discipline
      • Information Architecture
      • Information Theory
      • Information Collection
      • Essential Excel
      • Essential R
      • Information Modeling
      • Information Representation in XML
      • Patterns XML & DTD
      • Information Retrieval with XPath
      • Information Transformation with XSL
      • Information Storage in RDB
      • Information Retrieval with SQL
      • Information Processing in R
      • Information-Based Decision
      • Information Management & Policy
      • Information Security & Privacy
      • Information Transmission
      • Information Systems
      • Predictive Analytics
      • Process Analytics
      • Information Visualization
    • Text Books
    • Tools
    • Additional Readings
    • Archive
  • Help
    • Blog
    • Class Diary
    • Office Hours
    • Instructor

Information Theory


Slide Deck | Lecture Notes | Guest Lectures | Discussions | Self-Assessment | Diary

This unit introduces the Shannon Model of information and the Shannon-Weaver model of information transmission. It shows how the amount of information in a message can be quantified.​

Objectives
Upon completion of this lesson, you will be able to
  • describe different kinds of information
  • explain the role of noise
  • calculate the information content of a message
  • differentiate between subjective, empirical, and logical approaches to probability
  • relate the entropy of information
  • discuss the value of information
Required Readings
  • Wikipedia: Shannon-Weaver Model of Communication
  • Intuitive Explanation of Information Entropy
  • What is entropy and information gain? An Example of Entropy in Machine Learning & Decision Trees.
Suggested Readings
  • ​​Carr, N. (2008). Is Google Making us Stupid?, The Atlantic. July 1, 2008.
  • Semantic Conceptions of Information, Stanford Encyclopedia of Philosophy, October 5, 2005.
Picture

Learning

Blackboard
Lynda.com

Support

Contact Instructor
FAQ
Terms of Use
© COPYRIGHT 2016-19 by Martin Schedlbauer
​FREE FOR ACADEMIC USE WITH ACKNOWLEDGEMENT. 
ALL RIGHTS RESERVED.