Copyright 2004 Ken Greenebaum
Exam #3 Dice Info/Entropy
n1 Die
n6 possibilities each with p(e)=1/6
nH(x)=-1/6 log(1/6) - … 1/6 log(1/6)
n= -6*1/6 log(1/6)
n= -log(1/6)
n= 2.587bits
nWe know it must be < 3 bits
nsince 3 bits can encode 2^3=8 values…