Copyright 2004 Ken Greenebaum
Exam #3 Dice Info/Entropy
n
2 Dice:
n
36 possibilities, 11 outcomes
n
P(2)=1/36, P(3)=2/36, P(4)=3/36, P(5)=4/36,
P(6)=5/36, P(7)=6/36, P(8)=5/36. P(9)=4/36,
P(10)=3/36, P(11)=2/36, P(12)=1/36
n
We know that H(X) < 4 since
n
4 bits can encode 2^4=16 values…