A source emits one of four symbols s0, s1, s2, and s3 with probabilities 1/3, 1/6, 1/4 and 1/4, respectively. The successive symbols emitted by the source are statistically independent. Calculate the entropy of the source.
Let X represent the outcome of a single roll of a fair die. What is the entropy of X?