Shannon Entropy of 0.922, 3 Distinct Values
-
05-11-2019 - |
Question
Given a string of values $AAAAAAAABC$, the Shannon Entropy in log base $2$ comes to $0.922$. From what I understand, in base $2$ the Shannon Entropy rounded up is the minimum number of bits in binary to represent a single one of the values.
Taken from the introduction on this wikipedia page:
https://en.wikipedia.org/wiki/Entropy_%28information_theory%29
So, how can three values be represented by one bit? $A$ could be $1$, $B$ could be $0$; but how could you represent $C$?
Thank you in advance.
No correct solution
Licensed under: CC-BY-SA with attribution
Not affiliated with cs.stackexchange