Math and science::INF ML AI
Shannon information content
For an ensemble, \( X = (x, A_x, P_x) \), the Shannon information content of an event, \( x \) is defined to be:
\[ h(x) = [...] \\ \text{Where 'x' may be an outcome: a subset of } A_x \]
It is measured in bits.