Math and science::INF ML AI

# Shannon information content

For an ensemble, $$X = (x, A_x, P_x)$$, the Shannon information content of an event, $$x$$ is defined to be:

$h(x) = [...] \\ \text{Where 'x' may be an outcome: a subset of } A_x$

It is measured in bits.