header
Show Answer
Math and science::INF ML AI

Belief networks: independence

It's not immediately obvious how to interpret the conditional relationships represented by a belief network. For example, consider the networks below.

Network(s) [...] represent the distribution:

p(x1,x2,x3)=p(x1|x3)p(x2|x3)p(x3)=p(x2|x3)p(x3|x1)p(x1)=p(x1|x3)p(x3|x2)p(x2)

Network(s) [...] represent the distribution:

p(x1,x2,x3)=p(x3|x1,x2)p(x1)p(x2)

Next, consider conditional independence.


  • In a), x and y are unconditionally dependent, and conditioned on z they are independent. Knowing either gives information on the distribution of z, which in turn informs of the others distribution.. p(x,y|z)=p(x|z)p(y|z)
  • In b), x and y are unconditionally dependent, and conditioned on z they are independent. p(x,y|z)p(z|x)p(x)p(y|z)
  • In c), x and y are unconditionally independent, and conditioned on z they are dependent. p(x,y|z)p(z|x,y)p(x)p(y)
  • Id d), x and y are unconditionally independent, and conditioned on z or w, are dependent. See book for full equation.