header
Show Answer
Math and science::INF ML AI

Belief networks: independence

It's not immediately obvious how to interpret the conditional relationships represented by a belief network. For example, consider the networks below.

Network(s) b, c and d represent the distribution:

p(x1,x2,x3)=p(x1|x3)p(x2|x3)p(x3)=p(x2|x3)p(x3|x1)p(x1)=p(x1|x3)p(x3|x2)p(x2)

Network(s) a represent the distribution:

p(x1,x2,x3)=p(x3|x1,x2)p(x1)p(x2)

Next, consider conditional independence.


  • In a), x and y are unconditionally [...], and conditioned on z they are [...]. p(x,y|z)=p(x|z)p(y|z)
  • In b), x and y are unconditionally [...], and conditioned on z they are [...]. p(x,y|z)p(z|x)p(x)p(y|z)
  • In c), x and y are unconditionally [...], and conditioned on z they are [...]. p(x,y|z)p(z|x,y)p(x)p(y)
  • Id d), x and y are unconditionally [...], and conditioned on z or w, are [...]. See book for full equation.