[Probability] Conditional Probability Table (CPT)

Lookup Table

Table with 2^k rows can specify an arbitrary CPT, where k is number of parents of a node.

However, this is too complicated

Deterministic Node

“AND” gate will check whether all of them are 1,
“OR” gate will check whether all of them are 0.

However, this is too simple

Noisy-OR

Use k numbers to parametrize all 2^k entries.

Screen Shot 2018-10-25 at 10.50.03 PM

More parents are equal to 1, the more probable that Y=1.

However, this only takes into account excitation!

Sigmoid CPT

Use k real numbers to parametrize 2^k elements in CPT

Screen Shot 2018-10-25 at 10.50.11 PM

Also known as logistic regression in statistics,
activation function in neural networks.

Different from Noisy-OR in that this can mix both inhibition and excitation!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.