AI Glossary / Natural language and speech / Advanced
Noisy-or
Definition
Noisy-or is a probabilistic model in which any one of several active causes can produce an effect, but each cause may independently fail to do so. It generalizes logical OR by replacing guaranteed activation with uncertain causal influence.
What it means
A deterministic OR says that the effect is true whenever at least one input is true. Noisy-or allows an active input to be inhibited. If several inputs are active, the effect remains false only when all their individual influences fail, under the model's assumptions.
This provides a compact way to describe a binary outcome with many potential causes. Instead of separately specifying every combination of inputs, the model uses an influence or inhibition parameter for each cause. A leak parameter can represent activation from causes not explicitly listed.
The essential independence assumption concerns the separate mechanisms of influence or inhibition, conditional on the input configuration. It does not automatically assert that the parent variables themselves are independent in the broader world or in the full Bayesian network.
How it works
Let q_i be the probability that active cause i fails to produce a binary effect Y. Without a leak, P(Y=0 | active causes) is the product of q_i over those causes. Therefore P(Y=1 | active causes)=1−product(q_i).
If p_i=1−q_i describes activation strength, the same formula is 1−product(1−p_i). With an independent leak activation probability l, multiply the failure product by (1−l) before subtracting from one.
A full conditional table for k binary parents has 2^k input configurations. Standard noisy-or uses k influence parameters, or k+1 with a leak, for this conditional mechanism. The savings come from strong structural assumptions; they are not a free substitute for modeling interactions that the data actually require.
Three practical examples
- Equipment analysis: model several distinct fault mechanisms that can each trigger an alert, while allowing each mechanism's signal to fail.
- Document classification: combine several possible topic indicators under an explicitly chosen probabilistic model, rather than adding their scores without bounds.
- Workflow simulation: represent several independent triggering mechanisms for a notification, while separating the model from the actual deterministic rules used in production.
Think of it this way
Think of several independent attempts to ring the same bell. The bell stays silent only if every active attempt fails. The analogy is limited because real causes can share a failure mechanism, strengthen each other, or cancel each other; those interactions violate the simple independent-attempt picture.
Worked example
Suppose a fictional alert has two active causes. Cause A independently triggers it with probability 0.60, and cause B with probability 0.30. Their inhibition probabilities are 0.40 and 0.70. With no leak, the probability of no alert is 0.40 × 0.70 = 0.28, so the alert probability is 0.72.
Adding the strengths directly would give 0.90, incorrectly ignoring the overlap where both influences succeed. Now include an independent leak of 0.10. The no-alert probability becomes 0.90 × 0.40 × 0.70 = 0.252, and the alert probability becomes 0.748.
With neither listed cause active, the leak model gives 0.10, whereas the no-leak model gives zero. These are probabilities of the effect given known input states. They do not answer the reverse question, “Given an alert, what is the probability that A occurred?” That requires additional probabilities and inference.
Illustrative case study
Fictional case: Drift Monitor models notifications from two diagnostic checks. Its analyst initially treats the checks as independent influences, then discovers that both can fail when the same power module is unavailable.
The team revises the model to represent the shared condition and compares predictions with observed combinations. It does not simply retune two strengths until the aggregate rate looks reasonable. The example illustrates checking mechanism assumptions; it does not claim that a particular model has been validated or deployed.
Common misconceptions and mistakes
Noisy-or is not ordinary Boolean OR with arbitrary random labels, and it is not a general formula for adding any two probabilities. The active inputs and their influence parameters must have the intended semantics.
Independence of causal influences is not the same as independence of observed causes. More active positive causes cannot reduce the effect probability in the basic model, so it cannot directly represent cancellation. Synergy, where two causes must act together, also needs another representation. A leak handles residual activation, but does not automatically repair all misspecification.
Business use
Use noisy-or when independent sufficient influences are a defensible approximation and compact parameterization is valuable. Document whether parameters mean activation or inhibition, since confusing p_i with q_i reverses the interpretation.
Evaluate combinations of causes, not only cases where one cause is present. Compare predicted and observed rates for joint activation and for the no-cause baseline. Separate causal interpretations from predictive associations: fitting the formula to observational data does not itself establish that intervening on a feature will change the outcome. Preserve uncertainty when the mechanism is only a modeling hypothesis.
People also ask
Can noisy-or represent ordinary OR?
Yes. With no leak and every active cause's success probability equal to one, it reduces to deterministic OR.
What does the leak represent?
An aggregate route by which the effect can occur without the listed causes, modeled according to the chosen leak assumption.
Does it work for every multi-cause outcome?
No. Shared inhibition, negative influences, and strong interactions can require a richer conditional model.
Check your understanding
Two active influences have failure probabilities 0.20 and 0.50, with no leak. What effect probability does noisy-or assign?
Answer: Both must fail for no effect, giving 0.20 × 0.50 = 0.10. The effect probability is therefore 0.90, under independent inhibition.
Related terms
- Bayesian network
- Conditional probability table
- Leak node
- causal independence
- logical OR
- noisy-max
- explaining away
- probabilistic modeling
Learn next
construct the complete four-row conditional table for two causes, first without a leak and then with one. Check the no-cause row and monotonicity. Then introduce a shared inhibitor to see exactly which assumption makes the simple product formula fail.
More in Natural language and speech
- Neural machine translation - Neural machine translation, or NMT, uses neural networks to produce a translation from one human language into another.
- Newline character - A newline character is a control character used to mark a line boundary in text.
- Noisy text analytics - Noisy text analytics is the analysis of text whose spelling, formatting, segmentation, or other characteristics differ from the conventions expected by a...
- Non-capturing group - A non-capturing group is a regular-expression group that organizes part of a pattern without assigning that group a captured substring.
- Non-native speech database - A non-native speech database is an organized collection of recordings from people speaking a language they acquired beyond their first-language background...
- Non-terminal symbols - Non-terminal symbols are grammar symbols that represent categories or intermediate structures and can be expanded by production rules.
Sources
Sources: Russell and Norvig, Artificial Intelligence: A Modern Approach, official corrected page on noisy-or and inhibition: https://aima.eecs.berkeley.edu/errata/aima-421.pdf . KU Leuven ProbLog tutorial, Noisy-or, a probabilistic-programming application: https://dtai-static.cs.kuleuven.be/problog/tutorial/learning/04_noisyor.html . The alert probabilities and Drift Monitor scenario are original teaching examples, not empirical causal estimates.
Previous: Noisy channel model Next: Noisy text analytics