AI Glossary / Statistics and probability / Intermediate
Credence (statistics)
Definition
Credence is a degree of belief that a proposition is true. In probabilistic reasoning, it is represented on a scale from zero to one and interpreted relative to available information. Credences can express uncertainty about a future event, an unknown past event, or a hypothesis, rather than only long-run event frequencies.
What it means
Someone may believe a delivery is likely to arrive tomorrow without being certain. A credence of 0.7 gives that belief a numerical expression, provided the event and relevant information are clearly specified.
This is not a claim that tomorrow's delivery is 70% true. The proposition will be true or false; the uncertainty concerns what the person or model knows now. Two people can have different credences because they have different information or assumptions.
Credence belongs to a family of ideas about subjective probability and Bayesian reasoning. Calling a number a credence does not make it well justified, calibrated, or immune to correction. The quality of evidence and reasoning still matters.
How it works
Start with a clearly defined proposition and an information set. In a probabilistic representation, assign compatible probabilities to related propositions. For example, a proposition and its negation receive probabilities summing to one, while mutually exclusive alternatives have additive probabilities.
When new evidence is learned with certainty in a model that assigns it positive probability, ordinary Bayesian conditionalization updates credence using the prior and the evidence likelihood. The posterior is proportional to prior probability times likelihood.
Assess more than internal coherence. A coherent set of numbers can still rest on poor evidence. Where repeated, resolvable forecasts are available, calibration and suitable scoring rules can help evaluate performance. A single outcome cannot by itself establish whether a probabilistic forecasting practice is reliable.
Three practical examples
- A project manager states a probability that a launch milestone will be met by a specific date and records the assumptions behind it.
- An analyst updates belief in a possible system fault after receiving a diagnostic signal, rather than treating the signal as conclusive.
- An AI evaluation team separates a model's numerical confidence output from evidence that those outputs reliably represent uncertainty on the intended tasks.
Think of it this way
Think of a dimmer rather than an on-off switch for belief. The brightness represents confidence in a clearly defined claim. Turning the dimmer does not change the claim's truth; it changes how strongly you currently support it in light of what you know.
Worked example
Consider an original diagnostic illustration. Let H be the proposition that a device has a specified fault. Before an alert, an analyst assigns credence P(H) = 0.25, so P(not H) = 0.75.
Suppose the stated model gives P(alert|H) = 0.60 and P(alert|not H) = 0.20. The joint probabilities are 0.25 × 0.60 = 0.15 for fault and alert, and 0.75 × 0.20 = 0.15 for no fault and alert.
The total alert probability is 0.30. After observing an alert, posterior credence in H is 0.15/0.30 = 0.50. The alert raises belief from 25% to 50%, but it does not prove the fault exists.
The same result follows from odds. Prior odds are 1:3, the likelihood ratio is 0.60/0.20 = 3, and posterior odds are 1:1.
These are stipulated probabilities for teaching. If alerts are less informative in actual operation, the update is not justified by the arithmetic alone. A second alert also cannot be treated as independent new evidence without checking how the alerts are generated.
Illustrative case study
Fictional case: Brightline Delivery asks managers to forecast whether shipments will arrive by a defined deadline. Initially, labels such as likely and almost certain vary widely between teams.
The company introduces numerical forecasts with written evidence notes and records outcomes when deadlines pass. It compares groups of similar forecasts with their realized frequencies and examines whether confidence changes appropriately when new tracking information arrives.
Managers learn that a shipment assigned 80% can still arrive late without making the original forecast logically inconsistent. The useful question is whether the forecasting practice is informative and well calibrated over many relevant cases. Brightline also avoids rewarding confidence alone, which could encourage exaggerated certainty.
Common misconceptions and mistakes
- Credence is not the truth value of the proposition.
- Subjective does not mean arbitrary or unsupported; evidence can strongly constrain reasonable assessments.
- A 50% credence is a particular probability judgment, not a universal representation of complete ignorance.
- A confidence score emitted by an AI system is not automatically a calibrated credence about correctness.
- Internal coherence does not guarantee external accuracy.
- Ordinary updating cannot revive a hypothesis assigned zero prior probability when the conditioning event has positive probability; genuine model revision is a different operation.
Business use
Businesses can use explicit credences to clarify uncertainty in planning and evidence assessment. Define the event, resolution date, source information, and assumptions so later discussion concerns the same proposition.
For decisions, combine probabilities with consequences. Two managers with the same credence may reasonably choose different actions if their costs, benefits, or responsibilities differ. Belief assessment and action selection should not be silently conflated.
When pooling assessments, check whether people share the same evidence. Agreement among several analysts who all read one report does not supply several independent reports. Record changes in information and distinguish a revised forecast from a changed event definition.
People also ask
Can credence concern something already decided?
Yes. An analyst may be uncertain about a past event whose outcome is not yet known to them.
Is credence necessarily a Bayesian posterior?
No. It can describe a prior or another probability assessment; a posterior is a credence after a specified update.
Does a failed 90% forecast prove poor calibration?
No. Calibration concerns patterns across an appropriate collection of forecasts, not certainty for each case.
Check your understanding
Answer: 1.
What changed in the worked example?
Answer: The analyst's probability assessment after receiving evidence, not the device's physical state because of that assessment. 2.
Why was the alert insufficient for certainty?
Answer: It also had positive probability when the fault was absent. 3.
Why record an event definition?
Answer: A numerical belief is difficult to interpret or evaluate when its proposition is vague.
Related terms
- Subjective probability
- Bayesian probability
- Prior probability
- Posterior probability
- Calibration
- Expected utility
- likelihood ratio
Learn next
Study probability coherence and Bayes' theorem, then distinguish beliefs from decisions. Practice making precisely worded forecasts and recording their outcomes. Learn how calibration and scoring rules assess a forecasting process without demanding that every high-probability prediction occur.
More in Statistics and probability
- Covariance matrix - A covariance matrix is a square table describing the variances and pairwise covariances of a random vector's components.
- Cox model - The Cox model usually means Cox proportional hazards regression, a method relating predictors to the time until an event while accommodating appropriate...
- Cramér's phi ( F c ) - Cramér's phi, commonly written phi_c and more widely known as Cramér's V, measures association between two categorical variables in a contingency table.
- Criterion variable - A criterion variable is the variable a statistical model or prediction study aims to predict.
- Critical value - A critical value is a boundary used in a statistical decision rule, commonly separating rejection and nonrejection regions for a hypothesis test.
- Cromwell's rule - Cromwell's rule is advice to avoid assigning exact prior probabilities of zero or one to uncertain empirical propositions.
Sources
Stanford Encyclopedia of Philosophy, Bayesian Epistemology, author discussion of credence and conditionalization: https://plato.stanford.edu/entries/epistemology-bayesian/
Stanford Encyclopedia of Philosophy, Formal Representations of Belief: https://plato.stanford.edu/entries/formal-belief/
The primary scholarly treatments were consulted. The diagnostic arithmetic, delivery scenario, and teaching analogy are original illustrations of probabilistic credence.
Previous: Crash blossom Next: Criss-cross algorithm