AI Glossary / Graphs and symbolic AI / Intermediate
Complete data
Definition
Complete data contain observed values for every variable in the probability model for every example being used to learn that model. Completeness is relative to the chosen variables. It simplifies parameter estimation because the learner does not need to infer missing or hidden values for those examples, although other statistical and data-quality problems can remain.
What it means
Imagine a probability model containing delivery method and arrival status. If both variables are recorded for every delivery example, the dataset is complete for that model. If some arrival statuses are unknown, those examples are incomplete relative to the same model.
Adding an unobserved variable, such as a hidden operating condition, changes the assessment. A table can have no visibly blank cells yet remain incomplete for a model that includes a latent variable absent from the table.
Complete does not mean that every possible event has been observed, that the sample represents the whole population, or that every recorded value is correct. The term describes observation of model variables, not a general certificate of data quality.
How it works
First specify the probability model's variables and the unit represented by each example. Check whether the dataset provides an observed value for every variable in each example, using consistent definitions and valid value ranges.
For a discrete Bayesian network with a fixed structure and fully observed variables, maximum-likelihood parameter estimation can often use local counts. A conditional probability is estimated by counting a child value together with a parent configuration and dividing by the count for that parent configuration.
This calculation still requires enough relevant observations. If a parent configuration never appears, its conditional probabilities cannot be estimated by a simple observed frequency because the denominator is zero. Priors or other modeling decisions may be needed.
With incomplete or latent-variable data, the learner must handle unavailable values explicitly, often through probabilistic inference or another justified method. Filling a blank with a guessed value does not turn that guess into an actual observation.
Three practical examples
1. A quality-control dataset records both machine setting and inspection result for every sampled item, supporting direct conditional-frequency calculations for those variables.
2. A training exercise compares fully observed examples with versions where some labels are hidden, showing why the learning procedure must change.
3. A data team reviews whether a table is complete for an expanded model after adding a variable that was never collected in the original process.
Think of it this way
Think of an observation sheet whose required measurement columns are all recorded for every row. That supports calculations using those columns without first filling gaps.
The analogy has limits: recorded measurements can be inaccurate, important cases can be absent, and the model may require a hidden variable that has no column. A filled sheet is not necessarily a complete description of reality.
Worked example
Consider a model with binary variables Mode and Passed. Mode is Fast or Standard, and Passed is Yes or No. Every one of 20 inspected items has both values recorded.
Eight items used Fast mode: six passed and two did not. Twelve used Standard mode: nine passed and three did not. The maximum-likelihood estimate of P(Mode=Fast) is 8/20 = 0.4.
The conditional pass estimates are P(Passed=Yes given Fast) = 6/8 = 0.75 and P(Passed=Yes given Standard) = 9/12 = 0.75. These calculations use observed counts for every required variable.
Now hide the pass result for two Fast-mode items. Their rows are incomplete for this model. Treating both unknown results as failures would introduce an unsupported assumption. The original complete-data calculation no longer applies unchanged. Even before hiding values, the small sample did not prove that the true population pass rates were exactly equal.
Illustrative case study
Fictional case: Oakline Manufacturing receives an export labeled complete because every visible spreadsheet cell has a value. Its modeling team discovers that an unknown inspection result was encoded as the text Pending and later converted to No.
The team restores the distinction between an observed failure and an unobserved outcome. It documents which rows support complete-data learning and which require a missing-data approach or additional collection.
Oakline also checks whether the inspected items represent the intended production population. The fictional lesson is that absence of blank cells and statistical completeness are different from accuracy and representative sampling.
Common misconceptions and mistakes
Complete data are not necessarily abundant data. A small fully observed sample can yield uncertain estimates.
They do not guarantee coverage of every combination of variable values. Some conditional-probability rows may remain unsupported even though every collected example is fully observed.
Imputation does not create observed evidence. An imputed dataset may be useful, but its filled values and uncertainty should remain distinguishable from measurements.
Finally, completeness depends on the model. A dataset can be complete for one set of variables and incomplete for another. State the intended variables instead of describing completeness as an unconditional property of a file.
Business use
For business modeling, define completeness at the level of the proposed learning task. Document the variables, examples, missing-value codes, and any latent quantities before selecting an estimation method.
Keep separate checks for accuracy, representativeness, coverage, and information leakage. A perfectly filled table can still contain future information unavailable at prediction time or exclude relevant operating conditions. When reporting results, distinguish observed data from imputed values and explain how unsupported parameter combinations were handled.
People also ask
Does complete data mean every possible outcome appears?
No. It means every model variable is observed for each included example, not that all combinations occur.
Can a table with no blanks be incomplete for a model?
Yes. The model may contain an unobserved latent variable, or placeholder values may disguise missing observations.
Does completeness eliminate uncertainty in learned probabilities?
No. Sampling uncertainty, model assumptions, and measurement errors can remain.
Check your understanding
Every row records Mode, but three rows lack Passed. Are the data complete for a model containing both variables?
Answer: No. Those examples lack a value for a required model variable. The learning method must handle that missingness rather than treating unknown results as observed outcomes.
Related terms
- Missing data
- Latent variable
- Parameter learning
- Bayesian network
- Conditional probability table
- Expectation-maximization
- maximum likelihood
- imputation
Learn next
Build a small two-variable count table and estimate its probabilities. Then remove selected observations and explain which counts are no longer known. Study missing-data assumptions and expectation-maximization before attempting to reuse complete-data formulas in a latent-variable setting.
More in Graphs and symbolic AI
- Competitive ratio - A competitive ratio measures an online algorithm's performance against an optimal offline algorithm that knows the entire input sequence in advance.
- Complementary literals - Complementary literals are a pair consisting of an atom and its negation, such as P and NOT P.
- Complete assignment - A complete assignment gives a value to every variable in a specified problem.
- Complete-state formulation - A complete-state formulation represents every search state as a fully specified candidate, rather than a partially constructed candidate.
- Completeness - Completeness is a guarantee that a method can find every kind of result it is intended to find within a specified formal scope.
- Completion - Completion, in the logical database and rule-program sense, makes explicit that the listed facts or defining rules provide all the ways a specified relation...
Sources
Primary source consulted: Russell and Norvig, Statistical Learning Methods, section on learning with complete data, https://aima.cs.berkeley.edu/newchap20.pdf . Scope is probabilistic-model learning despite the supplied broader category. The inspection counts and fictional data-cleaning case are original teaching examples.
Previous: Complete assignment Next: Complete Join