AI Glossary / AI and machine learning / Beginner
Unlabeled example
Definition
An unlabeled example is one record containing input information without a known target answer for the task at hand. A trained supervised model can use that record's inputs to estimate the missing target.
What it means
An example might describe a parcel using its destination, weight and dispatch time. Before delivery, its eventual arrival status is unknown. For a model predicting lateness, the parcel is an unlabeled example.
The inputs can be complete even though the answer is absent. Conversely, a record can have a target label and still be missing an input feature. These are different data-quality situations.
Unlabeled status also depends on the task. The parcel may already have a service-category label while lacking a lateness outcome. There is no contradiction because the labels answer different questions.
For business users, this is the ordinary situation at prediction time: the system receives available facts and estimates something not yet known. The prediction should not silently become a verified label merely because it has been stored in a table.
How it works
The application gathers the features required by the model and applies the same preparation rules used during development. It checks units, categories, missing inputs and relevant timestamps.
The trained model produces a prediction, score or probability estimate. The workflow then decides how to use it, perhaps suggesting a queue, flagging a case for review or supporting a planning estimate.
Later, a true outcome or reviewed answer may become available. Linking that evidence back to the original prediction helps measure performance and may support future retraining.
The system should retain the distinction between predicted labels and observed labels. Otherwise, feedback can become circular: the next model may be trained to imitate old predictions while the organization believes it is learning from real outcomes.
Three practical examples
- Delivery planning: a newly dispatched parcel has known features but no final on-time or late outcome.
- Document routing: a new enquiry arrives before a reviewer assigns its correct department label.
- Product inspection: an incoming image is classified before a human or later process confirms whether a defect is present.
Think of it this way
Think of a completed question sheet with the answer box left blank. The information needed to attempt an answer may be present, but the correct answer has not yet been supplied.
The analogy has a limit. Some real examples lack sufficient information for a confident answer, and some targets are ambiguous rather than merely delayed. A model's willingness to fill the box does not prove that the answer is well supported.
Worked example
Tracking a prediction and its later outcome
Suppose an invented delivery record is created at 08:00 with route R, weight four kilograms and a promised arrival before 18:00. At 08:05, a model estimates a 0.7 probability of late arrival.
At that moment, the lateness label is still unknown. The value 0.7 is a prediction, not an observed outcome. If delivery occurs at 17:40, the eventual label is on time under the stated definition.
The record can now support evaluation by comparing the saved prediction with the later outcome. A single on-time result does not prove that a 0.7 estimate was invalid; probability quality is assessed across suitable collections of predictions.
The example illustrates why timestamps and separate fields for prediction and observation matter. The numbers are invented for teaching.
Illustrative case study
A fictional support system automatically writes its suggested category into the same field staff use for confirmed routing. Months later, analysts treat every value in that field as a reviewed training label.
The team separates model suggestions from confirmed decisions and records whether a person changed or accepted the suggestion. It also samples accepted suggestions for quality review, because acceptance alone may reflect limited attention.
The lesson is that an unlabeled example does not become reliably labeled just because software supplies a value. The provenance of the answer determines what evidence it provides.
Common misconceptions and mistakes
- Unlabeled means all fields are blank. The inputs may be complete while only the target is unknown.
- A model prediction is automatically ground truth. It is an estimate that may later be checked against evidence.
- Every example will eventually get a clear label. Some outcomes remain unobserved, delayed or disputed and need explicit handling.
Business use
Understanding unlabeled examples helps design prediction workflows and feedback collection. It clarifies what the system knows now and what evidence will become available later.
Keep prediction values, decision actions and verified outcomes distinct. Define how outcomes are linked to the original record and what happens when they never arrive. This supports credible monitoring and prevents retraining datasets from quietly becoming collections of the model's own guesses.
People also ask
Can an unlabeled example be used in clustering?
Yes. Clustering can examine its input relationships without a supervised target label.
Is a record with a missing feature automatically unlabeled?
No. Missing inputs and missing targets are separate issues.
Can a person provide the label?
Yes, if the task can be annotated and the review process defines the answer consistently.
Check your understanding
A classifier assigns a new message to billing before anyone reviews it. Is the assignment already a verified billing label?
Answer: No. It is the model's prediction. The system should preserve that distinction until suitable evidence or review establishes the target answer.
Related terms
Learn next
Read inference and ground truth. Trace one new record through prediction, action and later verification, checking that each stage is stored with its own meaning and timestamp.
More in AI and machine learning
- Univariate feature selection - Univariate feature selection evaluates input features one at a time and selects those that score well under a chosen statistical criterion.
- Universal portfolio algorithm - The universal portfolio algorithm is an online portfolio-selection method introduced by Thomas Cover.
- Universal psychometrics - Universal psychometrics is a research approach to measuring cognitive abilities across different kinds of systems, including humans, other animals...
- Unsupervised Clustering - Unsupervised clustering groups examples by patterns in their inputs without using predefined target labels to determine the groups.
- Unsupervised learning - Unsupervised learning finds structure in data without using supplied target labels to guide the fitting objective.
- Unsupported-claim rate - Unsupported-claim rate is the proportion of evaluated claims in a response that lack adequate grounding under a defined evidence standard.
Sources
Google, Machine Learning Glossary, unlabeled example: https://developers.google.com/machine-learning/glossary#unlabeled_example. Core record-level definition consulted. Delivery and support scenarios are original teaching examples.
Previous: Unlabeled data Next: Unlikelihood training