AI Glossary / Governance, ethics and safety / Intermediate

Nondiscrimination

Definition

Nondiscrimination is the principle that people should not face unjustified disadvantage or exclusion on grounds that should not determine their treatment. In AI governance, it concerns how systems are designed, used and evaluated within the decisions and social settings they affect.

What it means

An AI system can influence access, visibility, service quality or opportunities. Nondiscrimination asks whether its operation contributes to inappropriate differences in treatment, including through the surrounding process rather than only the model's explicit inputs.

The concept has ethical and legal dimensions. Which characteristics receive legal protection and how discrimination is assessed depend on jurisdiction and context. This entry explains the general governance principle rather than offering a universal legal test.

Nondiscrimination is not the same as making every measured outcome identical. Nor is it established by removing a demographic field. Other variables can act as proxies, and an apparently uniform procedure can create different barriers for different people. Assessment needs a justified account of the relevant treatment and consequences.

How it works

Begin with the decision or service affected by AI and identify who may experience its consequences. Examine the rules, data, interface and opportunities to obtain help or challenge a result.

Use appropriate quantitative analysis to locate differences, but interpret them with contextual evidence. Error rates, access rates and service outcomes answer different questions. A metric can reveal a disparity without proving its cause or resolving whether the treatment is justified.

Consult relevant expertise and affected people, investigate mechanisms and assess possible changes. Improvements may involve data, model design, accessible processes or human decision rules. Document why a particular comparison matters and what remains uncertain. Ongoing review is important because a system can change its effects as the population or workflow changes.

Three practical examples

  • A service team examines whether an AI-only interface prevents people using assistive technology from completing the same essential task.
  • A document-review project investigates whether a language model's error rates differ across the supported languages and whether an alternative route is needed.
  • An organization checks whether apparently neutral ranking features reproduce unjustified disadvantages from earlier decisions.

Think of it this way

Think of providing access to a building. Applying the same instruction to use the stairs to everyone may look uniform while creating a barrier for some visitors.

The analogy shows why equal wording does not necessarily provide appropriate access. It does not settle every AI comparison; the relevant context, rights and practical alternatives still require examination.

Worked example

Equal total accuracy can conceal unequal errors

In an invented evaluation, a classifier processes 100 cases in each of two groups. For each group, 50 cases should receive a positive result and 50 a negative result.

For group A, the model misses five positives and incorrectly flags 15 negatives. For group B, it misses 15 positives and incorrectly flags five negatives. Both groups have 80 correct results out of 100, or 80% accuracy.

The equal accuracy does not establish equivalent consequences. Group B experiences more missed positives, while group A experiences more false positives. Which matters depends on the service and decision. The figures identify differences for investigation; they do not, by themselves, prove unlawful discrimination or determine the appropriate remedy.

Illustrative case study

Fictional company Willow Access introduces an AI assistant as the main route to booking support. Testing focuses on the correctness of its answers, but feedback shows that some users cannot complete the interaction with their usual assistive tools.

The company reviews the whole journey, improves the interface and provides an effective alternative route. It evaluates task completion with relevant users rather than assuming that a technically available service is equally usable by everyone.

The case illustrates nondiscrimination as a property of the delivered service and its conditions. Improving model accuracy alone would not have removed the access barrier.

Common misconceptions and mistakes

  • Removing protected attributes guarantees nondiscrimination. Proxies and process barriers may remain.
  • One fairness metric provides a complete answer. Different metrics capture different aspects and can conflict.
  • Every observed difference proves discrimination. Context, uncertainty and causal mechanisms require investigation.
  • Treating everyone identically is always sufficient. Relevant differences in access or needs can make a uniform process exclusionary.

Business use

Businesses should connect nondiscrimination commitments to the actual decisions and services in which AI participates. That means examining data and models alongside interfaces, human review and routes for contesting or correcting outcomes.

Use a combination of measurement and contextual review, and seek applicable legal expertise when legal obligations are at issue. Keep the ethical principle distinct from a claim that a particular metric proves compliance. Clear documentation should show the relevant groups or situations examined, the rationale for the evaluation and the actions taken in response to supported concerns.

People also ask

Is nondiscrimination identical to algorithmic fairness?

The concepts overlap, but fairness has many technical and normative definitions, while nondiscrimination also has specific ethical and legal contexts.

Can a system discriminate without explicit demographic inputs?

Yes. Other variables and operational processes can create inappropriate disadvantages.

Does meeting one numerical target establish compliance?

No. Legal and ethical assessment requires the applicable context and broader evidence.

Check your understanding

Two groups have equal model accuracy, but one experiences many more missed positive cases. Can the team conclude that all relevant treatment is equal?

Answer: No. Aggregate accuracy hides different error patterns. The consequences and reasons for those differences must be examined in the intended use.

Related terms

  • Harmful bias
  • Protected attribute
  • Disparate impact
  • Equality of opportunity
  • Fairness
  • accessibility

Learn next

Read fairness and accessibility. Identify one AI-supported decision and map who can be disadvantaged at each stage, including access, prediction, human action and appeal. Choose evidence that addresses those specific pathways.

More in Governance, ethics and safety

  • Model Selection Bias - Model selection bias is distortion introduced when a model is chosen using data and the chosen result is interpreted without accounting for that selection.
  • Multi-level security - Multi-level security is an approach to processing information with different security classifications and categories while allowing authorized users...
  • Non-response bias - Non-response bias occurs when people who provide data differ in relevant ways from those invited or eligible to respond who do not.
  • Offline learning - Offline learning is training a model from an already collected dataset rather than continually updating it as new operational examples arrive.
  • Opacity - Opacity is difficulty seeing or understanding how an AI system operates, reaches an output or affects a decision.
  • Operationalization - Operationalization is the process of translating a concept into observable measures or concrete procedures.

Sources

UNESCO, Recommendation on the Ethics of Artificial Intelligence: https://www.unesco.org/en/artificial-intelligence/recommendation-ethics. NIST AI RMF, AI Risks and Trustworthiness: https://airc.nist.gov/airmf-resources/airmf/3-sec-characteristics/. These support the general ethical framing. The entry does not substitute for a jurisdiction-specific legal analysis; examples and counts are original illustrations.

Previous: Nondirectional test Next: Nonhomogeneous Gaussian regression

  • Home
  • Daily AI Updates
  • Blog
  • AIFBL Academy
  • AI Glossary
  • Products and Tools
  • Store
  • Free CFO AI Prompt Pack
  • About Shihan Sheriff
  • Privacy Policy
  • Terms of Use
  • Refund Policy
  • Cookie Policy
  • Earnings Disclaimer