AI Glossary / Governance, ethics and safety / Intermediate
Privacy-by-design
Definition
Privacy by design is an approach that integrates privacy into the purpose, architecture, operation and lifecycle of a system from the outset. It treats privacy as a design requirement to be implemented and tested, rather than a policy statement added after the system is built.
What it means
An AI feature's earliest choices can determine what information it collects, where processing occurs and which later uses become possible. Once raw data have been copied across several services, a late request to limit exposure can be difficult to implement. Designing for privacy brings those questions into the initial product decisions.
Privacy by default is closely related: it concerns the protections and data handling that apply without requiring people to change settings. A feature can offer excellent optional controls while still exposing more information than necessary through its default configuration.
The broad design approach is used across many contexts. Specific legal obligations, such as data protection by design and by default under the UK GDPR, have jurisdiction-specific requirements. This entry distinguishes the general method from a claim that one checklist establishes legal compliance everywhere.
How it works
Begin by defining the task and the people affected. Ask which information is necessary to achieve the purpose and whether a less intrusive design can work. Compare options before committing to an architecture: for example, what needs to leave a device and what can be processed without retaining raw material?
Translate decisions into requirements. Specify collection boundaries, access rules, retention, sharing and the behavior of privacy controls. Include logs, derived representations and supplier integrations. Make responsibility clear so that privacy requirements survive handoffs between product, engineering and operations teams.
Test the implementation with realistic user journeys and failure cases. Check defaults, account changes, scheduled processes, deletion paths and generated outputs. Keep the assessment active after launch. New features, recipients or data combinations may change the privacy effects even if the original system was reviewed. Documentation should explain the decisions and evidence, rather than merely recording that a review meeting occurred.
Three practical examples
- A note-taking assistant is designed to discard unnecessary raw audio after the defined processing step instead of retaining every recording indefinitely.
- A search assistant preserves document permissions through ingestion, retrieval and generated answers as an explicit architectural requirement.
- A team designs an optional personalization feature with clear defaults, separated purposes and tests showing that disabled accounts are excluded from the optional processing.
Think of it this way
Think of planning access and private spaces when designing a building. Considering those needs early can produce a coherent layout; trying to add them after every corridor is fixed may require expensive compromises.
The analogy does not suggest that privacy is completed when construction ends. Digital systems change continuously, and their data uses require ongoing attention throughout operation.
Worked example
A design choice that reduces unnecessary data flow
In an invented transcription project, 1,000 recordings are processed each week, each containing five minutes of audio. Design A sends all recordings to a central service and keeps them indefinitely. Design B performs the necessary processing, retains only the justified output and applies a defined disposal process to raw recordings.
Both begin with 5,000 minutes of weekly audio. Over 12 weeks, Design A would accumulate 60,000 minutes if nothing is deleted. Design B's retained raw-audio volume depends on its actual disposal window and implementation; it should be measured rather than assumed to be zero.
The comparison identifies an avoidable accumulation pathway. It does not prove that Design B is automatically compliant or free of risk: transcripts, metadata, processing access and backups still need evaluation.
Illustrative case study
Fictional case: Willow Minutes plans an AI assistant for meeting summaries. During early design, the team discovers that the proposed debugging process would retain complete recordings for every meeting, even though most troubleshooting can use less information.
It redesigns diagnostics, limits exceptional access and specifies how temporary material is handled. Product tests include the default recording lifecycle and the path for a failed processing job. The user explanation is written to match the implemented behavior.
The case illustrates how an early decision changes the system rather than merely changing its privacy notice. It does not report a real deployment or verified compliance outcome.
Common misconceptions and mistakes
- Privacy by design means adding a consent screen. A screen is one possible component; data architecture and operational practices also matter.
- It is only a launch-time review. Later changes can introduce new privacy effects.
- Privacy-friendly settings are enough even if downstream systems ignore them. The complete workflow must honor the intended behavior.
Business use
Businesses can make privacy by design reviewable by including it in requirements, supplier selection, acceptance criteria and change management. Ask for evidence that commitments are implemented, such as tests of retention and access boundaries, rather than relying solely on written assurances.
Assign ownership for the entire lifecycle, including decommissioning and disposal. Compare less data-intensive options before collecting information simply because it might become useful. When a particular law applies, map the design to its specific obligations with appropriate expertise. The general principle supports that work but does not replace it.
People also ask
Is privacy by design only for new systems?
No. Existing systems can be redesigned or improved, although earlier decisions may constrain the options.
Is local processing always private?
No. Local storage, access and outputs can still create privacy problems; the full context matters.
How does privacy by default differ?
It concerns the protective behavior that applies without requiring the user to take additional action.
Check your understanding
A feature starts with unnecessary data sharing enabled but offers a difficult-to-find switch to disable it. Does the existence of the switch establish privacy by default?
Answer: No. The default behavior itself needs assessment. Optional controls do not automatically justify unnecessary initial sharing.
Related terms
- Privacy-enhancing technology
- Privacy by default
- data minimisation
- privacy risk assessment
- lifecycle management
- purpose limitation
Learn next
Read data minimization and privacy by default. For one planned feature, compare two architectures and list how their collection, access, retention and sharing requirements differ before choosing one.
More in Governance, ethics and safety
- Privacy funnel - The privacy funnel is an information-theoretic approach to transforming data so that the released representation retains useful information while revealing...
- Privacy leakage - Privacy leakage occurs when information released by a system reveals something about protected data beyond the intended disclosure.
- Privacy protection
- Privileged protected attribute - A privileged protected attribute refers, in common fairness-toolkit terminology, to a value or set of values of a protected attribute designated as the...
- Processing Bias - Processing bias, in the sense used by this source entry, concerns how the ease and effectiveness of processing information can influence feelings and...
- Productization - Productization is the process of turning an AI capability, prototype, or research result into a usable and supportable product or service.
Sources
UK ICO, Data protection by design and by default: https://ico.org.uk/for-organisations/uk-gdpr-guidance-and-resources/accountability-and-governance/guide-to-accountability-and-governance/data-protection-by-design-and-by-default/. Returned guidance explicitly covers lifecycle integration and identifies its UK legal context. NIST Privacy Framework, Getting Started: https://www.nist.gov/privacy-framework/getting-started-0. Examples and design comparisons are original teaching material, not legal compliance assessments.
Previous: Privacy attack Next: Privacy-enhancing technology