AI Glossary / Graphs and symbolic AI / Intermediate
Monotonic preference
Definition
A monotonic preference is a preference that moves consistently in a specified direction as an attribute increases, with other relevant conditions held fixed. For a desirable quantity, more is never worse under weak monotonicity, and more is always better under strict monotonicity. The direction, comparison range, and meaning of “other conditions fixed” must be stated.
What it means
A user might prefer more available storage when price, reliability, privacy, and all other features remain unchanged. That is a claim about the direction of preference for storage. It does not say how valuable each additional unit is, whether the user would pay for it, or how the user evaluates a risky offer.
This distinction matters for AI systems that rank options or optimize a utility function. A monotonicity constraint can encode a plausible directional preference, but only if it matches the actual task. More notifications, higher temperature, or greater automation are not automatically desirable just because their numerical values increase.
How it works
Represent the chosen attribute by x and its preference score by U(x), holding the relevant context fixed. An increasing weakly monotonic representation satisfies U(x2) at least U(x1) whenever x2 exceeds x1. Strict monotonicity requires a strict increase. A decreasing preference, such as preferring less waiting time, reverses the direction.
The rate of change is a separate issue. A score can increase quickly at first and then slowly, while remaining monotonic throughout. Multiple attributes introduce another distinction: an improvement in one attribute may be outweighed by a worsening in another. Monotonicity alone does not specify the tradeoff between them.
Three practical examples
- A recommendation system can encode that a shorter delivery delay is preferred when product, price, reliability, and all other conditions match.
- A planning model can treat additional usable reserve capacity as non-worsening over a defined range, provided it introduces no extra cost or operational burden.
- A preference-elicitation exercise can ask whether a user always prefers a higher setting, prefers a lower setting, or has an ideal intermediate value.
Think of it this way
Think of walking along a path that never goes downhill: progress may be steep, gentle, or flat, but it does not reverse direction. Strict monotonicity removes the flat portions when comparing distinct positions. The analogy is limited because a real choice often changes several attributes at once, and an upward score is meaningful only relative to a declared preference interpretation.
Worked example
Suppose an invented task awards useful progress points x, and a decision maker's assumed utility for certain outcomes is U(x) = square root of x, for nonnegative x. Outcomes of 0, 25, and 100 points therefore have utilities 0, 5, and 10. More points are strictly preferred, but utility does not increase linearly with points.
Compare a certain 36-point outcome with a lottery giving 100 points half the time and 0 half the time. The certain outcome has utility 6. Under this explicitly assumed expected-utility model, the lottery has expected utility 0.5(10) + 0.5(0) = 5. The decision maker prefers certainty, even though the lottery's expected points are 50.
This does not contradict monotonic preference: the lottery is not a certain outcome of 50 points. Separately, a score V(x) = min(x,40) would be weakly increasing but not strictly increasing above 40. It represents saturation rather than declining preference. These are hypothetical utility models, not measured human behavior.
Illustrative case study
In a fictional learning application, a team initially assumes that more practice reminders are always better. Interviews suggest that users value reminders up to a point but find frequent interruptions burdensome. The proposed monotonic constraint therefore describes the wrong attribute over the full range.
The team separates practice opportunities from notification frequency and asks users to compare otherwise matched options. It models notification preferences with an acceptable range rather than an unlimited increasing score. The case illustrates checking a directional assumption before encoding it; it does not claim that a particular interface or experiment produced measured learning gains.
Common misconceptions and mistakes
Do not confuse increasing utility with constant marginal utility. Diminishing additional benefit can coexist with a consistently increasing preference. Do not confuse a preference for more of a desirable attribute with willingness to accept any price, risk, or inconvenience to obtain it.
Another trap is using “monotonicity” without identifying its domain. Logical monotonicity concerns retaining conclusions when premises are added. A decision-theory lottery axiom concerns preferring a higher probability of the same better outcome over the same worse outcome. Those are related directional ideas, but they are not identical to monotonic preference over an attribute.
Business use
A clear monotonic assumption can simplify ranking and help reviewers detect surprising recommendations. If two offers are identical except that one has a longer delay, a model claiming that shorter delay is always preferable should not rank the slower offer higher. Such comparisons make useful requirement checks.
Before imposing the constraint, identify exceptions and boundaries. Faster delivery may involve inconvenient arrival times; greater storage may carry additional retention obligations. Those are changes in other relevant conditions, not necessarily violations of the original fixed-context preference. Document which factors the model actually holds constant and revisit the assumption when the product or user population changes.
People also ask
Does monotonic preference mean more is always better for everyone?
No. It is a modeling statement about a specified attribute, direction, range, and decision maker.
Can a monotonic preference flatten out?
Yes under weak monotonicity. Strict monotonicity excludes equal preference for distinct quantities along the stated comparison.
Does monotonicity determine risk attitude?
No. Different increasing utility functions can imply different choices among uncertain outcomes; their curvature matters under expected-utility assumptions.
Check your understanding
A user's preference score for reminder count peaks at three reminders and then falls. Is it increasing monotonic over counts zero through ten?
Answer: No. Increasing the count beyond the peak worsens the score. It may be increasing over a smaller range, so any monotonic claim must state the range it covers.
Related terms
- Utility function
- Preference elicitation
- Stochastic dominance
- Multiattribute utility theory
- Monotonicity
- weak preference
- strict preference
- diminishing marginal utility
- risk aversion
- monotonic constraint
Learn next
Compare U(x) = x and U(x) = square root of x on the same certain outcomes, then on the worked lottery. Both rank certain point amounts in increasing order, yet they need not rank lotteries identically. This explains why ordinal outcome rankings alone do not fully specify decisions under risk.
More in Graphs and symbolic AI
- Modularity-based communities - Modularity-based communities are groups of graph nodes identified by seeking a partition with a high modularity score.
- Modus ponens - Modus ponens is a rule of logical inference: from “if P, then Q” and “P,” infer “Q. It is a truth-preserving pattern of deduction in classical logic.
- Monoidal t-norm logic - Monoidal t-norm logic, usually abbreviated MTL, is a formal system of mathematical fuzzy logic associated with all left-continuous triangular norms and...
- Monte Carlo - Monte Carlo refers to a family of computational methods that use random sampling to estimate quantities or study the behavior of a model.
- Monte Carlo planning - Monte Carlo planning uses sampled possible futures to help choose actions.
- Monte Carlo tree search - Monte Carlo tree search, or MCTS, is a search method that grows a decision tree through repeated sampled simulations and uses their results to guide further...
Sources
Sources: Sean Holden, Cambridge Artificial Intelligence II, Simple Decision-Making notes, including monotonic preference and utility design: https://www.cl.cam.ac.uk/teaching/0910/ArtIntII/notes3-10-small.pdf . Russell and Norvig, decision-making slides, utility and lottery distinctions: https://aima.cs.berkeley.edu/slides-pdf/chapter16.pdf . Numerical examples and the learning-app case are original.
Previous: Monotone spline Next: Monotonic relationship