AI Glossary / Retrieval and knowledge systems / Intermediate
Ordered weighted averaging
Definition
Ordered weighted averaging, usually abbreviated OWA, combines several numerical values by sorting them and applying weights to their ordered positions. The weights are nonnegative and sum to one. Unlike an ordinary criterion-weighted average, a basic OWA operator weights the largest, second-largest and subsequent values rather than named criteria.
What it means
OWA lets a designer specify how strongly an overall result should depend on high, middle or low inputs. For example, an aggregation rule can emphasize the strongest evidence, require broadly strong performance or simply take an arithmetic mean.
The distinction is where the weights attach. A conventional weighted score might always give reliability the greatest weight. An OWA rule might instead give the lowest score the greatest weight, regardless of whether that score describes reliability, speed or usability. These express different preferences and should not be substituted silently.
How it works
First put the inputs on a meaningful common scale and decide whether higher values represent better outcomes. Then choose a sorting convention. Using descending order, let b1 be the largest input, b2 the next largest and bn the smallest. Calculate the sum of wj times bj across all positions.
The weights must be associated with this declared ordering. Some references use ascending order, so copying their weights without reversing the relevant convention changes the rule. With descending order, weights [1,0,0] select the maximum, [0,0,1] select the minimum, and equal weights produce the arithmetic mean.
The basic operator treats permutations of the input values identically. If criterion identity matters, additional modeling is necessary. Missing values and changing numbers of inputs also require an explicit policy rather than an improvised redistribution of weights.
Three practical examples
1. A document-ranking experiment aggregates three comparable match scores with an OWA rule that rewards one strong match while still considering the other signals.
2. A supplier-screening exercise gives greater influence to the weakest normalized performance scores, encouraging balanced options after mandatory requirements are checked separately.
3. A group assessment combines comparable anonymous ratings while reducing the influence of extreme ordered positions, provided the selected weights and rationale are disclosed.
Think of it this way
Think of medals awarded by finishing position. The first-place reward follows whoever finishes first; it is not permanently attached to one runner. OWA weights behave similarly: they follow the ordering of the values, rather than the identities of the inputs that produced them.
Worked example
Suppose three normalized evidence scores are 0.2, 0.9 and 0.5. Sort them from largest to smallest to obtain 0.9, 0.5 and 0.2. Choose position weights 0.5, 0.3 and 0.2, which are nonnegative and sum to one.
The OWA result is 0.5 x 0.9 + 0.3 x 0.5 + 0.2 x 0.2 = 0.45 + 0.15 + 0.04 = 0.64. Permuting the original inputs to 0.5, 0.2 and 0.9 leaves this result unchanged because the sorted sequence is identical.
For comparison, applying those same weights directly to the original unsorted inputs gives 0.5 x 0.2 + 0.3 x 0.9 + 0.2 x 0.5 = 0.47. That is a different rule. The arithmetic mean is approximately 0.5333, while the minimum and maximum are 0.2 and 0.9. The example illustrates aggregation choices; none of these numbers is automatically a probability of relevance.
Illustrative case study
Fictional case study: Meridian Learning evaluates course recommendations using three comparable suitability scores. Its designers initially describe their rule as giving the most important criterion the largest weight, but their implementation sorts the scores first.
During review, they discover that the largest weight actually follows whichever score happens to be highest. They revise the specification: one experiment deliberately rewards strong performance on at least one dimension, while another uses fixed criterion weights because accessibility has a specific business meaning.
They compare both approaches on reviewed examples before choosing a rule. This fictional case illustrates why an accurately calculated number can still implement the wrong preference when the meaning of its weights is unclear.
Common misconceptions and mistakes
The main mistake is confusing ordered-position weights with criterion importance. Another is mixing ascending and descending conventions. A third is combining incomparable inputs, such as seconds and percentages, without a justified transformation.
OWA is not inherently optimistic or pessimistic; its weights determine that behavior relative to the score direction. A low input can be beneficial when it represents cost, so direction matters. Also, even a rule that emphasizes weak scores does not necessarily enforce a mandatory minimum. Hard requirements should be represented explicitly.
Business use
OWA can help businesses make aggregation preferences inspectable in ranking, evaluation and decision support. Its value lies in expressing how a collection of scores should contribute to an overall assessment, rather than concealing that preference inside an unexplained total.
Document the score scales, sorting direction, weights and treatment of missing inputs. Test examples with one excellent score, one poor score and balanced performance to see whether the resulting ordering matches the intended policy. Sensitivity analysis is useful because small changes in scores or weights can alter close rankings.
People also ask
Does OWA always equal a weighted arithmetic mean?
It is a weighted sum of sorted values. It generally differs from applying fixed criterion weights to the unsorted inputs.
Can the result exceed the largest input?
Not with the standard nonnegative weights summing to one. It lies between the smallest and largest inputs.
Are OWA weights learned automatically?
They can be chosen or estimated by different methods. The basic definition does not prescribe how they are obtained or validate their suitability.
Check your understanding
With descending inputs 0.8, 0.6 and 0.1, what does the OWA weight vector [0,0,1] return?
Answer: It returns 0.1, the smallest input. The final weight applies to the last ordered position, not to a permanently named criterion.
Related terms
- Order statistic
- Fuzzy logic
- aggregation operator
- weighted arithmetic mean
- multicriteria decision making
- minimum
- maximum and Choquet integral
Learn next
calculate several OWA results for the same score profiles and explain the preference encoded by each weight vector. Then compare those rankings with fixed criterion weighting, keeping the score normalization identical so the difference is interpretable.
More in Retrieval and knowledge systems
- Music alignment - Music alignment is the process of identifying corresponding musical positions across different representations or performances of a work.
- Next word index - A next word index, often written nextword index in information-retrieval research, organizes words by the words that immediately follow them in documents.
- NYSIIS phonetic code - The NYSIIS phonetic code is a letter-based encoding used to group names with similar spelling-to-sound patterns.
- Overlap coefficient - The overlap coefficient measures how much two nonempty sets share relative to the size of the smaller set.
- Parametric index - A parametric index is an information-retrieval index for structured document attributes, such as publication date, language, or document type.
- Permuterm index - A permuterm index is a vocabulary index that supports wildcard matching by storing cyclic rotations of each term with a special end marker.
Sources
Primary sources: Yager, On ordered weighted averaging aggregation operators in multicriteria decisionmaking, 1988: https://ieeexplore.ieee.org/document/87068
Marichal, Behavioral Analysis of Aggregation in Multicriteria Decision Aid, section 2.2: https://ikojadin.perso.univ-pau.fr/kappalab/pub/MarCOLL2000.pdf
Previous: Ordered key - value store Next: Ordering constraints