AI Glossary / Statistics and probability / Intermediate
Trimmed statistics
Definition
Trimmed statistics are numerical summaries calculated after excluding a specified portion of extreme observations. The best-known example is the trimmed mean, which averages the retained central values. Trimming can reduce sensitivity to unusually large or small observations, but the resulting statistic must be interpreted according to the trimming rule and the quantity it is intended to describe.
What it means
An ordinary mean gives every observation equal weight, including the largest and smallest. A trimmed mean gives zero weight to selected tail observations and equal weight to the retained ones.
That can be useful for describing central behavior when extremes dominate the arithmetic average. It does not make the result a universally superior estimate. For a skewed population, a population trimmed mean generally differs from the ordinary population mean, so the analysis may answer a different question.
How it works
Specify the statistic and the trimming convention. For a symmetric trimmed mean with n ordered observations and k removed from each tail, add observations k+1 through n-k and divide by n-2k.
State the fraction per tail and the count rule. Software can use floor counts or other conventions when the fraction does not produce an integer. Two implementations can therefore give different results from the same nominal trim percentage in a small sample.
Connect the sample statistic to its target. A population trimmed mean can be described as the average of the central quantile region, with appropriate normalization. It is not generally an estimate of total burden divided by the original number of cases.
Keep descriptive calculations separate from inference. The standard deviation of retained values describes their spread; it is not automatically the correct ingredient for a standard error of the trimmed mean. Tail selection is part of the estimator's sampling behavior.
Use a method designed for the inferential question. For example, Yuen-type procedures compare trimmed means and use winsorized variance information with suitable adjustments. They are not simply ordinary t-tests run after deleting whichever observations look inconvenient.
If using resampling, reproduce the full estimator within each resample, including sorting and trimming. Resampling only a previously retained subset can ignore variability associated with which observations fall in the tails. The resampling design must also respect clustering or time dependence.
Examine robustness and efficiency together. Trimming can limit the influence of extreme magnitudes but discards some information. The preferred balance depends on the distribution, sample size, and task rather than a universally optimal trimming percentage.
Document sensitivity transparently. Compare the ordinary mean, a prespecified trimmed summary, and relevant tail measures. A difference between them can be informative about the data; it should prompt interpretation, not automatic selection of whichever statistic favors the desired conclusion.
Three practical examples
- A model-evaluation report presents a trimmed mean absolute error together with the overall mean and large-error frequency.
- A service dashboard summarizes central completion time while separately tracking unusually long waits.
- An experiment compares prespecified trimmed response measures using an uncertainty method appropriate to trimmed means.
Think of it this way
Think of evaluating everyday traffic speed while deliberately setting aside a fixed share of the fastest and slowest observations. That summary may describe ordinary travel well, but it cannot replace a report about severe congestion or the total time travelers lost.
Worked example
Consider two original ordered samples of ten values each. Sample A is 1, 2, 3, 4, 5, 6, 7, 8, 9, 100. Sample B is 2, 3, 4, 5, 6, 7, 8, 9, 10, 20.
The ordinary mean of A is 145/10 = 14.5, while B's is 74/10 = 7.4. Their ordinary mean difference, A minus B, is 7.1.
Now trim one observation from each tail, equivalent to 10% per tail here. A retains 2 through 9, with sum 44 and trimmed mean 5.5. B retains 3 through 10, with sum 52 and trimmed mean 6.5. The trimmed mean difference is -1.0.
The ranking reverses because the ordinary and trimmed summaries emphasize different parts of these samples. This is not evidence that one calculation is wrong. If the values are costs and the question concerns total spending per case, the ordinary mean answers that question. If the prespecified question concerns central performance after symmetric trimming, the trimmed means answer that different question. No significance claim follows from these descriptive calculations.
Illustrative case study
Fictional case: Riverbend Analytics compares two forecasting systems. One system has slightly better central errors but occasionally makes very large mistakes. Its trimmed mean looks favorable, while its overall mean error looks worse.
The evaluation team reports both summaries and the frequency of severe errors. It chooses a deployment criterion tied to the consequences of those errors rather than treating the trimmed statistic as permission to ignore expensive failures.
Common misconceptions and mistakes
Do not assume that a trimmed mean estimates the same quantity as an ordinary mean in every population. Do not call its standard error the retained sample standard deviation divided by the square root of the retained count without a justified method. Trimming is different from winsorization, although winsorized quantities can appear in trimmed-mean inference. A robust statistic is not immune to poor sampling or systematic bias.
Business use
Trimmed statistics can make routine performance summaries less sensitive to rare extreme values. They work best when organizations explain the estimand and maintain separate visibility of the tails. Use the same prespecified rules across comparable groups, retain original records, and investigate whether excluded extremes represent important customers, operating conditions, or failure modes.
People also ask
Are all trimmed statistics means?
No; other summaries can be computed after trimming, but their interpretation must be specified.
Does trimming require normally distributed data?
No, although an inferential method has its own assumptions.
Can trimming reverse a comparison?
Yes, as the example shows.
Check your understanding
What is the trimmed mean difference in the example?
Answer: A minus B is -1.0.
Why does the ordinary mean difference have the opposite sign?
Answer: A's large upper-tail value has much more influence on the ordinary mean.
Which statistic measures original average cost per case?
Answer: The untrimmed arithmetic mean.
Related terms
- Trimmed samples
- Influence
- trimmed mean
- winsorized variance
- Yuen's test
- robust estimation
- tail risk
Learn next
Write the target quantity before choosing a summary. Then compare sample means and trimmed means on symmetric and skewed data, using an appropriate method for any confidence interval.
More in Statistics and probability
- Translational invariance - Translational invariance is the property that a model's relevant output remains unchanged when its input is shifted in position.
- Treatment and control groups - Treatment and control groups are comparison groups used to assess an intervention.
- Trend-stationary process - A trend-stationary process is a time series that becomes stationary after removing a deterministic trend.
- Truncated normal distribution - A truncated normal distribution is the distribution of a normally distributed variable conditional on its value lying within specified bounds.
- Tukey - Duckworth test - The Tukey-Duckworth test is a simple two-sample test that uses counts of nonoverlapping observations at opposite ends of the combined data.
- Tukey's B method - Tukey's B method is a multiple-comparison procedure for comparing group means that combines features of Tukey's honestly significant difference procedure...
Sources
University of Vermont, Statistical Methods for Psychology glossary, Trimmed statistics: https://www.uvm.edu/~statdhtx/methods8/Glossary/Glossary.html SciPy, trim_mean: https://docs.scipy.org/doc/scipy/reference/generated/scipy.stats.trim_mean.html SciPy, ttest_ind, trimmed Yuen test and notes: https://docs.scipy.org/doc/scipy/reference/generated/scipy.stats.ttest_ind.html
Previous: Trimmed samples Next: Triphone