AI Glossary / Statistics and probability / Advanced
Satterthwaite solution
Definition
The Satterthwaite solution is an approximation used to assign effective degrees of freedom when an estimated variance combines contributions with different uncertainties. In the supplied glossary's context, it refers to the Welch - Satterthwaite approach to comparing two population means without assuming equal population variances. It supports an approximate t reference distribution rather than treating the combined variance as if it came from one simple pooled estimate.
What it means
A difference between two sample means has uncertainty from both samples. If one sample is small and variable, its contribution may be much less precisely estimated than the other's. Simply adding the sample sizes and subtracting two does not capture this situation for the unequal-variance calculation.
Effective degrees of freedom describe the reference distribution used for inference. They can be fractional. A value such as 7.55 does not mean that the analyst observed seven and a half people or discarded part of a record.
How it works
For independent samples, define a = s1²/n1 and b = s2²/n2, where each s² is an ordinary sample variance and each n is the sample size. The estimated standard error of the mean difference is sqrt(a + b).
The Welch - Satterthwaite degrees of freedom are (a + b)² divided by [a²/(n1 - 1) + b²/(n2 - 1)]. Use this value with the corresponding t statistic, rather than attaching the pooled-variance degrees of freedom to an unequal-variance standard error.
More generally, the approximation combines independent variance contributions and their degrees of freedom. It is motivated by matching moments of an approximating scaled chi-squared distribution. It is not a universal correction for dependence, severe outliers or an unsuitable sampling design.
Three practical examples
1. Processing-time comparison: two independent groups of requests have different sample sizes and variability. An analyst compares their mean durations using separate variance estimates.
2. AI evaluation: two independently sampled task groups have different spreads in their measured scores. The analyst states the sampling unit and checks whether the independent-sample comparison is appropriate before calculating its reference distribution.
3. Measurement uncertainty: a combined estimate depends on several independently estimated uncertainty components. Their contributions and associated degrees of freedom help determine effective degrees of freedom for the combination.
Think of it this way
Think of combining two estimates of how uncertain a journey time is. One comes from a small collection of highly variable trips; the other comes from a more stable collection. The combined uncertainty should remember how uncertain its ingredients are, rather than counting trips alone.
Worked example
Consider fictional summaries from two independent samples of processing times, measured in minutes. Sample A has six observations, mean 25 and sample variance 24. Sample B has ten observations, mean 20 and sample variance 10. The variances use their usual n - 1 denominators.
For an approximate independent-sample comparison of means, the two contributions to the estimated variance of the difference are a = 24/6 = 4 and b = 10/10 = 1. Their sum is five, so the standard error is sqrt(5), approximately 2.236 minutes.
The observed mean difference is 25 - 20 = 5 minutes. Against a null difference of zero, the t statistic is 5/sqrt(5) = sqrt(5), approximately 2.236.
Now calculate the degrees of freedom. The numerator is (4 + 1)² = 25. The denominator is 4²/5 + 1²/9 = 16/5 + 1/9 = 149/45. Dividing gives 25/(149/45) = 1125/149, approximately 7.5503.
Thus, this calculation pairs a statistic of approximately 2.236 with approximately 7.5503 degrees of freedom. The number 6 + 10 - 2 = 14 belongs to the usual pooled-variance procedure; substituting it here would change the reference distribution without changing the uncertainty calculation that produced the statistic.
The example deliberately stops before declaring a decision. A complete report must specify the alternative, significance level and inferential assumptions. These stipulated summaries demonstrate the arithmetic; they do not establish normality, independence or practical importance.
As a units check, convert minutes to seconds. The mean difference becomes 300 seconds, and both sample variances multiply by 60² = 3,600. The standard error becomes 60 sqrt(5) seconds. Their ratio is still sqrt(5). Every term in the degrees-of-freedom ratio scales consistently, leaving 1125/149 unchanged.
Illustrative case study
Fictional Cedar Services reviews the worked comparison. Its reporting template originally inserts fourteen degrees of freedom because there are sixteen observations in total.
The analyst traces the calculation and finds that the standard error used separate sample variances. Cedar updates the report to show the matching effective degrees of freedom and records the five-minute mean difference alongside the uncertainty calculation.
The team also checks whether requests were independently sampled or repeatedly measured from the same customers. If dependence is present, merely changing fourteen to 7.5503 would not resolve the design issue. This invented case illustrates a consistency check, not an observed service improvement.
Common misconceptions and mistakes
"Degrees of freedom must be an integer." Effective degrees of freedom in this approximation need not be.
"Equal observed variances always give n1 + n2 - 2." Not with unequal sample sizes in this formula. Keeping sample sizes six and ten but setting both sample variances to ten gives 32/3, approximately 10.6667, rather than fourteen.
"The correction fixes paired data." Paired observations require their dependence to be represented appropriately.
"A precise calculation makes an approximation exact." Numerical precision does not remove distributional assumptions.
Business use
Keep sample sizes, means, variances, standard error and degrees of freedom together in the analysis record. This makes it possible to detect a report assembled from incompatible formulas.
For AI-generated statistical summaries, verify that the stated method matches the calculation. Ask whether observations represent independent customers, repeated sessions or another unit. An automated explanation should report the measured difference and its units without turning a test result into proof of a useful business effect.
People also ask
Is this the same as pooling variances?
No; the two-sample formula retains separate variance contributions.
Should 7.5503 be replaced by eight?
Preserve the fractional value when the statistical implementation supports it.
Does the method prove variances differ?
No. It avoids requiring them to be equal.
Check your understanding
Why is a equal to four?
Answer: It is 24 divided by six.
Why is the denominator 149/45?
Answer: It combines 16/5 and 1/9.
Why do seconds leave the statistic unchanged?
Answer: Both the difference and its standard error scale by sixty.
Related terms
- Welch's t-test
- Effective degrees of freedom
- Sample variance
- Standard error
- Pooled variance
- heteroskedasticity
- independent samples
Learn next
Recalculate with equal sample sizes and equal sample variances, then compare the effective degrees of freedom with the usual pooled value.
More in Statistics and probability
- Sampling risk - Sampling risk is the possibility that a conclusion based on a sample differs from the conclusion obtained by applying the same examination procedure to the...
- Sargan - Hansen test
- Satellite image time series - A satellite image time series is a sequence of satellite observations of an area, ordered by acquisition time and prepared so that measurements can be...
- Saturated array - A saturated array, in experimental design, is an orthogonal array whose factor main effects use all the available degrees of freedom after allowing for the...
- Saturated model - A saturated model has enough free parameters to reproduce all the independently variable features of the observed data being modeled.
- Scale analysis (statistics) - Scale analysis is the examination of questionnaire or test items to determine how they can support measurement of an underlying construct.
Sources
David C. Howell, Statistical Methods for Psychology glossary, Satterthwaite and Welch–Satterthwaite solution: https://www.uvm.edu/~statdhtx/methods8/Glossary/Glossary.html
NIST/SEMATECH, Two-Sample t-Test for Equal Means: https://www.itl.nist.gov/div898/handbook/eda/section3/eda353.htm
NIST Dataplot, Welch Satterthwaite effective degrees of freedom: https://www.itl.nist.gov/div898/software/dataplot/refman2/auxillar/welchsat.htm
Previous: Satisficing Next: Saturated array