AI Glossary / Statistics and probability / Foundation
Simple regression
Definition
Simple regression is regression with a single explanatory variable. In the forecasting glossary used for this entry, it specifically means a straight-line relationship estimated by least squares between that variable and the quantity being forecast. It therefore overlaps with simple linear regression. The word simple identifies the number of explanatory variables, not the reliability of the forecast. Even a one-predictor model requires careful attention to timing, assumptions, uncertainty and the relevance of the data.
What it means
The model uses one variable to describe the average behavior of another. In forecasting, the explanatory variable might be planned activity, a known calendar quantity or a future input that must itself be predicted. A fitted relationship is useful only if the predictor value needed at forecast time is available or represented by a defensible scenario. A model can fit historical data closely while failing as a forecast because its input arrives too late, changes meaning or has its own uncertainty.
How it works
Define the forecast target, horizon and predictor as they would be known at the decision time. Fit an intercept and slope to relevant historical pairs, usually by minimizing squared residuals. Check whether a linear mean relationship is plausible and whether residuals show time dependence or changing variance. Evaluate forecasts on later observations or another appropriate holdout. For future prediction, supply a known predictor, a scenario or a separate predictor forecast, and distinguish conditional uncertainty from uncertainty about that future input.
Three practical examples
Example 1: A service operation predicts workload from the number of appointments already booked. Example 2: An AI computing team predicts processing demand from a planned document count. Example 3: A retailer explores a simple relationship between sales and a future temperature forecast. The first two may use partly known future inputs; the third must consider weather-forecast uncertainty. None of the relationships automatically means that changing the predictor would cause the fitted change in the response.
Think of it this way
Think of a small calculator with one input dial. Turning the dial changes the model's predicted average output according to a fitted line. The calculator still has two questions to answer: how reliable is the line, and how certain are you about the future dial setting? Treating a guessed setting as known can make the forecast look more precise than the information actually supports.
Worked example
Suppose a stipulated simple regression for daily workload is Y = 20 + 3X + error, where X is an activity count. At X = 10 the predicted mean is 50, while at X = 14 it is 62, a difference of 12. Assume the model parameters are known for this illustration and the error has mean zero and variance four. If tomorrow's X is known to be 12, the predicted mean is 56 and the conditional response variance is four. If instead X has mean 12 and variance one, and is independent of the error, the predicted mean remains 56 but the unconditional response variance becomes 3 squared times one plus four = 13. Its standard deviation is approximately 3.606 rather than two. Parameter-estimation uncertainty and model uncertainty would add further considerations in a real fitted forecasting application.
Illustrative case study
In this fictional case study, Oakbridge Scheduling builds a workload baseline before testing an AI forecast. The regression uses bookings known at a fixed morning cutoff. Analysts initially evaluate it with final end-of-day booking totals, then recognize that this gives it information unavailable when the forecast would be issued. They rebuild the evaluation using the actual cutoff data and compare forecasts chronologically. The resulting report explains both the model relationship and the uncertainty caused by late bookings.
Common misconceptions and mistakes
Common mistakes include calling every regression forecast causal, using future information during evaluation and ignoring uncertainty in a forecast predictor. Another error is assuming one explanatory variable means one source of variation. Residual autocorrelation can invalidate a naive independent-error analysis, while common trends can create misleading associations. A fitted coefficient is also tied to units and the observed operating range. Extending a line far beyond that range requires substantive justification, not merely a successful calculation.
Business use
Businesses use simple regression as an interpretable planning tool and a baseline for more complex AI systems. It can make assumptions visible and help teams understand whether additional complexity improves operational forecasts. Evaluation should use the information genuinely available at the forecast origin and a loss measure relevant to the decision. Where future predictors are uncertain, scenario forecasts or a joint uncertainty calculation may be more honest than a single narrow interval. Monitor whether the historical relationship remains useful after operational changes.
People also ask
Is simple regression different from simple linear regression here?
The source glossary uses simple regression for the one-predictor linear least-squares case, so the concepts overlap.
Can time itself be the predictor?
Yes; a linear trend model is one example, though extrapolating a trend requires caution.
Does a good fit guarantee a useful forecast?
No; future inputs, structural change and evaluation leakage can undermine it.
Must the predictor be known in advance?
It must be supplied somehow, with any uncertainty or scenario assumption made explicit.
Check your understanding
What is the predicted mean when X is 12 in the worked example?
Answer: Fifty-six.
Why does uncertainty in X increase response variance from four to 13?
Answer: Variation in X is multiplied by the squared slope and added under the stated independence assumption.
Does the example include uncertainty in estimated coefficients?
Answer: No; it stipulates known parameters to isolate predictor uncertainty.
Why is using final bookings for a morning forecast misleading?
Answer: Those values were unavailable at the decision time.
Related terms
- Related terms include simple linear regression
- explanatory variable
- forecast origin
- conditional forecast
- scenario forecast
- residual autocorrelation
- prediction interval and data leakage
Learn next
Learn next how to evaluate forecasts using chronological splits and rolling origins. Compare known future predictors with uncertain predictors, then study regression models with autocorrelated errors. Practice documenting the forecast equation, input availability and uncertainty separately so that a clear model is not mistaken for a certain prediction.
More in Statistics and probability
- Simple effect - A simple effect is the effect of one factor evaluated at a specified level of another factor.
- Simple interaction - A simple interaction is the interaction between two factors evaluated at one specified level of a third factor.
- Simple linear regression - Simple linear regression models the mean of one response variable as a straight-line function of one predictor.
- Simpson's paradox - Simpson's paradox is a statistical phenomenon in which an association observed within separate groups reverses when the groups are combined.
- Single-arm study design - A single-arm study design follows one group receiving an intervention without an internally assigned concurrent comparison arm.
- Single-subject design - A single-subject design, often called a single-case design, studies outcomes repeatedly within individual cases while systematically varying an intervention...
Work in finance? Get the free CFO AI Prompt Pack: 7 prompts for finance leaders.
Sources
Sources: Glossary of Forecasting Terms, Simple regression, https://robjhyndman.com/mwh3/FG4.pdf; Hyndman and Athanasopoulos, Forecasting: Principles and Practice, Forecasting with regression, https://otexts.com/fpp3/forecasting-regression.html. The workload equations, variance decomposition and fictional scheduling case are original examples with known-parameter and independence assumptions stated for clarity.
Previous: Simple reflex agent Next: Simplex algorithm