AI Glossary / Statistics and probability / Foundation

Simple regression

Definition

Simple regression is regression with a single explanatory variable. In the forecasting glossary used for this entry, it specifically means a straight-line relationship estimated by least squares between that variable and the quantity being forecast. It therefore overlaps with simple linear regression. The word simple identifies the number of explanatory variables, not the reliability of the forecast. Even a one-predictor model requires careful attention to timing, assumptions, uncertainty and the relevance of the data.

What it means

The model uses one variable to describe the average behavior of another. In forecasting, the explanatory variable might be planned activity, a known calendar quantity or a future input that must itself be predicted. A fitted relationship is useful only if the predictor value needed at forecast time is available or represented by a defensible scenario. A model can fit historical data closely while failing as a forecast because its input arrives too late, changes meaning or has its own uncertainty.

How it works

Define the forecast target, horizon and predictor as they would be known at the decision time. Fit an intercept and slope to relevant historical pairs, usually by minimizing squared residuals. Check whether a linear mean relationship is plausible and whether residuals show time dependence or changing variance. Evaluate forecasts on later observations or another appropriate holdout. For future prediction, supply a known predictor, a scenario or a separate predictor forecast, and distinguish conditional uncertainty from uncertainty about that future input.

Three practical examples

Example 1: A service operation predicts workload from the number of appointments already booked. Example 2: An AI computing team predicts processing demand from a planned document count. Example 3: A retailer explores a simple relationship between sales and a future temperature forecast. The first two may use partly known future inputs; the third must consider weather-forecast uncertainty. None of the relationships automatically means that changing the predictor would cause the fitted change in the response.

Think of it this way

Think of a small calculator with one input dial. Turning the dial changes the model's predicted average output according to a fitted line. The calculator still has two questions to answer: how reliable is the line, and how certain are you about the future dial setting? Treating a guessed setting as known can make the forecast look more precise than the information actually supports.

Worked example

Suppose a stipulated simple regression for daily workload is Y = 20 + 3X + error, where X is an activity count. At X = 10 the predicted mean is 50, while at X = 14 it is 62, a difference of 12. Assume the model parameters are known for this illustration and the error has mean zero and variance four. If tomorrow's X is known to be 12, the predicted mean is 56 and the conditional response variance is four. If instead X has mean 12 and variance one, and is independent of the error, the predicted mean remains 56 but the unconditional response variance becomes 3 squared times one plus four = 13. Its standard deviation is approximately 3.606 rather than two. Parameter-estimation uncertainty and model uncertainty would add further considerations in a real fitted forecasting application.

Illustrative case study

In this fictional case study, Oakbridge Scheduling builds a workload baseline before testing an AI forecast. The regression uses bookings known at a fixed morning cutoff. Analysts initially evaluate it with final end-of-day booking totals, then recognize that this gives it information unavailable when the forecast would be issued. They rebuild the evaluation using the actual cutoff data and compare forecasts chronologically. The resulting report explains both the model relationship and the uncertainty caused by late bookings.

Common misconceptions and mistakes

Common mistakes include calling every regression forecast causal, using future information during evaluation and ignoring uncertainty in a forecast predictor. Another error is assuming one explanatory variable means one source of variation. Residual autocorrelation can invalidate a naive independent-error analysis, while common trends can create misleading associations. A fitted coefficient is also tied to units and the observed operating range. Extending a line far beyond that range requires substantive justification, not merely a successful calculation.

Business use

Businesses use simple regression as an interpretable planning tool and a baseline for more complex AI systems. It can make assumptions visible and help teams understand whether additional complexity improves operational forecasts. Evaluation should use the information genuinely available at the forecast origin and a loss measure relevant to the decision. Where future predictors are uncertain, scenario forecasts or a joint uncertainty calculation may be more honest than a single narrow interval. Monitor whether the historical relationship remains useful after operational changes.

People also ask

Is simple regression different from simple linear regression here?

The source glossary uses simple regression for the one-predictor linear least-squares case, so the concepts overlap.

Can time itself be the predictor?

Yes; a linear trend model is one example, though extrapolating a trend requires caution.

Does a good fit guarantee a useful forecast?

No; future inputs, structural change and evaluation leakage can undermine it.

Must the predictor be known in advance?

It must be supplied somehow, with any uncertainty or scenario assumption made explicit.

Check your understanding

What is the predicted mean when X is 12 in the worked example?

Answer: Fifty-six.

Why does uncertainty in X increase response variance from four to 13?

Answer: Variation in X is multiplied by the squared slope and added under the stated independence assumption.

Does the example include uncertainty in estimated coefficients?

Answer: No; it stipulates known parameters to isolate predictor uncertainty.

Why is using final bookings for a morning forecast misleading?

Answer: Those values were unavailable at the decision time.

Related terms

  • Related terms include simple linear regression
  • explanatory variable
  • forecast origin
  • conditional forecast
  • scenario forecast
  • residual autocorrelation
  • prediction interval and data leakage

Learn next

Learn next how to evaluate forecasts using chronological splits and rolling origins. Compare known future predictors with uncertain predictors, then study regression models with autocorrelated errors. Practice documenting the forecast equation, input availability and uncertainty separately so that a clear model is not mistaken for a certain prediction.

  • Autocorrelated errors

More in Statistics and probability

  • Simple effect - A simple effect is the effect of one factor evaluated at a specified level of another factor.
  • Simple interaction - A simple interaction is the interaction between two factors evaluated at one specified level of a third factor.
  • Simple linear regression - Simple linear regression models the mean of one response variable as a straight-line function of one predictor.
  • Simpson's paradox - Simpson's paradox is a statistical phenomenon in which an association observed within separate groups reverses when the groups are combined.
  • Single-arm study design - A single-arm study design follows one group receiving an intervention without an internally assigned concurrent comparison arm.
  • Single-subject design - A single-subject design, often called a single-case design, studies outcomes repeatedly within individual cases while systematically varying an intervention...

Work in finance? Get the free CFO AI Prompt Pack: 7 prompts for finance leaders.

Sources

Sources: Glossary of Forecasting Terms, Simple regression, https://robjhyndman.com/mwh3/FG4.pdf; Hyndman and Athanasopoulos, Forecasting: Principles and Practice, Forecasting with regression, https://otexts.com/fpp3/forecasting-regression.html. The workload equations, variance decomposition and fictional scheduling case are original examples with known-parameter and independence assumptions stated for clarity.

Previous: Simple reflex agent Next: Simplex algorithm

  • Home
  • Daily AI Updates
  • Blog
  • AIFBL Academy
  • AI Glossary
  • Products and Tools
  • Store
  • Free CFO AI Prompt Pack
  • About Shihan Sheriff
  • Privacy Policy
  • Terms of Use
  • Refund Policy
  • Cookie Policy
  • Earnings Disclaimer