AI Glossary / Time series and signal processing / Intermediate
Non-linear forecasting
Definition
Non-linear forecasting uses a model in which the predicted quantity has a nonlinear relationship with relevant inputs, such as past observations, past errors, or external predictors. Examples include threshold models, nonlinear autoregressions, and neural networks. The term describes the forecasting relationship, not merely whether the historical data trace looks curved or the fitting algorithm is complicated.
What it means
A linear model uses fixed additive contributions from its specified inputs. A nonlinear model can represent relationships whose slopes change, interactions that depend on other variables, saturation, or different operating regimes.
This flexibility can be useful when the process behaves differently across conditions. It also creates risks: more flexible models can fit accidental historical patterns, require more information, and behave unpredictably outside the range of observed situations.
How it works
Specify what future quantity is predicted and which inputs are available at issuance. Choose a nonlinear structure suited to the plausible behavior, then estimate it using training data. Examples include a piecewise rule with thresholds, a smooth nonlinear function, or a neural network using lagged values.
Evaluate forecasts on later periods at the actual decision horizon. Multi-step prediction needs particular care: applying a nonlinear function to a forecast mean generally differs from averaging the function over possible future inputs. Simulation or other distributional calculations may therefore be needed. Distinguish nonlinearity in predictors from nonlinearity in parameters; a polynomial can be nonlinear in an input while remaining linear in its coefficients.
Three practical examples
- An energy model allows demand to rise at both low and high temperatures, rather than assuming one constant temperature slope across the whole range.
- A service model uses different dynamics below and above a congestion threshold.
- A forecasting team trains a neural network on lagged observations and known calendar variables, comparing its later-period performance with simpler benchmarks.
Think of it this way
Think of a water tap whose effect changes as it approaches its limit. A small turn may make a large difference in one region and little difference in another. A nonlinear relationship allows that changing response, but the model still needs evidence about the regions where it will be used.
Worked example
Consider an original stipulated forecasting rule for a positive workload index x. For x at or below 100, let the conditional next-period mean be f(x) = 0.9x + 5. Above 100, let it be f(x) = 0.5x + 45. Both branches equal 95 at the threshold, so the rule is continuous, but its slope changes.
Suppose the available information implies that next period's index will be 80 or 120 with equal probability. Its mean is 100. The following period's conditional means are f(80) = 77 and f(120) = 105. Averaging across the two possible intermediate states gives a two-step mean of 0.5 × 77 + 0.5 × 105 = 91, assuming the stated conditional-mean relationship applies.
Simply inserting the intermediate mean into the rule gives f(100) = 95. That shortcut differs by four units from the distribution-aware mean. The calculation demonstrates why recursive substitution of point forecasts can fail to produce the true multi-step mean in a nonlinear model.
The threshold, coefficients, and two possible states are stipulated for illustration. They are not fitted evidence, a causal policy response, or a complete predictive distribution for the second future period. Additional conditional noise would matter for interval calculations even if its conditional mean were zero.
Illustrative case study
Illustrative fictional case: Maple Capacity observes that response times rise sharply when workload approaches a processing limit. The team compares a threshold-based forecast with a straight-line baseline, using only information available before each target period.
It evaluates both ordinary workloads and congestion episodes, then checks how forecast uncertainty affects staffing choices. Managers avoid extrapolating the fitted threshold relationship far beyond observed conditions without further evidence. The fictional case illustrates a reason to test nonlinear structure, not an automatic argument for the most complicated model.
Common misconceptions and mistakes
A nonlinear-looking time plot does not prove that a nonlinear forecasting model is necessary. Linear stochastic models can produce complex sample paths, and linear regression with suitable features can represent some curved input relationships.
Do not equate nonlinear forecasting with neural networks or chaos. Many nonlinear methods are small and interpretable, and many nonlinear systems are not chaotic. A better training fit is not sufficient evidence of useful prediction. Also avoid treating a forecast made with subsequently observed external inputs as though those inputs had been known when the forecast was issued.
Business use
Nonlinear forecasting can help when thresholds, interactions, or saturation materially affect decisions. Its benefit should be demonstrated at relevant horizons and operating conditions, including rare but important regimes.
Document inputs, transformations, model complexity, parameter selection, and uncertainty procedures. Compare against simple credible baselines and inspect sensitivity outside the training range. Where a model is used for scenario analysis, distinguish a predictive relationship from an identified causal effect of changing an input.
People also ask
Must a nonlinear forecast use a nonlinear optimization algorithm?
Not necessarily. Some models are nonlinear in inputs but linear in coefficients.
Does more flexibility guarantee better forecasts?
No. It can increase estimation error and overfitting.
Can nonlinear forecasts have prediction intervals?
Yes, but the calculation must reflect the model and its uncertainty; intervals may be asymmetric and require simulation or other specialized methods.
Check your understanding
What makes the worked rule nonlinear across its full range?
Answer: Its slope changes at the threshold, so one global affine formula does not describe it.
Why is the two-step mean 91 rather than 95?
Answer: The nonlinear rule is averaged over possible intermediate states rather than applied only to their mean.
Would this example establish a good model for real workload?
Answer: No. Its structure and probabilities were deliberately stipulated.
Related terms
- Saturation (point operation)
- Prediction interval
- nonlinear autoregression
- threshold model
- neural network forecasting
- interaction
- saturation
- regime switching
- recursive forecasting
- simulation
Learn next
compare a linear model with a simple threshold alternative using rolling-origin evaluation. Then examine the difference between recursive point substitution and simulated forecast distributions, keeping future-input uncertainty explicit.
More in Time series and signal processing
- Metalevel state space - A metalevel state space is a representation of the possible internal computational states of an agent or program.
- Multicollinearity - Multicollinearity is a strong linear relationship among two or more predictor variables in a model.
- Noise-to-signal ratio - Noise-to-signal ratio compares the magnitude of unwanted variation with the magnitude of a signal.
- Nonstationarity - Nonstationarity occurs when the statistical behavior of a process changes with time or another relevant index.
- Object-level state space - An object-level state space is the collection of possible states of the task an intelligent system is trying to solve.
- Order selection criteria - Order selection criteria are rules for choosing a model's structural complexity, such as how many autoregressive or moving-average terms a time-series model...
Work in finance? Get the free CFO AI Prompt Pack: 7 prompts for finance leaders.
Sources
Sources: Glossary of Forecasting Terms, Non-linear forecasting: https://robjhyndman.com/mwh3/FG4.pdf . Hyndman and Athanasopoulos, Forecasting: Principles and Practice, advanced methods and neural-network forecasting: https://otexts.com/fpp3/advanced.html . Primary glossary and textbook consulted. The threshold calculation and fictional case are original and independently checked.
Previous: Non-linear estimation Next: Non-local means (NLM)