AI Glossary / Time series and signal processing / Intermediate
Time series model
Definition
A time series model is a mathematical representation of how observations indexed by time relate to past observations, disturbances, latent states or other relevant series. It specifies structure that can be estimated, checked and used for tasks such as forecasting or simulation. The model is an approximation to a process, not the process itself. Different models can explain similar historical patterns while producing different forecasts and uncertainty estimates.
What it means
The term refers to the representation rather than the entire forecasting workflow. An autoregressive model uses earlier values of the same quantity. A moving-average model in the statistical sense uses current and earlier innovations. State-space models describe evolving hidden states and how observations arise from them. Other models allow nonlinear relationships or additional predictors.
A fitted model combines a chosen structure with estimated parameter values and any required initial conditions. Choosing the structure, estimating its parameters and evaluating its predictions are separate steps. Merely attaching dates to an ordinary table does not establish that a model accounts appropriately for temporal dependence or the timing of information.
How it works
Specify which observations and explanatory inputs are available, how they are connected across time, and what assumptions govern unpredictable variation. Estimate parameters from an appropriate historical window. Inspect residual behavior and compare the resulting predictions on later periods that were not used to fit or choose the model.
For a simple autoregression, forecasts propagate the fitted relationship forward while replacing future zero-mean innovations with their conditional expectation. Uncertainty must still account for those future innovations, and often parameter or predictor uncertainty as well. Models for counts, changing variance or seasonal patterns require suitable additional structure. The choice should follow the observed process and intended use, rather than a desire to impose the same equation on every series.
Three practical examples
- Operations: represent weekly workload as partly related to the preceding week, then check whether unexplained residual patterns remain.
- Monitoring: model a sensor's underlying level and measurement noise separately so short-lived noise is not automatically interpreted as a persistent change.
- Demand analysis: combine calendar information with temporally correlated errors, while distinguishing a predictive relationship from an intervention effect.
Think of it this way
Think of a working diagram showing how a machine's current condition depends on earlier conditions and new disturbances. The diagram can help predict behavior without reproducing every microscopic detail. A time series model serves a similar purpose: its usefulness depends on which relationships it captures and whether omitted details matter for the question being asked.
Worked example
Consider an original stationary AR(1) illustration: y at time t equals 20 plus 0.6 times the previous y, plus an independent zero-mean innovation with variance 4. Treat these parameters as known. With the latest observation equal to 80, the next conditional mean is 20 + 0.6 times 80 = 68. The following mean is 20 + 0.6 times 68 = 60.8.
The long-run mean solves m = 20 + 0.6m, so m = 50. Forecast means move toward 50; the intercept 20 is not the process mean. The one-step forecast error variance is 4. At two steps, the error combines 0.6 times the first new innovation with the second, giving variance 4 times (1 + 0.6 squared) = 5.44 because the innovations are independent.
If the innovations are also Gaussian, a conditional 95% two-step interval with known parameters is approximately 60.8 plus or minus 1.96 times the square root of 5.44, or 56.23 to 65.37. Estimated parameters would introduce additional uncertainty. These calculations illustrate one specified model; they are not forecasts fitted to an actual business dataset or proof that AR(1) assumptions are appropriate elsewhere.
Illustrative case study
A fictional maintenance team models a weekly vibration summary with an autoregression. After a sensor replacement, its predictions become persistently inaccurate. Investigation finds that the new device reports a differently scaled measurement. The team resolves the measurement definition, preserves the change history and reevaluates the model using compatible observations. It does not assume that a more complex neural network will repair an undocumented unit change. The modeling exercise becomes useful only after the recorded quantity has a consistent meaning.
Common misconceptions and mistakes
A time series model is not synonymous with ARIMA, although ARIMA is an important family. Stationarity requirements belong to particular formulations; some models explicitly represent trends or changing levels. A statistical moving-average component is not simply a rolling average of observed values.
Residuals that look uncorrelated do not establish that every assumption is correct or that forecasts will remain accurate after a structural change. A predictive coefficient is not automatically causal. Models with similar point forecasts can differ substantially in distributional assumptions, making their uncertainty estimates and suitability for particular decisions different.
Business use
Document the model family, target definition, time index, estimated parameters, training period and update procedure. Explain which predictors are known at prediction time and how missing or revised observations are treated. Compare performance at the actual planning horizons, including a simple baseline and relevant error categories.
Assess whether the representation supports the intended task. A model adequate for a mean workload forecast may be inadequate for estimating extreme overload probabilities. Preserve diagnostics and forecast versions so a changed result can be traced to changed data, parameters or structure. Complexity is useful when it captures relevant behavior and survives evaluation, rather than merely increasing historical fit.
People also ask
Is a time series model the same as a forecast?
No. The model is a representation; a forecast is a prediction obtained using a model or another specified method.
Must the model use only the target's history?
No. It may incorporate related series or known explanatory information.
Does a fitted equation remain valid forever?
No. Measurement, behavior and operating conditions can change, so continued assessment is necessary.
Check your understanding
In the worked AR(1) example, why is the long-run mean 50 rather than 20?
Answer: The constant enters each step alongside 0.6 times the preceding level. At equilibrium the mean must satisfy m = 20 + 0.6m, whose solution is 50. Confusing the intercept with the mean misreads the model.
Related terms
- Residual
- Stationarity
- Diagnostic checking
- Autoregression
- ARIMA
- innovation
- state-space model
- parameter estimation
- dynamic regression
- forecast distribution
- structural change
Learn next
Write a one-lag model and identify its observed input, constant, coefficient and innovation. Calculate two forecasts and their error variances under explicit assumptions. Then study residual diagnostics and chronological validation before moving to seasonal, multivariate or nonlinear formulations.
More in Time series and signal processing
- Time series - A time series is a sequence of observations associated with times or time intervals.
- Time series analysis - Time series analysis is the study of observations indexed by time, with methods that account for their ordering, timing and dependence.
- Time Series Forecasting - Time series forecasting estimates future values of a quantity from information available at a specified time.
- Tracking signal - A tracking signal is a forecast-monitoring statistic highlighting persistent errors that may indicate bias or a changed forecasting environment.
- Transfer function - A transfer function describes how an input is transformed into an output by a specified linear system, including delayed effects.
- Trend analysis - Trend analysis examines how the underlying level or direction of a time series changes over a specified period.
Work in finance? Get the free CFO AI Prompt Pack: 7 prompts for finance leaders.
Sources
Hyndman, Glossary of Forecasting Terms, time series model entry: https://robjhyndman.com/mwh3/FG4.pdf Hyndman and Athanasopoulos, autoregressive models and stationarity: https://otexts.com/fpp3/arima.html Scope: general model concept with an original known-parameter AR(1) calculation; the example does not establish a fitted production model.
Previous: Time Series Forecasting Next: Time-series segmentation