AI Glossary / Time series and signal processing / Intermediate

Impulse response weights

Definition

Impulse response weights describe how a dynamic model's output responds over successive time lags to a one-time unit input or shock. Each weight gives the response at a particular lag. In a linear time-invariant model, these weights also determine how an arbitrary input sequence contributes to output through convolution.

What it means

An input need not have its entire modeled effect immediately. A pulse can produce an initial response, a delayed peak, and a gradual decline. Impulse response weights summarize that timing as a sequence rather than a single coefficient.
The meaning of a unit depends on the input definition and scale. A one-unit change in advertising spend, a one-standard-deviation innovation, and a physical voltage impulse are different inputs. The weights are model-dependent and should not automatically be interpreted as causal effects of an intervention.

How it works

For a causal linear model, write the input contribution as yt = h0xt + h1x(t−1) + h2x(t−2) + further lagged terms. Setting one input value to one and all other input values to zero reveals the sequence h0, h1, h2, and so on, assuming zero initial deviation from the baseline.
For a general input, add the appropriately shifted and scaled response sequences. Recursive systems may have infinitely many nonzero weights even when their equations are short. Stability, initial conditions, units, and the definition of the shock matter. In multivariate models, how shocks are separated or identified can also change their interpretation.

Three practical examples

  • A process engineer describes how a one-time input adjustment propagates through a modeled production system over several minutes.
  • A forecasting analyst represents a predictor's delayed association with demand through distributed-lag coefficients.
  • A signal-processing team uses a filter's impulse response to understand its memory and how it spreads a short event across successive samples.

Think of it this way

Think of tapping a bell once and listening to the sound that follows. The response unfolds over time after the brief input. Tapping twice creates overlapping responses only to the extent that the system behaves linearly; if the bell or measurement system saturates, simply adding two single-tap responses may no longer describe it.

Worked example

Consider an original stipulated linear model with impulse response weights h0 = 2, h1 = 1, and h2 = 0.5, with all later weights zero. Start from zero input-related output deviation. A one-time input of 3 at time zero produces output contributions 6, 3, and 1.5 at times zero, one, and two.
Now add a second input of 2 at time one. Its contributions are 4 at time one, 2 at time two, and 1 at time three. Adding the overlapping responses gives the total sequence [6, 7, 3.5, 1]. Direct substitution into yt = 2xt + x(t−1) + 0.5x(t−2) gives the same values.
The total input is 3 + 2 = 5, and the sum of weights is 3.5. The summed output contribution is 6 + 7 + 3.5 + 1 = 17.5, matching 5 × 3.5. This cumulative identity includes the full response tail and relies on the stipulated linear finite-response model. The weights are not probabilities: their sum need not be one, and other valid models can have negative weights. No data were used here to establish a real input-output relationship.

Illustrative case study

Illustrative fictional case: Sequoia Packaging models how a temporary machine-setting adjustment is associated with output quality over the next few production intervals. The estimated response appears delayed, so engineers avoid evaluating the adjustment solely from the first interval.
Before treating the coefficients as an intervention guide, they examine whether settings were historically changed in response to unrecorded faults and conduct a controlled validation where appropriate. The fictional case illustrates the gap between a fitted dynamic association and a defensible causal interpretation.

Common misconceptions and mistakes

An impulse is a one-time input, while a step is a persistent change. For a linear time-invariant system, the step response accumulates impulse response weights; the two response plots are not interchangeable.
Do not assume weights are normalized, nonnegative, or permanent. A finite plotted horizon may omit a meaningful tail. Also distinguish response to an observed predictor from response to an identified model innovation. An estimated relationship can reflect feedback, confounding, or measurement error, so calling it an impulse response does not establish experimental causality.

Business use

Businesses use impulse response weights to understand timing, persistence, and overlap in dynamic systems. They can help align monitoring windows and evaluate how a forecast responds to changes in assumed future inputs.
Record input units, baseline conditions, shock size, model version, and the horizon displayed. Include uncertainty where weights are estimated rather than stipulated. Check whether linear superposition remains plausible across the operating range, and distinguish a model-based scenario from a guaranteed effect of changing policy or process settings.

People also ask

Can a weight be negative?

Yes. The model may predict an opposite-signed response at a particular lag.

Do weights have to decline smoothly?

No. They may rise, oscillate, or have delays, depending on the model.

Is the sum of weights always meaningful?

For suitable stable models it can summarize cumulative response or long-run gain, but convergence, units, and the input definition must be checked.

Check your understanding

Answer: Which weight describes the immediate response? h0, under the indexing used here.

Why is the time-one output 7 in the example?

Answer: It combines 3 from the first input's lag-one response and 4 from the second input's immediate response.

Would the same sum identity hold if the final output value were omitted?

Answer: Not for the complete response; the omitted tail would remove part of the cumulative contribution.

Does a weight of 2 mean a 200% probability?

Answer: No. It is an input-output response coefficient.

Related terms

  • Transfer function
  • Convolution
  • impulse response
  • distributed lag
  • dynamic regression
  • step response
  • linear time-invariant system
  • innovation
  • causal identification

Learn next

apply the example's weights to a persistent unit input and compare the resulting step response with the impulse response. Then examine how uncertainty and feedback affect the interpretation of weights estimated from observational data.

More in Time series and signal processing

  • Holdout set - A holdout set is a portion of data deliberately excluded from a specified stage of model development so that predictions can be evaluated on observations...
  • Holt-Winters forecasting - Holt-Winters forecasting is a family of exponential-smoothing methods that represents a time series through level, trend, and repeating seasonal components.
  • Homoscedasticity - Homoscedasticity means that an error or outcome distribution has the same variance across the conditions being considered.
  • Kalman filter - A Kalman filter is a recursive method for estimating a hidden state in a linear dynamic system from noisy observations.
  • Lagrange dual function - The Lagrange dual function is obtained by taking the infimum of a problem's Lagrangian over its original decision variables, while holding the multipliers...
  • Lagrangian - A Lagrangian is a function that combines an optimization objective with weighted constraint expressions. The weights are called Lagrange multipliers.

Sources

Sources: Glossary of Forecasting Terms, Impulse response weights: https://robjhyndman.com/mwh3/FG4.pdf . SciPy, official discrete impulse-response documentation: https://docs.scipy.org/doc/scipy/reference/generated/scipy.signal.dimpulse.html . SciPy Signal Processing tutorial: https://docs.scipy.org/doc/scipy/tutorial/signal.html . Primary sources consulted. The exact convolution and cumulative checks are original, as is the explicitly fictional case.

Previous: Impulse (delta) Next: Imputation variance

  • Home
  • Daily AI Updates
  • Blog
  • AIFBL Academy
  • AI Glossary
  • Products and Tools
  • Store
  • Free CFO AI Prompt Pack
  • About Shihan Sheriff
  • Privacy Policy
  • Terms of Use
  • Refund Policy
  • Cookie Policy
  • Earnings Disclaimer