AI Glossary / Statistics and probability / Intermediate

Partial correlation

Definition

Partial correlation measures the association between two variables after accounting for their relationships with one or more specified control variables. In the usual Pearson linear form, it is the correlation between the residuals obtained by regressing each variable separately on the controls. It describes adjusted linear association, not automatically a causal effect.

What it means

Two business measures may move together partly because both relate to another measure. Partial correlation asks how strongly they remain linearly associated after the selected adjustment.
The answer depends on which controls are included and how they are modeled. Controlling for a variable does not physically hold it fixed, remove every source of confounding, or make the remaining relationship causal. Poorly chosen controls can even create misleading associations.

How it works

Identify variables X and Y and choose controls Z based on the research question and knowledge of the data-generating process. Avoid including variables solely because software makes them available.
Fit a linear regression of X on the controls, usually including an intercept, and retain residuals. Separately regress Y on the same controls and retain its residuals. Pearson correlation between the two residual vectors is the sample partial correlation for that linear adjustment.
With one control and compatible correlations, the formula is r_XY.Z = (r_XY - r_XZ r_YZ)/sqrt[(1 - r_XZ squared)(1 - r_YZ squared)]. The denominator must be positive; perfect prediction by the control can make the quantity undefined.
For multiple controls, residualization or a suitable covariance-matrix calculation can be used. Strong collinearity and too many controls relative to observations can make estimates unstable. Use the same analysis sample for the component calculations.
Inference needs assumptions beyond computing the coefficient. Dependence, clustering, nonnormality, and missing-data handling can affect standard errors, intervals, and tests. A rank-based partial correlation is a different construction and still needs careful interpretation.
Partial and semipartial correlations differ. Partial correlation removes the controls' modeled contributions from both variables; semipartial correlation removes them from only one.
Under a joint Gaussian model, zero population partial correlation has a conditional-independence interpretation. Without such additional assumptions, zero adjusted linear correlation does not imply that the variables are unrelated in every way. Nonlinear relationships can remain after linear adjustment.

Three practical examples

  • Operations research: analysts examine the association between workload and delays after linearly accounting for a measured scale variable.
  • AI evaluation: researchers assess whether two performance metrics remain associated after adjusting for task length or difficulty measures.
  • Survey analysis: a team explores the relationship between two responses after specified demographic adjustments, while avoiding causal overinterpretation.

Think of it this way

Think of comparing two recordings after subtracting the background sound predicted from the same reference microphone. Their remaining similarity may be informative. It still depends on how well the background was modeled and whether the reference microphone captured the right thing.

Worked example

Suppose an original hypothetical correlation summary gives r_XY = 0.65, r_XZ = 0.80, and r_YZ = 0.50. Assume these describe the same sample or compatible population model and use linear Pearson adjustment.
The numerator is 0.65 - 0.80 times 0.50 = 0.25. The denominator is sqrt[(1 - 0.80 squared)(1 - 0.50 squared)] = sqrt(0.36 times 0.75) = sqrt(0.27), approximately 0.519615.
The partial correlation is 0.25/0.519615, approximately 0.48113. Thus the adjusted linear association is positive and smaller than the original 0.65 correlation in this example.
The three specified correlations form a valid positive-definite correlation matrix: its determinant is 0.2075, and the relevant principal minors are positive. This check avoids illustrating the formula with an impossible correlation combination.
No sample size was specified, so no p-value or confidence interval is inferred. Nor does the reduction from 0.65 to about 0.48 prove that Z causally explains a particular percentage of the relationship. It shows the result of the stated linear adjustment.

Illustrative case study

Illustrative fictional case: Brook Analytics studies whether use of an AI assistant relates to task completion quality. It considers controlling for task difficulty, but notices that one proposed difficulty score was recorded after assistance and may itself be affected by the assistant.
The team reviews the timing and causal role of each variable, reports descriptive associations, and distinguishes exploratory adjustment from a causal study. It does not simply add every available field to the control list. This fictional case illustrates the importance of choosing controls deliberately.

Common misconceptions and mistakes

Do not assume adjusted means unbiased. Unmeasured confounding, measurement error, nonlinear structure, and inappropriate controls can remain. Conditioning on a common effect of two variables can induce an association even when none exists before adjustment.
Do not equate partial correlation with a regression coefficient; the scales and interpretation differ. Avoid claiming zero partial correlation proves independence without stronger assumptions. Also avoid mixing correlations computed from different subsets of observations without a coherent missing-data method.

Business use

Partial correlation can help businesses explore whether associations persist after a transparent set of adjustments. Its value is descriptive clarity and model diagnosis. Reports should identify the controls, their timing, the functional adjustment, sample size, missing-data handling, and uncertainty, while separating association from claims about what an intervention would change.

People also ask

Does adding controls always reduce correlation?

No; the magnitude can increase or the sign can reverse.

Is partial correlation symmetric in X and Y?

Yes, when the same controls and method are used.

Is it a causal estimate?

Not by itself. Causal interpretation needs a justified design and assumptions about the controls and other variables.

Check your understanding

What is the adjusted correlation in the example?

Answer: Approximately 0.48113.

Why is no significance claim made?

Answer: The sample size and inferential assumptions have not been specified.

What does residualizing both variables distinguish?

Answer: Partial correlation from a semipartial correlation.

Related terms

  • Correlation
  • Residual
  • Multiple regression
  • Confounding
  • Conditional independence
  • Partial autocorrelation
  • semipartial correlation
  • collider bias

Learn next

Next study residualization and the difference between partial and semipartial correlation. Then use causal diagrams to reason about which variables should, and should not, be included in an adjustment set.

  • Correlation

More in Statistics and probability

  • Park test - The Park test is a regression-based diagnostic for heteroscedasticity, using an auxiliary relationship between the logarithm of squared residuals and the...
  • Partial Area Under the ROC Curve - Partial area under the ROC curve, or partial AUC, summarizes a classifier's ranking performance over a specified portion of the receiver operating...
  • Partial autocorrelation function - The partial autocorrelation function, or PACF, describes the linear association between a time series and its lagged values after accounting for the...
  • Partialing - Partialing, also spelled partialling, is statistically adjusting for one or more variables when examining relationships among other variables.
  • Partially open question - A partially open question is a survey question that combines structured response options with an opportunity to answer in the respondent's own words.
  • Pearson correlation coefficient - The Pearson correlation coefficient measures the direction and strength of linear association between two quantitative variables.

Work in finance? Get the free CFO AI Prompt Pack: 7 prompts for finance leaders.

Sources

Hyndman and colleagues, Glossary of Forecasting Terms, Partial correlation: https://robjhyndman.com/mwh3/FG4.pdf — author-hosted terminology source. Pingouin, partial_corr: https://pingouin-stats.org/generated/pingouin.partial_corr.html — official developer documentation for partial and semipartial correlations. Both primary sources were accessed. The correlation values, matrix-validity check, and fictional case are original.

Previous: Partial autocorrelation function Next: Partial Dependency

  • Home
  • Daily AI Updates
  • Blog
  • AIFBL Academy
  • AI Glossary
  • Products and Tools
  • Store
  • Free CFO AI Prompt Pack
  • About Shihan Sheriff
  • Privacy Policy
  • Terms of Use
  • Refund Policy
  • Cookie Policy
  • Earnings Disclaimer