Mathematics for AI and Machine Learning

Foundations for modern AI and machine learning

Schur Complement

Chapter 10 Linear algebra

Chapter 10: Matrix Block Partitioning — Schur Complement

High-resolution PNG
Schur Complement — high-resolution mind-map icon

From the book

Chapter 10: Matrix Block Partitioning. In the chapter mind map this icon labels Schur Complement: $S = D - C A^{-1} B$ or $A - B D^{-1} C$. The discussion below is excerpted and lightly edited from § Theorem: Schur Complement in Mathematics for AI and Machine Learning.

where $A_{00} \in \mathbb{R}^{m \times m}$ is invertible. The Schur complement of $A_{00}$ in $A$ is defined as

the book figure demonstrates the Schur complement in the context of Gaussian process regression. The plot shows training observations (red points) and the posterior mean prediction (blue line) with a 95% confidence interval (shaded blue region). The key insight is that the posterior variance at any test point is exactly the Schur complement $k_{} - \mathbf{k}_^\top K^{-1} \mathbf{k}_$, where $k_{}$ is the prior variance, $K$ is the covariance matrix of training points, and $\mathbf{k}_*$ is the covariance between training and test points. The shaded region represents the reduction in uncertainty (information gain) compared to the prior: near training points, the variance is small (high confidence), while far from training data, the variance approaches the prior variance. This visualization connects the abstract linear algebra concept of the Schur complement to the intuitive notion of "uncertainty reduction" in probabilistic modeling, making clear why the Schur complement is fundamental in Gaussian processes, Bayesian inference, and conditional probability computations.

What this drawing shows

What you see. Highlights the reduced block that remains after eliminating part of a block matrix.

In the mind map. Chapter 10 — Schur Complement: or. See From the book above for definitions, figures, and worked examples.

Where to read next

Open Chapter 10 companion →

Read the full definitions, figures, and worked examples in Chapter 10: Matrix Block Partitioning — see the mind-map node Schur Complement: or.