Mathematics for AI and Machine Learning

Foundations for modern AI and machine learning

Vector Norms

Chapter 1 Geometry & transforms

Chapter 1: Vector Space and Inner Product — Norm($\ell_1$, $\ell_2$, $\ell_\infty$, Std-$\ell_2$, Mahalanobis)

High-resolution PNG
Vector Norms — high-resolution mind-map icon

From the book

Chapter 1: Vector Space and Inner Product. In the chapter mind map this icon labels Norm($\ell_1$, $\ell_2$, $\ell_\infty$, Std-$\ell_2$, Mahalanobis). The discussion below is excerpted and lightly edited from § Definition: Mahalanobis Norm (M-norm) in Mathematics for AI and Machine Learning.

For a vector $\mathbf{v} \in \mathbb{R}^d$ and a positive definite covariance matrix $\Sigma \in \mathbb{R}^{d \times d}$, the Mahalanobis norm (denoted as M-norm or Mahalanobis distance) is defined as

The M-norm accounts for correlations between dimensions through the covariance matrix $\Sigma$. When $\Sigma = I$ (identity matrix), it reduces to the standard Euclidean norm. The unit ball of the M-norm is a rotated and scaled ellipse (or ellipsoid) whose orientation and shape are determined by the eigenvectors and eigenvalues of $\Sigma$. In machine learning, the M-norm is used in anomaly detection, clustering (e.g., Gaussian mixture models), and when data has correlated features.

What this drawing shows

What you see. Compares different notions of vector length and their unit-ball geometry.

In the mind map. Chapter 1 — Norm(, , , Std-, Mahalanobis). See From the book above for definitions, figures, and worked examples.

Where to read next

Open Chapter 1 companion →

Read the full definitions, figures, and worked examples in Chapter 1: Vector Space and Inner Product — see the mind-map node Norm(, , , Std-, Mahalanobis).