Mathematics for AI and Machine Learning

Foundations for modern AI and machine learning

Tensor Train

Chapter 9 Linear algebra

Chapter 9: Matrix Decompositions and Beyond — Tensors

High-resolution PNG
Tensor Train — high-resolution mind-map icon

From the book

Chapter 9: Matrix Decompositions and Beyond. In the chapter mind map this icon labels Tensors: Tensor Train (TT) & CP Decomps. The discussion below is excerpted and lightly edited from § Tensor Train (TT) Decomposition in Mathematics for AI and Machine Learning.

For a $d$-dimensional tensor $\mathcal{A} \in \mathbb{R}^{n_1 \times n_2 \times \cdots \times n_d}$, the Tensor Train (TT) decomposition represents it as a chain of low-rank core tensors:

where $\mathcal{G}_k$ are core tensors with ranks $R_k \ll n_k$. The storage requirement is $O(dnR^2)$ instead of $O(n^d)$, providing exponential compression for high-dimensional tensors.

What this drawing shows

What you see. Represents a high-dimensional tensor compressed as a chain of low-rank tensor cores.

In the mind map. Chapter 9 — Tensors: Tensor Train (TT) & CP Decomps. See From the book above for definitions, figures, and worked examples.

Where to read next

Open Chapter 9 companion →

Read the full definitions, figures, and worked examples in Chapter 9: Matrix Decompositions and Beyond — see the mind-map node Tensors: Tensor Train (TT) & CP Decomps.