Mathematics for AI and Machine Learning

Foundations for modern AI and machine learning

SDE Continuous Optimization Limit

Chapter 19 Dynamics & diffusion

Chapter 19: Stochastic Differential Equations — SDEs as Limits of Optimization Algorithms

From the book

Chapter 19: Stochastic Differential Equations. In the chapter mind map this icon labels SDEs as Limits of Optim Algos. The discussion below is excerpted and lightly edited from § SDEs as Limits of Optimization Algorithms in Mathematics for AI and Machine Learning.

Itô calculus, SDEs, and continuous-time stochastic processes

What this drawing shows

What you see. Green discrete optimization steps fixed; purple continuous SDE path grows from the last iterate toward the continuous-time limit.

In the mind map. Chapter 19 — SDEs as Limits of Optim Algos. See From the book above for definitions, figures, and worked examples.

Where to read next

Open Chapter 19 companion →

Read the full definitions, figures, and worked examples in Chapter 19: Stochastic Differential Equations — see the mind-map node SDEs as Limits of Optim Algos.

PNG Icons

Textless (256×256 px)
PNG 256×256 px Copy PNG URL
Textless (64×64 px)
PNG 64×64 px Copy PNG URL
Textless (32×32 px)
PNG 32×32 px Copy PNG URL

Animated GIFs

Animated GIF (256×256 px)
GIF 256×256 px Copy GIF URL
Animated GIF (128×128 px)
GIF 128×128 px Copy GIF URL
Animated GIF (64×64 px)
GIF 64×64 px Copy GIF URL