Convex Set
From the book
Chapter 12: Optimization Methods. In the chapter mind map this icon labels Convex Sets & Functions. The discussion below is excerpted and lightly edited from § Example: Strictly Convex Functions in Mathematics for AI and Machine Learning.
- $f(x)=\log(1+e^{-x})$ (logistic loss; binary classification)
- $f(x)=x^2$ (squared loss; regression, L2 regularization)
- $f(x)=-\log x$ for $x>0$ (negative log-likelihood, MLE)
The top row of the book figure plots these three functions: each is strictly convex on its domain (the Hessian test below confirms $\nabla^2 f \succeq 0$), and they appear throughout supervised learning (classification, regression) and maximum-likelihood estimation.
What this drawing shows
What you see. Shows a set where every segment between two points remains inside the set.
In the mind map. Chapter 12 — Convex Sets & Functions. See From the book above for definitions, figures, and worked examples.
Where to read next
Read the full definitions, figures, and worked examples in Chapter 12: Optimization Methods — see the mind-map node Convex Sets & Functions.