A tangent line matches a curve's value and slope at one point — and nowhere else. How much of the actual curve can you recover just by adding more information at that same single point?
The dashed curve is . The solid line is its tangent at — drag the slider and watch the line pivot, matching the curve closely right at but drifting away fast on either side.
A Taylor series keeps adding derivative terms at to build a better local approximation:
- — the point the approximation is built around (the point of expansion).
- — the function's actual value at ; the zeroth-order term.
- — the first-order (linear) term: the tangent line's contribution.
- — the second-order (quadratic) term: adds curvature.
- Truncating after one term is the tangent line
Stopping after the linear term recovers exactly the tangent-line approximation from Chapter 1 — same formula, new name.
- Adding the quadratic term adds curvature
The quadratic term is the first one that can bend — it uses to curve the approximation the same way the true function curves near .
- Every term after that keeps closing the gap
Each additional term corrects more of what the previous ones missed; for a well-behaved function, the approximation converges to itself as more terms are added.
- It only works locally
All of this accuracy is local — no matter how many terms you add, expect the approximation to get worse the farther strays from .
Move and the evaluation point independently. Near , both approximations track the curve almost perfectly; the quadratic one keeps tracking noticeably farther out, because it bends with the curve instead of running straight through it.
Expand around and evaluate at :
- Compute the ingredients at x0=1
- Build the linear approximation
- Build the quadratic approximation
- Compare against the true value
.
- The linear approximation misses by .
- The quadratic one misses by only .
Seven times closer, from one extra term.
Expanding f(x) = x³ around x₀ = 2, compute the quadratic Taylor approximation's value at x = 2.5.
Every "linear approximation" and "quadratic approximation" you'll meet later — a linearized loss landscape, a locally-quadratic optimizer step — is exactly this truncated Taylor series, keeping just enough terms to be cheap while still capturing the curvature that matters nearby. The next chapter picks the second-order term back up and asks what curvature means for an entire multivariable landscape at once.