Mathematical Foundations
A plain-language introduction to the mathematical tools that recur in machine learning, and to the mathematics the other courses on this site rely on.
7 units 31 notes Read 0 / 31 Oct 2026
-
M0 Calculus Toolkit 0 / 4 Gradient and direction, divergence and flux, Taylor expansion and "assume a straight line", differentiating under the integral and the total derivative along a path.
-
M1 Probability and Conditional Expectation 0 / 5 Multivariate Gaussians, conditional expectation, the minimizer of MSE, Bayes and the posterior, and denoising as the posterior mean (Tweedie).
-
M2 Deterministic Dynamics 0 / 5 Vector fields and ODEs, pushforward and flow maps, the continuity equation, Euler error and higher-order methods.
- M2.0 Arrows on a River: Vector Fields and ODEs
- M2.1 From One Leaf to a Cloud: Flow Maps and Pushforwards
- M2.2 Change in the Crowd = Inflow − Outflow: The Continuity Equation
- M2.3 Navigation Updates Every 30 Seconds: Euler's Method and Its Error
- M2.4 One More Look Halfway Through: Higher-Order Methods
-
M3 Stochastic Dynamics 0 / 5 From random walks to Brownian motion, SDEs as noisy ODEs, Fokker–Planck, Langevin and stationary distributions, weak vs. strong convergence.
- M3.0 Where Is the Walker After an Hour? From Random Walks to Brownian Motion
- M3.1 Flow Plus Fluctuations: Stochastic Differential Equations
- M3.2 A Thousand Leaves in a Noisy River: The Fokker–Planck Equation
- M3.3 Random Walkers in a Valley: Langevin Dynamics and Stationarity
- M3.4 Matching Paths or Matching Statistics: Strong and Weak Convergence
-
M4 Markov Chains 0 / 4 Markov chains and transition matrices, absorbing states, continuous-time Markov chains and rate matrices, time reversal and ratios.
-
M5 Optimization, Convexity, and Distances 0 / 4 Jensen's inequality, KL divergence and cross-entropy, moving targets and EMA, differentiating through a generator (the KL gradient is a difference of scores).
-
M6 Optimal Transport 0 / 4 The warehouse problem (Monge / Kantorovich), the W₂ distance, one-dimensional monotone matching, and large-scale approximations (Sinkhorn, minibatch).
Lit notes are what this browser has read; the record stays on this device.