Find a course or note

Search notes

Search by topic, keyword or unit code, such as Flow Matching or U4.

    Esc to close · ⌘ / Ctrl K to search

    Mathematical Foundations

    A plain-language introduction to the mathematical tools that recur in machine learning, and to the mathematics the other courses on this site rely on.

    7 units 31 notes Read 0 / 31 Oct 2026
    1. M0 Calculus Toolkit 0 / 4 Gradient and direction, divergence and flux, Taylor expansion and "assume a straight line", differentiating under the integral and the total derivative along a path.
    2. M1 Probability and Conditional Expectation 0 / 5 Multivariate Gaussians, conditional expectation, the minimizer of MSE, Bayes and the posterior, and denoising as the posterior mean (Tweedie).
    3. M2 Deterministic Dynamics 0 / 5 Vector fields and ODEs, pushforward and flow maps, the continuity equation, Euler error and higher-order methods.
    4. M3 Stochastic Dynamics 0 / 5 From random walks to Brownian motion, SDEs as noisy ODEs, Fokker–Planck, Langevin and stationary distributions, weak vs. strong convergence.
    5. M4 Markov Chains 0 / 4 Markov chains and transition matrices, absorbing states, continuous-time Markov chains and rate matrices, time reversal and ratios.
    6. M5 Optimization, Convexity, and Distances 0 / 4 Jensen's inequality, KL divergence and cross-entropy, moving targets and EMA, differentiating through a generator (the KL gradient is a difference of scores).
    7. M6 Optimal Transport 0 / 4 The warehouse problem (Monge / Kantorovich), the W₂ distance, one-dimensional monotone matching, and large-scale approximations (Sinkhorn, minibatch).

    Lit notes are what this browser has read; the record stays on this device.