Domain 2: Mathematics, Statistics & Optimization
The maths behind ML, from reading notation to linear algebra, SVD and PCA, calculus and Jacobians, probability, optimization and information theory.
Unlock all 12 lessons with Unrolled Pro
Full production code, quantitative capacity math, failure recovery playbooks, and interview coaching.
Lessons
12 lessonsReading Maths Notation — Functions, Sets, Sums, Products and argmax
ML maths is mostly a handful of symbols used over and over: functions mapping one space to another, sets and membership, sums and products over indices, and argmax/argmin to pick the best option.
Linear Algebra — The Language of Embeddings and Attention
Every modern AI model is, underneath, a long chain of vector and matrix operations.
Linear Systems, Rank, Inverses and Eigenvectors
Three questions recur across ML: *can this system be solved, and is the answer unique?* (rank and inverses: least squares, redundant features), *what does this matrix do when applied again and again?
SVD and PCA — Every Matrix Is a Rotation, a Stretch and a Rotation
The singular value decomposition factors any matrix into rotations and a stretch, and sorts its "directions of action" by importance.
Calculus — How a Model Knows Which Way to Improve
Atlas's lesson-ranking formula has weights. Some rankings get good feedback, some bad. We need a precise answer to: *"if I nudge this weight up a little, does the error go up or down, and by how much?
Jacobians, Matrix Calculus and Taylor Series — Gradients of Whole Layers and Local Approximations
Backpropagation is the chain rule applied to functions whose inputs and outputs are vectors, so each step multiplies by a Jacobian matrix.
Probability & Statistics — Reasoning When You're Not Sure
An LLM never "knows" the next word — it outputs a probability distribution over every possible next token and samples from it.
Joint Distributions, the Gaussian, Sampling and the Central Limit Theorem
Real data has many variables at once, so we need joint distributions: how variables vary together (covariance, correlation), what one tells us about another (conditionals), and when they're unrelated (independence).
Optimization — Turning Gradients Into Learning
Gradients only say *which way* is downhill at this exact spot. How big a step to take, how to use the last few steps, and when to slow down decide whether training takes an hour, takes a week, or never works.
Convexity and Lagrange Multipliers — When Local Means Global, and Optimizing Under Constraints
Convexity is the property that makes optimization trustworthy: for a convex function every local minimum is the global minimum, so linear and logistic regression, SVMs and many classical models have guaranteed solutions.
Information Theory — Measuring Surprise, the Loss Every LLM Minimizes
"Cross-entropy loss", "perplexity", "KL penalty", "bits per byte" — these words appear in every LLM paper and training dashboard. They're all one idea: how surprised is a model by what actually happens?
Bridge: From Formulas We Tune to Models That Learn
Atlas can represent meaning as vectors and minimize a loss — but every formula so far was designed by us.