VFlash: Fast, Accurate Visual Planning via Flash Primitive Decoding
u_Unrolled
D18: Multimodal Foundation Models · Computer Vision — From Pixels and Filters to Detection and Segmentation

Computer Vision — From Pixels and Filters to Detection and Segmentation

20 min read·Advanced· Unrolled Pro
Computer Vision — From Pixels and Filters to Detection and Segmentation

You already know: convolutions, CNNs and the idea of learned features (D4 Major architectures); training loops and transfer of representations (D4, D6); attention and transformers (D5); precision, recall and thresholds (D3 ML evaluation); the D17 bridge's cost of an image in tokens.

Why this matters for Atlas. Vision is the most mature non-text modality and the front end for documents, diagrams, screenshots, video and robotics. This lesson builds it from the ground up: images as arrays and convolution as a local pattern detector; why CNNs work and why vision transformers (ViTs), which treat an image as a sequence of patches, now dominate; transfer learning, the way almost every real vision system is built; and the two workhorse tasks beyond classification, object detection (boxes, IoU, non-maximum suppression, mAP) and segmentation (pixel masks). Vision-language models get their own lesson next.


1. Images are arrays; convolution finds local patterns

The question. How does a computer see an edge in a photo?

Start from nothing. A colour image is an array of shape height × width × 3 (red, green, blue), each value 0–255. A convolution slides a small kernel (say 3×3) over the image, computing a weighted sum at each position: a local pattern detector. A kernel with negative weights on the left and positive on the right responds strongly where brightness jumps from left to right: a vertical edge. Classical vision hand-designed such filters (Sobel edges, HOG gradient histograms); CNNs learn thousands of them, stacked so that early layers detect edges, middle layers textures and parts, and late layers objects.

That's the preview. The full lesson, with its code and exercises, is part of Unrolled Pro.
Staff AI & Pro Tier Lesson

Unlock "Computer Vision — From Pixels and Filters to Detection and Segmentation"

The foundations are free forever. Unrolled Pro unlocks the complete lesson, production architectures, and 55 battle-tested ML system design case studies.

Everything included with Pro:
All 234+ Deep-Dive Lessons across transformer internals, inference, RAG & agents
55 Staff-Level ML & System Design Case Studies with mathematical capacity estimates
AI Engineer Sheet & Exercises with worked solutions, self-checks, and code
100 Landmark Research Papers guided walkthroughs & progress tracking
14-Day Money-Back Guarantee — 100% full refund if you aren't satisfied
View Plans & Unlock All Lessons

From ₹167/mo (~$2/mo) · Cancel anytime · Instant activation

100% Risk-Free: 14-day no-questions-asked money-back guarantee