VFlash: Fast, Accurate Visual Planning via Flash Primitive Decoding
u_Unrolled
D18: Multimodal Foundation Models
Phase 8: Advanced AI Domains & Specialization/DOMAIN 18

Domain 18: Multimodal AI

AdvancedUnrolled Pro

Multimodal AI: computer vision and vision in production, audio and speech, video, spatial AI and robotics, vision-language models and image generation.

Estimated study time: about 90 hours
Access: Unrolled Pro
Unrolled Pro Domain

Unlock all 8 lessons with Unrolled Pro

Full production code, quantitative capacity math, failure recovery playbooks, and interview coaching.

Get Pro from ₹167/mo (~$2/mo)14-day refund guarantee

Lessons

8 lessons
01

Computer Vision — From Pixels and Filters to Detection and Segmentation

Pro 20m

Vision is the most mature non-text modality and the front end for documents, diagrams, screenshots, video and robotics.

✓ Runnable code✓ Exercise with solutionStart Lesson
02

Vision in Production — A Defect-Detection Project with YOLO, and Serving Models on the Edge

Pro 10m

Most real computer vision is narrow, specific and runs close to the camera: inspecting parts, counting items, spotting failures.

✓ Runnable code✓ Exercise with solutionStart Lesson
03

Audio & Speech — Spectrograms, ASR, TTS and Real-Time Voice

Pro 15m

Voice is the most natural interface and the hardest to get right in real time.

✓ Runnable code✓ Exercise with solutionStart Lesson
04

Video Intelligence — Sampling, Temporal Models and Video-Language Systems

Pro 15m

Video is images × time × audio, and that multiplication is what makes it hard.

✓ Runnable code✓ Exercise with solutionStart Lesson
05

Spatial AI & Robotics — 3D Perception, Control Loops and Vision-Language-Action Models

Pro 15m

An agent that acts in the physical world adds three things text agents never face. Geometry: decisions need 3D positions, not just labels, so cameras must be calibrated and pixels lifted into space.

✓ Runnable code✓ Exercise with solutionStart Lesson
06

Vision-Language Models — CLIP, Multimodal LLMs and Document Understanding

Pro 15m

Two ideas power almost every modern multimodal system.

✓ Runnable code✓ Exercise with solutionStart Lesson
07

Generative Image Models — Autoencoders, VAEs and Diffusion

Pro 15m

Generating an image means sampling from the distribution of plausible images, a distribution over millions of pixel values.

✓ Runnable code✓ Exercise with solutionStart Lesson
08

Bridge: From More Inputs to More Ways In

Pro 10m

Atlas now reads photos, screenshots and scanned exams, listens to voice notes, indexes lecture videos, drives a lab robot through a safety watchdog, and generates diagrams.

✓ Runnable codeStart Lesson
Domain 18: Multimodal Foundation Models · Unrolled