VFlash: Fast, Accurate Visual Planning via Flash Primitive Decoding
u_Unrolled
D22: AI System Design Bank · Case Study: Visual Search — Routing, Embeddings Across the Photo Gap, Compressed Indexes and Privacy Rules at Staff Level
Phase 9/Domain 22/Lesson 24

Case Study: Visual Search — Routing, Embeddings Across the Photo Gap, Compressed Indexes and Privacy Rules at Staff Level

20 min read·Staff+ Tier· Unrolled Pro
Case Study: Visual Search — Routing, Embeddings Across the Photo Gap, Compressed Indexes and Privacy Rules at Staff Level

You already know: convolutional and transformer image encoders (D5), contrastive learning (D4), approximate nearest-neighbour search and quantisation (D4 and D7), and from the autocomplete case that some rules must hold outside every model. This case adds search where the query is a photo: the photo is messy while the index is clean, the index holds billions of vectors, mobile uploads dominate latency, the photo might show text, a barcode or a landmark rather than a product, and it might contain people. The design questions: how to route, how to represent, how to index, and how to protect privacy.

How to read this lesson. No code, on purpose. Numbers marked assumed are assumptions you state out loud.


1. The prompt, and the questions that change the design

A mid-level answer: "embed the photo with a pretrained model and find the nearest images". A staff candidate first asks what people point the camera at (products, text, plants, landmarks), what they want back (the exact product or similar ones), the latency and device limits, and the privacy and safety rules. Those answers produce routing to specialised handlers, exact match versus similar results, on-device cropping with a compressed index, and a hard rule against identifying people.

Assumptions you state:

That's the preview. The full lesson, with its code and exercises, is part of Unrolled Pro.
Staff AI & Pro Tier Lesson

Unlock "Case Study: Visual Search — Routing, Embeddings Across the Photo Gap, Compressed Indexes and Privacy Rules at Staff Level"

The foundations are free forever. Unrolled Pro unlocks the complete lesson, production architectures, and 55 battle-tested ML system design case studies.

Everything included with Pro:
All 234+ Deep-Dive Lessons across transformer internals, inference, RAG & agents
55 Staff-Level ML & System Design Case Studies with mathematical capacity estimates
AI Engineer Sheet & Exercises with worked solutions, self-checks, and code
100 Landmark Research Papers guided walkthroughs & progress tracking
14-Day Money-Back Guarantee — 100% full refund if you aren't satisfied
View Plans & Unlock All Lessons

From ₹167/mo (~$2/mo) · Cancel anytime · Instant activation

100% Risk-Free: 14-day no-questions-asked money-back guarantee