VFlash: Fast, Accurate Visual Planning via Flash Primitive Decoding
u_Unrolled
D8: RAG & Knowledge Systems · Retrieval II — Analyzers, Speed, Sharding, Permissions and Debugging
Phase 5/Domain 8/Lesson 2

Retrieval II — Analyzers, Speed, Sharding, Permissions and Debugging

35 min read·Advanced· Unrolled Pro
Retrieval II — Analyzers, Speed, Sharding, Permissions and Debugging

You already know: the RAG pipeline, the inverted index, BM25 and vocabulary mismatch (Retrieval I); context budgets and delimited sources (D7 Context engineering).

Why this matters for Atlas. Lesson I built retrieval that works on a toy corpus. Production retrieval fails for different reasons: text analyzed one way at index time and another at query time, queries that are too slow at millions of documents, scores that change depending on which shard a document lives on, users seeing passages they aren't allowed to see, and nobody able to explain a bad result. This lesson covers each, with code you can measure.

Where you'll use this. Configuring an Elasticsearch, OpenSearch or Postgres full-text index for a RAG system. Deciding whether search should refuse to answer. Keeping a multi-tenant assistant from leaking one customer's documents to another. Answering "why didn't search find X?" with evidence instead of guesses.


1. Analyzers: what the index actually stores

The question. "Refunded" didn't match "refund" in Lesson I. What decides which words count as the same?

Start from nothing. An analyzer turns raw text into the terms stored in the index, and the same analyzer must run on every query. A typical chain:

That's the preview. The full lesson, with its code and exercises, is part of Unrolled Pro.
Staff AI & Pro Tier Lesson

Unlock "Retrieval II — Analyzers, Speed, Sharding, Permissions and Debugging"

The foundations are free forever. Unrolled Pro unlocks the complete lesson, production architectures, and 55 battle-tested ML system design case studies.

Everything included with Pro:
All 234+ Deep-Dive Lessons across transformer internals, inference, RAG & agents
55 Staff-Level ML & System Design Case Studies with mathematical capacity estimates
AI Engineer Sheet & Exercises with worked solutions, self-checks, and code
100 Landmark Research Papers guided walkthroughs & progress tracking
14-Day Money-Back Guarantee — 100% full refund if you aren't satisfied
View Plans & Unlock All Lessons

From ₹167/mo (~$2/mo) · Cancel anytime · Instant activation

100% Risk-Free: 14-day no-questions-asked money-back guarantee
Build Atlas · Part 7 of 9: Ground it in your documentsUse this lesson in the project: Chunk the lessons by structure, search them with BM25 and dense vectors, fuse the rankings, and measure retrieval apart from answers.