VFlash: Fast, Accurate Visual Planning via Flash Primitive Decoding
u_Unrolled
D22: AI System Design Bank · Case Study: Privacy-preserving LLM Gateway — Data Classes, Routing, Pseudonymisation and Retention at Staff Level
Phase 9/Domain 22/Lesson 53

Case Study: Privacy-preserving LLM Gateway — Data Classes, Routing, Pseudonymisation and Retention at Staff Level

30 min read·Staff+ Tier· Unrolled Pro
Case Study: Privacy-preserving LLM Gateway — Data Classes, Routing, Pseudonymisation and Retention at Staff Level

You already know: the LLM gateway (routing, quotas, logging), the guardrail gateway and evaluation gates. This case adds privacy: making sure sensitive data reaches only approved models, in approved regions, with as little retained as possible. The design questions: how to classify data, where each class may go, how to hide personal data without breaking tasks, what to log and for how long, and what to do when detection misses.

How to read this lesson. No code, on purpose. Numbers marked assumed are assumptions you state out loud. This is a design discussion, not legal advice: data rules come from your legal and privacy teams.


1. The prompt, and the questions that change the design

A mid-level answer: "detect personal data with a model and redact it before calling the provider". A staff candidate notes that detection is probabilistic: even at 99% recall, thousands of prompts a day slip through. So the design needs deterministic controls behind it: classify data by where it came from, route each class only to destinations allowed to receive it, and rely on contracts (no retention, region) for what detection misses. They also note that usability is a privacy control: if the gateway is painful, people paste data into unmanaged tools.

Assumptions you state:

That's the preview. The full lesson, with its code and exercises, is part of Unrolled Pro.
Staff AI & Pro Tier Lesson

Unlock "Case Study: Privacy-preserving LLM Gateway — Data Classes, Routing, Pseudonymisation and Retention at Staff Level"

The foundations are free forever. Unrolled Pro unlocks the complete lesson, production architectures, and 55 battle-tested ML system design case studies.

Everything included with Pro:
All 234+ Deep-Dive Lessons across transformer internals, inference, RAG & agents
55 Staff-Level ML & System Design Case Studies with mathematical capacity estimates
AI Engineer Sheet & Exercises with worked solutions, self-checks, and code
100 Landmark Research Papers guided walkthroughs & progress tracking
14-Day Money-Back Guarantee — 100% full refund if you aren't satisfied
View Plans & Unlock All Lessons

From ₹167/mo (~$2/mo) · Cancel anytime · Instant activation

100% Risk-Free: 14-day no-questions-asked money-back guarantee