VFlash: Fast, Accurate Visual Planning via Flash Primitive Decoding
u_Unrolled
D22: AI System Design Bank · Case Study: Fraud and Abuse Detection — Cost-Based Decisions, Real-Time Features and Delayed Labels at Staff Level

Case Study: Fraud and Abuse Detection — Cost-Based Decisions, Real-Time Features and Delayed Labels at Staff Level

25 min read·Staff+ Tier· Unrolled Pro
Case Study: Fraud and Abuse Detection — Cost-Based Decisions, Real-Time Features and Delayed Labels at Staff Level

You already know: the system design method (lesson 01), feature stores and point-in-time data (lesson 03), stream processing (D14), class imbalance and calibration (D3), and monitoring (D11). Fraud looks like binary classification and isn't, in four ways: mistakes have different prices, so the threshold is an economic choice; positives are rare, so accuracy is meaningless; labels arrive weeks later; and the opponent adapts. This case is the first in the bank to use the full fourteen-section format, and it sets patterns (cost-based tiers, early labels, rules beside models) that the spam, credit and ad cases reuse.

How to read this lesson. No code, on purpose. Numbers marked assumed are assumptions you state out loud; prices are illustrative.


1. The prompt, and the questions that change the design

A mid-level answer: "train a classifier on past fraud and block payments above 0.5". A staff candidate first asks what each mistake costs, which actions exist besides allow and block, how fast decisions and labels are, and who the adversaries are. Those answers produce cost-based thresholds, a challenge tier, real-time velocity and graph features with early labels, and rules that can change in minutes beside a model.

Assumptions you state:

That's the preview. The full lesson, with its code and exercises, is part of Unrolled Pro.
Staff AI & Pro Tier Lesson

Unlock "Case Study: Fraud and Abuse Detection — Cost-Based Decisions, Real-Time Features and Delayed Labels at Staff Level"

The foundations are free forever. Unrolled Pro unlocks the complete lesson, production architectures, and 55 battle-tested ML system design case studies.

Everything included with Pro:
All 234+ Deep-Dive Lessons across transformer internals, inference, RAG & agents
55 Staff-Level ML & System Design Case Studies with mathematical capacity estimates
AI Engineer Sheet & Exercises with worked solutions, self-checks, and code
100 Landmark Research Papers guided walkthroughs & progress tracking
14-Day Money-Back Guarantee — 100% full refund if you aren't satisfied
View Plans & Unlock All Lessons

From ₹167/mo (~$2/mo) · Cancel anytime · Instant activation

100% Risk-Free: 14-day no-questions-asked money-back guarantee