VFlash: Fast, Accurate Visual Planning via Flash Primitive Decoding
u_Unrolled
Easy10 XPserving

Should you use batch or online inference?

Weekly churn-risk scores feed an email campaign every Monday. Which serving mode fits?

Stuck? Show the solution

Answer: B. Batch inference: score everyone on a schedule and write the results to a table

When predictions are needed on a schedule, batch is simpler and cheaper. Use online inference when the input only exists at request time.

Learn the idea behind itML Problem Families — Choosing the Right Shape for the Problem