Users say the chatbot "feels slow to start" but streams quickly once it begins. Which metric is bad?
Answer: B. TTFT (time to first token), which is dominated by queueing and prefill
TTFT covers waiting in the queue and processing the prompt (prefill). TPOT is the gap between streamed tokens (decode).