How does the compute of standard self-attention grow with sequence length n?
Answer: C. O(n²): every token attends to every other token
The attention matrix has n × n entries, so doubling the context roughly quadruples attention compute and memory.