A gradient-boosted model scores 98% on training data and 70% on validation. What is the most likely diagnosis?
Answer: B. Overfitting: regularize, simplify, or get more data
A large gap between training and validation scores means the model memorized the training data. Limit depth, add regularization or early stopping, or get more data.