I Pitted XGBoost Against Logistic Regression on 358 Matches. The Boring Model Won.

The article compares XGBoost and logistic regression across 358 matches, finding that the simpler logistic regression model outperformed the more complex XGBoost due to bias-variance tradeoffs. It emphasizes that smaller models can provide better cross-validated fits and advises on when to choose simpler approaches over complex ones.