
Foundation Models Beat Tuned XGBoost Below 50,000 Rows
Pretrained transformers now top the tabular leaderboard, beating tuned XGBoost below 50,000 rows. The ceiling, the GPU bill and the protocol caveat decide whether it applies to your tables.
September 20, 2026 · 6 min read