Paste a CSV into a chatbot and ask it to make predictions. You'll likely get a confident answer, but one that often performs worse than an XGBoost model trained in five minutes. The reason is simple: language models treat numbers as text fragments and rows as sequences, while tabular data consists of numerical values and has no inherent order.
This talk explores how models designed specifically for tabular and time-series data overcome these limitations, comparing their approaches along three dimensions:
The results are compelling: with default settings, TabPFN-3.5 leads the TabArena leaderboard.
Yet important challenges remain, from scaling beyond a million rows to navigating benchmarks influenced by vendor claims and restrictive licenses, such as TimesFM 3's non-commercial terms.
By the end of the talk, attendees will understand how these models learn, how they make predictions, and where their strengths and limitations lie.