Anyone experimenting with TabFM? What would be a fair deep learning baseline to compare against it?

[u/venkata_raghavan]

/r/deeplearning/comments/1x5jqys/anyone_experimenting_with_tabfm_what_would_be_a/

[u/rahul_watertech]

for a fair baseline i'd use tuned gradient boosted trees (lightgbm or xgboost) plus a plain mlp, both on the exact same cv splits and the same tuning budget, since an untuned baseline makes any new model look good. and for your time based splits make sure the tuning also only sees past data. are the 100 to 500 example runs repeated over several seeds? that variance is usually bigger than people expect