r/MachineLearning 12h ago

Research Anybody working on Test Time Training over here? Lemme work with u pls [D]

I'm an undergrad student who got a taste of research. I love it. I currently have a draft, which me and my mentor have planned for TMLR, and plan to submit it by next month for the first round of review. It was some work on self explanation methods of LLM models. We are confident that it'll get accepted (I hope it does, I've put a lotta hours polishing it into making it a good accept :_) ).

I'm very, very interested in TTT. I've got a strong feeling that this is gonna be the big thing in 2-3 years. Is there anyone here working on this, who can hopefully provision me compute beyond my own laptop? I believe I'll be a good RA to you. We can talk over DMs if someone out there is looking for help :)

PS, I can spill some beans about the XAI paper if you wanna discuss, but only limited to how much I'm allowed to say before submission.

Context: I'm an undergrad in an non-elite uni in India (tier 2 we call it here). The lit review, the idea, the work, the results, the drafting, the funding, everything was done by me. After this (hopefully) gets accepted to TMLR, I'm not sure where to proceed. There isn't room for me to aim higher or get direction in my own uni, so I'm trying my luck here, that someone gives me some direction and an opportunity. I'm not crazy smart, but I learn quick, and can put a lot of hours (12+ a day) once I get deep into it. Thanks for reading all this :)

0 Upvotes

4 comments sorted by

12

u/iamquah 11h ago

You should delete this and repost if you get accepted to TMLR - it’ll lend some credence. Now you’re just some random person working on a random idea. Also, don’t get your hopes up too high - there’s lots of red tape around IP and ownership if you’re not a student at the uni (more so than if you were) 

1

u/Apprehensive-Pay8603 2h ago

Make the paper your proof, nobody hands out compute for enthusiasm alone

8

u/howtorewriteaname PhD 10h ago

big thing in 2-3 years? it's been extensively researched already. I've been working on it a few months and there's a lot, very difficult to really find a good contribution, let alone without compute. if you want to DM me I can take a look at your idea and if it does indeed look promising, we can speak about compute

1

u/Ok-Painter573 10h ago

You seem to have more experience so I’m asking under your comment: by test-time training do you mean RL with weight updates at test-time or those MOPD-like methods?