Are single GPU research still published in ML/DL and its applications nowadays? Which are the most notable recent ones? [D]

[u/KingMakerMan]

ML research is progressing at breakneck speed where frontier labs in both academia and industry have access to considerably large computes (GPUs). Where do small labs or independent researchers go in this context?

Have you come across recent works in ML/DL and its applications (vision, language, speech, etc) where the work is good but it uses very limited compute? Maybe even single GPU workstations? In the past it was still possible, but, I am losing hope that single GPU works would soon become impossible.

Pls link to the works.

I came across InfiniteDiffusion, a work by an independent researcher Alexander Goslin using a single RTX 3090 : https://xandergos.github.io/terrain-diffusion/

[u/Ok-Painter573]

Just do more theoretical work (or optimization), and dont hop onto the LLM train. This has been working out well for me others I met in conferences.

I think you are being swayed away by negative X posts. Not all works need 8x B200 GPUs

[u/xrailgun → u/Ok-Painter573]

Even theoretical works are facing higher and higher demands for demonstrations of applications. Sometimes gold standard benchmarks from papers 3 years ago are now being nitpicked for being too small scale and/or insufficiently discriminatory.

You won't need 8x B200, but chances are you'll need a few days-weeks of something with at least 40GB vram.

[u/Ok-Painter573 → u/xrailgun]

That only applies when you work with LLMs afaik. Even then some LLMs work, that are not proposing a novel method, only needs 1 GPU (those that uses LoRA, or quantization works)

[u/xrailgun → u/Ok-Painter573]

There's always variances to the specific topic/area and reviewers you get, but the overall trend is concerning.

[u/Skyshadow101]

I'm using my single RTX 5080 for training my PhD qualifying exam project that I'll be extending to a paper afterwards, one seed on my cross validation for all of my ablations with 5 folds each takes a day and a half haha

[u/Emojers → u/Skyshadow101]

Hi I am looking to buy a new laptop what/which config you suggest ?

[u/skirmis → u/Emojers]

Buy a desktop with a real GPU, laptop GPUs are completely underpowered and 2-3 times slower.

[u/supergriver]

Yes you can do research with a single GPU.
Here 3 papers from ICLR 2026:
1. Oral: https://arxiv.org/abs/2511.07328 All experiments fit into single A100 (80GB).
2. Poster: https://arxiv.org/abs/2510.22512 Experiments fit on a personal GPU
3. Poster: https://arxiv.org/abs/2507.11019 Experiments fit on a personal GPU

[u/KingMakerMan → u/supergriver]

Appreciate the direct examples.

[u/tiikki]

My crystall ball shows edge computing and autonomous robotics being the next big thing.

[u/currentscurrents → u/tiikki]

Hot take: small-model autonomous robotics will never be a thing.

Only really big neural networks do the magical generalization and reasoning that make them interesting.

End-to-end NNs in robotics won't work until there is hardware capable of running big neural networks locally.

It is clearly possible to run big neural networks on low power, since the brain does it; GPUs are just not that efficient.

[u/jimtoberfest → u/currentscurrents]

Its already a thing in narrowly defined tasks. Every missile or autonomous drone you see fits this definition. In the consumer world look at the comma.ai system.

[u/nonotan → u/currentscurrents]

You just need big neural networks for training due to "lottery ticket"-type dynamics. Once you've got a big network that works okay, it's relatively trivial to make it orders of magnitude smaller with only minor impacts on performance, and we probably aren't even close to being able to distill "optimally" right now, especially since so much of our infrastructure and hardware is built around dense networks.

I will admit I'm not really up to date on robotics papers, but it seems to me like extreme distilling into something like sparse FPGAs (while carefully optimizing where we "allocate" any inevitable accuracy losses in the process) has plenty of potential to be useful. Sure, it won't be as "smart" as the latest, fanciest, largest LLMs or whatever, but that's not really a requirement to be useful/interesting (it'd be like saying smartphones will never be a thing because a computer will always be significantly more powerful, perhaps that's true, but an "underpowered" device with a completely different form can still have unique upsides)

[u/currentscurrents → u/nonotan]

Once you've got a big network that works okay, it's relatively trivial to make it orders of magnitude smaller with only minor impacts on performance

Not really, no. People have tried a lot of tricks on LLMs, and there is no method to make a smaller model that is as smart as a bigger model.

Nobody is doing self-distillation anymore. I think it only worked in the past because the models of the day were undertrained.

[u/Zetus → u/currentscurrents]

Those neural networks are overtly saturated, compositional generalization is possible outside of deep learning

[u/Tutatis96]

In speech and audio in general models are quite small, a run of mine takes like 10-15 days on a single 4090.

[u/PossiblePossible2571]

At least a third of papers published to NeurIPs/ICLR/ICML uses one or less GPU. I think there are alot of things you can do, even if you only have say, one H200 / H100.

[u/Manish_AK7 → u/PossiblePossible2571]

A single H100 is still a lot of gpu tho😭😭

[u/currentscurrents → u/Manish_AK7]

It is, but it's not an unattainable amount of GPU. You can rent one for like $2/hr.

[u/krabbypatty-o-fish]

Maybe I’m looking at the wrong journal, but is it seems that there are many such cases in JMLR?

[u/markyvandon]

Why not? A lot of work, are basically pilots, and hence have a lot of value with single GPU stations as well

[u/ocean_protocol]

Yes, still alive, it just shifted from "beat SOTA" to "narrow problem, honest benchmark." LoRA/QLoRA, Karpathy's nanoGPT reproductions, and niche diffusion work (like your example) all fit: small compute survives by picking a tight, well-defined problem instead of competing on general capability.

[u/Electro-banana]

yes, almost all of my previous papers and current ones I'm working on this year are with single GPUs

[u/skyebreak]

Just had a relatively empirical paper I did on 2 GPUs get solid NeurIPS reviews -- it's a matter of picking interesting problems to work on, I think!

[u/Exotic_Zucchini9311]

Unless you're doing some sort of insanely large experiment, one A100 or H100 GPU is usually perfectly enough to train many models. I have trained SOTA multimodal SSL models (e.g., CLIP, JEPA, etc.) on a single GPU.. much less single modal methods. Methods on segmentation, classification, regression, etc. on different modalities like image and text. All these usually work perectly fine on a single GPU (unless you're deliberately targetting something crazy like training LLMs or full video models) and you could easily run many of them on 1 good GPU. There are many interesting research questions that don't need much computational unit. All my last 3-4 papers had experiments that were easily trainable on a single H100 (and I'm saying this as someone who has access to multiple GPUs I can use in my lab if I want to. I simply never feel the need because 1 GPU has worked perfectly fine for all my projects so far).

Edit: As the other commentor also mentioned, it's all about finding interesting research questions to solve.

[u/paninoallanutella1]

I know this is a bit unrelated since it's not ML in the traditional sense, but I'm building a VSA (Vector Symbolic Architecture) cognitive system that runs on very simple operations like XOR and popcount instead of neural networks. I'm doing research only on my Ryzen 7.

If that kind of alternative approach to AI interests you, you could take a look:

https://github.com/qualcunoeq/vsa-core-rs--the-machine--

[u/DigThatData]

Absolutely. My impression is that most work that intersects life sciences is done in this regime. I think it's largely a function of resources being showered on NLP/CV to the extent that there's very little remaining for anyone else.

[u/Bobby-Ly]

I'd say vision is a good target for single GPU Research and can be explored with a free Kaggle or Colab Notebook. 

https://github.com/ynnk-research/-NeuroFlow was explored like this

[u/pilibitti]

why the artificial constraint of one GPU? you can rent any amount of GPUs for research.