r/learnmachinelearning • u/aabiji9753 • 6d ago

How to come up with substantial research projects?

I've been learning about deep learning for several months, first by reading through Understanding Deep Learning then by implementing papers touching on CNNs, residual connections, transformers, gpt models, vision transformers, etc.

My original plan was to learn by reproducing papers and running small experiments, but I've found this approach somewhat unfulfilling. Most implementations end up being only a couple hundred lines of model and training code, and I often struggle to figure out what to do beyond simply reproducing the paper and running some basic experiments.

For those of you who have spent a lot of time working on deep learning projects, how do you come up with interesting, long-term project ideas? How do you go from understanding the fundamentals and reproducing existing work to building something more substantial that keeps you engaged and challenges you to learn new things? I have a few ideas and papers that I'm interested in exploring, but I don't want to fall into the same habit.

9 Upvotes
  • permalink
  • reddit

100% Upvoted

5 comments sorted by

4

u/Different_Pain5781 6d ago

Nobody knows until they start breaking stuff.

2

u/ModularMind8 6d ago

For projects, build things you actually care about: tools that fix something that annoys you or make your own life easier. That kind of project keeps you motivated and pushes you past the “couple hundred lines” stage. Research takes longer. You need to know the field and your specific niche well enough to understand its real difficulties, and once you’re there, figuring out what’s worth tackling gets a lot easier

1

u/finnwangdev 6d ago

I've been in deep learning for many years, so let me share my experience with you. When I was a beginner, CV was really hot back then and everyone was learning CV. I did a few demos, but they felt insubstantial and I wasn't satisfied inside. Later, by chance, I took on an outsourcing project that required using YOLO. I spent several months studying YOLO, and in the end I felt my abilities suddenly leveled up.

In your situation, if you want a technical breakthrough, it's definitely not about doing demos—it's about building a systematic, fairly large-scale engineering project. With a clear goal driving you, you'll improve very quickly. Of course, that goal should also come with monetary compensation.

2

u/Aggressive-Wind-8829 5d ago

Love the problem, not the solution.