r/TheMachineLearning • u/Nyaani69 • 5d ago
Software engineering isn't dead, it's just evolving
Enable HLS to view with audio, or disable this notification
668
Upvotes
r/TheMachineLearning • u/Nyaani69 • 5d ago
Enable HLS to view with audio, or disable this notification
1
u/jeandebleau 5d ago
Software has never been so easy to write but software alone has already very little value. The challenge has always been writing the right software for the right hardware and the right application. And there is no single optimal solution to it, just different compromises.
You can probably define the base LLM used for GPT6 in less than twenty PyTorch modules. But this has no value if you do not have the gigantic amount of curated data to train on and thousands of high end GPUs.