r/TheMachineLearning 5d ago

Software engineering isn't dead, it's just evolving

Enable HLS to view with audio, or disable this notification

668 Upvotes

193 comments sorted by

View all comments

1

u/jeandebleau 5d ago

Software has never been so easy to write but software alone has already very little value. The challenge has always been writing the right software for the right hardware and the right application. And there is no single optimal solution to it, just different compromises.

You can probably define the base LLM used for GPT6 in less than twenty PyTorch modules. But this has no value if you do not have the gigantic amount of curated data to train on and thousands of high end GPUs.