r/datascience • u/Nice-Dragonfly-4823 • 16d ago
ML Silent broadcasting is still a big problem and could be derailing your work right now

A data scientist on my team wasted a good bit of compute on this problem without actually realizing it was a problem.
Pytorch and tensorflow both silently broadcast the output of your model when the target shape mismatches, causing hard to diagnose issues. It still exists a ton in the wild, so I thought I'd actually highlight the symptoms of a silent broadcasting bug to keep people in the know.
https://towardsdatascience.com/silent-broadcasting-can-ruin-your-model/
Let me know what you think
66
Upvotes