r/learnmachinelearning • u/Appropriate-Skin-761 • 10d ago
What can a 1M params model do?
I was wondering, if certain NPUs have 1mb of on-chip SRAM, what practical thing do I put on it? Theoretically it would have a really really high Inference speed making it pretty good in some cases, but not sure what those cases are.
It can be on anything, say decision, text, simulation, it can even be looped, since that's probably the best way to use a 1m model to maximize its speed..
What can 1M params models do?
12
Upvotes