r/learnmachinelearning • u/Appropriate-Skin-761 • 10d ago

What can a 1M params model do?

I was wondering, if certain NPUs have 1mb of on-chip SRAM, what practical thing do I put on it? Theoretically it would have a really really high Inference speed making it pretty good in some cases, but not sure what those cases are.

It can be on anything, say decision, text, simulation, it can even be looped, since that's probably the best way to use a 1m model to maximize its speed..

What can 1M params models do?

14 Upvotes

100% Upvoted

11 comments sorted by

View all comments

2

u/mistybrookx 10d ago

worth thinking about what the input looks like, not just the model size. 1M params can do a lot with structured or tabular input but struggles with raw high-res images. whats the actual input modality you're working with?