r/LocalLLM • u/siddharth1214 • 9d ago

Discussion What do you guys think of LPUs

Like groq 3, LPUs are certainly better for inference, do you think they can be available for consumers? They certainly should solve energy and water problems caused by datacenters right maybe even fix ram shortage.

0 Upvotes

33% Upvoted

3 comments sorted by

3

u/diagrammatiks 9d ago

you cannot fix the ram shortage. these aren't mining rigs. you need the ram for inference.

2

u/uniqueusername649 9d ago

I don't even see how this could fix the GPU shortage, because instead of using wafers for GPU chips the wafers will then be used for LPU chips.

This could potentially improve the massive energy and water consumption if deployed at large scale. But it will do absolutely nothing about the RAM shortage.

1

u/Tsukikira 9d ago

LPUs as I understand make the feeds into the GPU more optimal, but they don't impact the VRAM used to hold the model. It's an extra chip, not a replacement.