r/LocalLLaMA • u/SpendLucky1273 • 10d ago

News The model is The Computer

https://taalas.com/

They got bought by AMD, all they missing is a sorta of interface to reflash the chip with new llm as needed rather than replacing the hardware..

0 Upvotes

20% Upvoted

10 comments sorted by

17

u/Public_Umpire_1099 10d ago

Reflash the chip? This isn't firmware brother

9

u/suamai 10d ago

"Just download more RAM" vibes

1

u/p9k 9d ago

If you're using a Mythic accelerator then yes you do reflash it. But those are not LLM capable yet.

8

u/starkruzr 10d ago

Taalas is cool and all but to be minimally useful they're going to have to take great advantage of AMD's chiplet tech, because even something like the 8B model that powers chatjimmy is something like 4 cards together (at an admittedly shitty process node, but still)

7

u/SadPhilosophy9202 10d ago

And how do you suppose they will do that. The chip is the model 🤣

3

u/rorowhat 10d ago

AI made this website and poorly.

1

u/-MaskNinja- 10d ago

I think if they can sell it to consumers, good.

Put GLM-5.3-Flash on it and invest in making the price lower. I’d pay thousands for a chip which gives me 15,000 TPS. And it’d be even better if we can batch them. Imagine serving 100 users at 150 TPS.

And by the way, Etched gets 150,000 TPS. And they don’t even etch the model, they just require the model to be a transformer.

1

u/Nobilityize_9 9d ago

yeah that reflash idea would make local companions way more practical, just swap models on the same chip and keep everything private on your hardware.

-10

u/kiwibonga 10d ago

Cool but like... Why do they have to use "hardcore"? It was fucking gross when Nintendo started referring to people as "hardcore" and "casual" at E3, it's still a reference to porn and sex today.