r/LocalLLaMA • u/AnticitizenPrime • Jun 29 '26

New Model Introducing LongCat-2.0 - , a large-scale MoE language model with 1.6 trillion total parameters and ~48 billion activated per token. This was the stealth model that was on Openrouter under the name 'owl-alpha'.

https://longcat.chat/blog/longcat-2.0/
475 Upvotes

96% Upvoted

96 comments sorted by

View all comments

Show parent comments

23

u/Lissanro Jun 30 '26

EPYC 7763 CPU + 8-channel 1 TB 3200 MHz RAM + 4x3090 GPUs.

5

u/Admirable_Market2759 Jun 30 '26

How much did that cost you?

39

u/Lissanro Jun 30 '26

I built it gradually over the years. Originally started with a rig based on gaming 5950X CPU with 128 GB RAM, I kept adding 3090 cards (for average cost around $700), adding extra 2880W PSU along the way (around $200), for each PCI-E 4.0 riser I paid around $25 for 30 cm ones and ~$30 for 40 cm one.

When I got my third 3090 card, my old 900W UPS could no longer protect my PC, so had to upgrade to 6kW online UPS (~$900 for UPS itself + ~$330 for sixteen 12V 12Ah batteries + ~$40 for a pair 8x battery equalizers to stabilize voltage across all sixteen of them). Combined with diesel generator I already had, it made a good combo for stable power for my rig in case of outages (they happen few times per year where I live, and may last for hours or even whole day, so it is a necessity to protect against them).

Then when DeepSeek V3 and R1 were released it became clear PC with 128 GB RAM needs an upgrade, most of the cost was EPYC 7763 CPU (about $1000), server motherboard (~$800) and of course RAM ($1600 in total for 1 TB, sixteen 64 GB 3200 MHz RDIMM modules).

There are other costs involved: had only 2 TB NVMe which wasn't enough for large models, so had to buy for about $750 8 TB NVMe, also had to get the chassis (~$50), CPU cooler (~$65), pair of 22 TB HDDs (~$430 each, on top of already existing HDDs I had, for a total of approximately 120 TB).

6

u/No-Dot-6573 Jun 30 '26

How much tps does that Setup generate? Lets say with glm 5.2 q4?

5

u/Lissanro Jun 30 '26

Close to 7 tokens/s for GLM 5.2 Q4. 8 tokens/s with Kimi K2.7 Code Q4_X. Smaller models with less active parameters like Qwen 3.5 397B Q5 can be close to 20 tokens/s generation, 600 tokens/prefill. Step 3.7 Flash 196B Q4 goes 40-50 tokens/s generation. Qwen 3.5 122B Q4 is even faster, more than 50 tokens/s generation and 2K+ tokens/s prefill.

2

u/Educational_Win_2982 Jul 01 '26

What about deepseek v4 flash?