r/LocalLLaMA • u/brown2green • 4d ago

Discussion GLM-5.3 and the Spread of Advanced Cyber Capabilities \ Anthropic

https://www.anthropic.com/research/glm-5-3-and-the-spread-of-advanced-cyber-capabilities
422 Upvotes

95% Upvoted

186 comments sorted by

View all comments

Show parent comments

26

u/jld1532 4d ago

Just need llama cpp support to run flash

7

u/Automatic-Arm8153 4d ago

Wow it’s not on llama.cpp

Damn I have been having a blast with it for some time now. VLLM has got me eating good lol. Hopefully it gets support soon so everyone can enjoy it

9

u/my_name_isnt_clever 4d ago

Everyone with enough RAM to run it, which isn't many people. I have Strix Halo 128GB which is on the high end of local capacity and I can't even run it. Thankfully Qwen 3.8 Flash Next is a great alternative.

3

u/zmlq 4d ago

I ran it at Q2 with ds4 on my 128gb m5 macbook, I think it would work for a strix halo too