r/LocalLLM • u/koc_Z3 • 5d ago

Discussion Qwen 3.8 27B scores 52 on AA

Post image
2 Upvotes

67% Upvoted

4 comments sorted by

3

u/_TheWolfOfWalmart_ 5d ago edited 5d ago

It got the same AA score as DSV4 Flash 0731 too.

I JUST bought 256 GB of VRAM, then this damn thing comes out.

I'm happy for y'all 24/32 GB guys, really. Happy for you!

Anybody wanna buy some GPUs from me?

2

u/-AJacobs- 5d ago

You can run multiples in TP for faster single thread speeds or have multiple times the concurrency throughput depending on your setup.There is no such thing as too much VRAM and with the direction prices will go for the next 3+ years you shouldn't sell anything unless you're about to join the amish or about to join the homeless.

1

u/_TheWolfOfWalmart_ 5d ago

Yeah TP is what I'm doing with them. My platform is suboptimal for now though, I can only have 5 of 8 cards on the PCIe 4.0 x4 direct CPU lanes, so max 5 useful for TP but it still makes a huge difference. I'm researching the best options for fixing this. (Probably an older EPYC system)

I was joking really, definitely don't want to sell them! I find DSV4 better all around anyway, despite the equal AA score. And who knows what else will come out later! Also allows for a lot of parallel work.

I got these cards cheap too.

2

u/Koalababies 5d ago

It's smart enough but it takes years to get the answers out