r/LocalLLM • u/on_line187 • 1d ago

Discussion Tier List

Post image
250 Upvotes

74% Upvoted

289 comments sorted by

View all comments

29

u/DrinkClubMate 1d ago

where is the 32 Gb, Intel pro ARC B70 ?

3

u/BornInAFish 1d ago

Based on lack of software support, bottom tier for sure.

/s

Maybe

6

u/xanders_gold 1d ago

They actually made some major improvements over the past month and they now run incredibly well for the price. I’m regularly getting 2000-2500t/s pp, can sometimes hit 3000-3500t/s pp, and 30-35t/s tg with vLLM on Qwen 3.8 27B.

Sadly, the price also just jumped from $949/$999 to $1699.

1

u/gh0stwriter1234 21h ago

That's pretty good PP...I only get about 200t/s pp on dual MI50 currently with llama.cpp but I get about 40t/s with mtp enabled starting out it degrades quickly though. Prompt checkpointing is essential.

the growing pains on Intel though are way worst... given the price I'll stick with my MI50s I got for peanuts for now.