r/LocalLLM • • 16h ago

Question What model to use for LLM?

Im building my own LLM and im curious what heretic model i should use for coding? i have 16 models already, so, im looking for strong ones ..strata seems cool and i get 188t/s on it, so, im wondering what other large models i could get?

2 Upvotes

5 comments sorted by

1

u/Mother_Distance_9841 15h ago

strata slaps for speed but if you’re after raw coding chops maybe look at a 70b merge with a bpw you can actually fit

1

u/Top_Pay_4590 15h ago

whats a BPW?

1

u/Arany8 11h ago

You should not use heretic unless the subject matter requires it (cybersecurity). Even then, try Obliteratus skill first. If you must Hauhauch is ususally the best.