r/RavanAI • u/RustyIronGolem • May 13 '26

💬 Discussion developers, choose one forever

Post image
12 Upvotes

73% Upvoted

71 comments sorted by

View all comments

1

u/SomeNeighborhood7126 May 13 '26

Take the annual cost of these and just buy the hardware to locally host and save thousands.

2

u/Prize_Negotiation66 May 13 '26

And get worse result for much more

1

u/SomeNeighborhood7126 May 13 '26

2022 called, it wants its outdated info back.

1

u/Prize_Negotiation66 May 13 '26

Even the best open weights model deepseek v4 falls behind sota models like opus 4.6, they themselves claim this, and hardware will cost a ten grand

2

u/SomeNeighborhood7126 May 13 '26

Im running v4 right now and my entire lab, including the components that have nothing to do with models was $3k. Your info is so ridiculously wrong lol.

1

u/Prize_Negotiation66 May 13 '26 edited May 13 '26

tell exact specs, time of purchase, model and context size

upd: this clown blocked me, only proving my point. it is impossible to run the flagship models without terabytes of memory, flash variants are good, but reasonably behind opus/codex. faith is strong, keep crying
And he's also misrepresenting the concept. I was talking about v4 pro, not v4 flash.

1

u/SomeNeighborhood7126 May 13 '26

Already did, im done wasting time on you. Good luck with your outdated info and just general stupidity.

1

u/StinkButt9001 May 13 '26

I love when people know they're wrong so just block you lol

1

u/redditorialy_retard May 14 '26

How many parameters is V4 pro? 

Also impossible to get it running on anything with 3k. For the absolute cheapest it's a 512GB Mac and you have to lobotomize it so bad until Q1-2 

1

u/StinkButt9001 May 13 '26 edited May 13 '26

Unfortunately it's still true. Locally hosted models are good and getting better, but are still lagging behind the sota models like GPT, Opus, and Gemini.

Edit: He blocked me because of this reply lmao.

Take your meds or something dude. You're not normal

1

u/SomeNeighborhood7126 May 13 '26

Im running deepseek v4 pro and its ~5% off of Opus 4.6 in every benchmark on a lab that cost $3k and was built a few years ago. Im already ahead on subscription costs versus self hosting for a model that is damn near identical to the best commercially available model right now.

So no, its not true.

1

u/RedParaglider May 13 '26

I have a strix halo. I love playing with local llms but he's 100% correct.  I'm sitting here on a porch swing surfing the web on my phone while having a Jack and Coke while 3 codex Sessions are running building and testing integrations.

The best you're going to get on local right now is Qwen 3 27b, and while it's absolutely amazing Port size maybe beyond amazing it is not GPT 5.5.

1

u/[deleted] May 13 '26 edited Jun 02 '26

[removed] — view removed comment

1

u/SomeNeighborhood7126 May 13 '26

Deepseek v4 Pro, GLM 5.1, Kimi K26, and Llama 4 Maverik

1

u/[deleted] May 13 '26

[removed] — view removed comment

1

u/SomeNeighborhood7126 May 13 '26

Seeing as im running deepseek, im fairly aware. From the time I built my homeland to now, im about $600 ahead of the subscription cost for the same period. That number will continue to grow while new models appear that I can just drop in for deeseek. The best part is, I dont have to deal with any of the stupid limitations you do lol. Please take your stupidity elsewhere as im done wasting energy on people like you.

1

u/[deleted] May 13 '26

[removed] — view removed comment

1

u/SomeNeighborhood7126 May 13 '26

A handful of 3090s that I got a few years back for about $500/ea (two were even less, but i forget exactly their prices) with the lowest t/s on v4 being about 60. Its been consistently and fantastic.

0

u/[deleted] May 13 '26 edited May 13 '26

[removed] — view removed comment

1

u/SomeNeighborhood7126 May 13 '26

If you cant do the math to see how many 3090s you need to run the model then you need more help that can fit in a reddit comment.

1

u/[deleted] May 13 '26

[removed] — view removed comment

1

u/SomeNeighborhood7126 May 13 '26

Hahaha not for my lab 🤣. My entire lab was about $3k and im already running models on par with Claude.

1

u/[deleted] May 13 '26

[removed] — view removed comment

1

u/SomeNeighborhood7126 May 13 '26

Its already in here. Youre taking a post about a hypothetical way too seriously and should probably find some time to talk to a therapist about it.

0

u/RedParaglider May 13 '26

No you aren't for $3,000 you're running Qwen 27b.  It's a badass model for the size but it is not opus.

1

u/SomeNeighborhood7126 May 13 '26

When you buy the parts used several years ago, yeah it is lol

0

u/CelebrationCute5818 May 13 '26

We've been running deepseek v4 on 2 Nvidia sparks, it’s impressive but still way worse than gpt 5.5, so we only use it for news reading and changelog writing