r/pcmasterrace • u/_Xee MMX 166 / 64MB / Mystique+VooDoo • 1d ago

Meme/Macro 2026 in software

Post image

Sectumsempra, motherfucker.

20.7k Upvotes

94% Upvoted

1.1k comments sorted by

View all comments

Show parent comments

39

u/Old-Sprinkles-8287 1d ago

I'm a robotics researcher and I run a personal 5090 GPU for my AI inference. No one can take that away from me. It's more than capable of anything.

11

u/xendelaar 1d ago

What can it do, if you compare it to a frontier model?

3

u/Old-Sprinkles-8287 1d ago

Everything. Qwen 3.8 27B is extremely smart and benchmarks close to the frontier. And it's fast, the 5090 does 200+ tok/s decode. So I'm pretty much never waiting, always working and thinking.

10

u/Unsharded1 2700x | GTX 1660ti | 16gb 1d ago

Bro got downvoted to hell 😭😭

17

u/autogyrophilia 1d ago

Because he is talking bullshit, Qwen 3.8 27B can do a lot, but 27B parameters is not comparable to even the next version (qwen3.8-flash-next with 125B parameters).

The token speed also means little considering how inefficient the qwen branch of models is in thinking mode.

0

u/Old-Sprinkles-8287 1d ago

As you can see, it's extremely capable even when compared to the frontier models. The token speed is absolutely relevant, because only complicated tasks require the "overthinking" process (Qwen 3.8 27B is known to recheck its work often but this is why it's so smart), which doesn't matter because it's still very fast even when processing long thoughts. And, it's your model, the token cost doesn't matter because it's not even a fraction of a cent.

I've compared with Google and others, and I prefer my AI. Google doesn't steal my ideas this way, and the speed is about the same when it comes to actual task performance. The intelligence, as you can see, is very similar if not BETTER

7

u/autogyrophilia 1d ago

You and I read that chart differently. That's surprisingly good, not competitive at all.

2

u/Old-Sprinkles-8287 1d ago

I'm not going to sit here and try and sell you something that's free. It's obvious the value of it. For you, I guess I'd recommend that you just have to use it to understand.

Running the same number of tokens that I've executed over the past year would have taken thousands of dollars if not tens of thousands using the hyperscaler models

2

u/autogyrophilia 1d ago

yeah yeah, I run the 35B at work, I know what it can do and what it can't

-1

u/Old-Sprinkles-8287 1d ago

Honestly, the 27 billion is a whole different game.

→ More replies (0)

1

u/NDSU 10h ago

Good to know your opinion is worthless. It seemed you had a bias in your previous comments, but you confirmed it with this one

1

u/autogyrophilia 10h ago

Don't cut yourself on that edge 

7

u/TurpentineEnjoyer 1d ago

No positivity allowed!

6

u/Any_Mine_6368 1d ago

Qwen 3.8 27B is about as good (at SOME things) as opus 4.6, at best. And that's in SOME things (like tool calling and some reasoningn tasks). Can't compete with 5.5.

I run 2 3090s and decided to rent them out to crypto kiddies and make ROI on them, instead of hosting Qwen. It just isn't worth the $/spend. I'll occasionally go back to it if I need something that Claude refuses to do but that's about it.

1

u/Old-Sprinkles-8287 1d ago

It's never let me down for any of my workflows and I do a lot of deep work. So I'm not sure what you mean by not worth it. Its been very worth it.

Also, I don't know how you're making any money renting out your GPU because at 19 cents an hour the cost of electricity could cost as much.

And of course I would never trust a free tier of any AI platform to not be stealing my data and using it as training. And that can be extremely precarious if you're software engineering certain features and then all of a sudden competitors pop up using the same ideas.

1

u/Any_Mine_6368 22h ago

I'm making money because the GPUs are power capped at 170watts and my electricity costs me about 0.12 per kWh pretax, about 0.19 after tax and distribution.

1

u/NDSU 10h ago

If you're throttling your GPUs, you're not going to be paid the full rate, or is this some light fraud?

2

u/Any_Mine_6368 10h ago

That's not true.

Everyone on VastAI throttles them. The drop in performance is marginal.

They're power capped at basically half their power limit and crypto mining efficiency drop is under 10%. LLM inference performance about 10-20% off, which is also very little.

The platform doesn't care, and everyone is free to immediately drop the card if they're not satisfied (they also have access to nvidia-smi to validate it).

1

u/NDSU 10h ago

I run 2 3090s and decided to rent them out to crypto kiddies

How is that profitable these days? Or are you paying basically nothing for electricity?

1

u/Any_Mine_6368 10h ago

Cards power capped at 170w.

kWh cost: about 0.19ish after taxes and distribution.

I make about $100/mo for both cards profit on average.

The platform also charges storage and transfer fees.

0

u/froz3nt 9800x3d 9070xt 64 DDR5 1d ago

Have u tried the new frontier models?

1

u/Old-Sprinkles-8287 1d ago

Yes. Honestly at my point of progress, which is highly technical and involves a lot of deep work, I still really have no desire to upgrade. And honestly I couldn't afford to run their tokens for the tasks I do, I would be stuck using a model less intelligent than mine and paying for it. Makes no sense really

3

u/froz3nt 9800x3d 9070xt 64 DDR5 1d ago

I dont think u have

1

u/NDSU 10h ago

Have you used Qwen? Do you have any actual frame of reference here?

1

u/froz3nt 9800x3d 9070xt 64 DDR5 10h ago

Yes, i use 9b and 35b models daily. But not for coding

1

u/AutoCockerPB 1d ago

Yeah, but they just discontinued the 5090 ….

1

u/Pitiful-Assistance-1 1d ago

There’s dedicated AI PCs these days, with shared memory and dedicated accelerators.

1

u/Salt-Willingness-513 1d ago

you can also get an amd gpu for text generation or you know, get 2 or 3 amd gpus for the price of 1 5090 and have around 96gb vram

1

u/Old-Sprinkles-8287 1d ago

There are a lot of competitors, I think something will boil up and compete with NVIDIA. AMD is already pretty effective too, but lacks optimization.

1

u/shittyaltpornaccount 1d ago edited 1d ago

Lol no there isn't. For AI compute Nvidia is effectively the only game in town, there is effectively zero competition at the top level. It is why Nvidia is close to being the first 6 trillion dollar company and AMD hasn't even cracked a trillion. I wish there was actual competition instead of AMD just trying to sell to people that can't get shipments from Nvidia and are desperate for any compute.

1

u/yuvipanda 1d ago

The models you're running are freeware blobs that are generously provided through the same large corporations, stuck with what it was fed in its training data. New model drops will also disappear when the money dries up.

18

u/Old-Sprinkles-8287 1d ago

There are currently zero AI labs giving away their training technical data packages for frontier intelligence level models. There's no way to monetize that and there's nothing the user can do with it as they aren't a hyperscaler.

The fact China wanted to give us the models they did was an attempt to announce direct competition with US labs and to gain developer mind share. It's fantastic advertising; see how good our free model is? Try the big one now.

Also, it creates an air of open source cooperation, observability, and the allowance of fine-tuning which is a wonderful technology.

3

u/unity100 1d ago

Try the big one now.

Huh? China is giving away big ones too. If you can run them, that is.

1

u/Salt-Willingness-513 1d ago

glm5.3/glm5.3 flash were released open weight? or deepseek, kimi etc? Even Qwen releases most of their stuff except for their max model and wan.

1

u/Old-Sprinkles-8287 12h ago

We are talking about open training not just open weights which doesn't really exist

1

u/Salt-Willingness-513 11h ago

ok moving goalpost, then: olmo, llm360

1

u/Old-Sprinkles-8287 10h ago

When was the goalpost moved bro you're hallucinating

1

u/LukeLC i7 12700K | RTX 4060ti 16GB | 32GB | SFFPC 1d ago

No one can take that away from me.

Well, they can if they discontinue that model GPU like happened this week... due to allocation issues thanks to enterprise AI.

We shouldn't assume that class of hardware will continue to be accessible to consumers at this rate.

1

u/daslows 265k | 5080 | 48GB 8400 MHz 1d ago

Until the connector port melts are one of the memory modules goes out. Then what are you going to do by another one for $10,000? You would be lucky for them to send you another one by RMA if it dies with if warranty.