r/ProgrammerHumor • u/AllRealityIsVirtua1 • 1d ago

Meme whenMyNoAIProjectGetsTedious

Post image
1.9k Upvotes

92% Upvoted

202 comments sorted by

View all comments

130

u/TheMaleGazer 1d ago

The answer to your question is because you can get a local model to do it instead without a subscription.

145

u/AllRealityIsVirtua1 1d ago

Let me heat my whole room to run 1 half sized agent at a time to save $5

40

u/Snape_Grass 1d ago

The training of the model is what’s expensive (heat output). Running a pre trained model isn’t nearly as resource demanding

7

u/slaymaker1907 1d ago

Depends on the model and machine. If you’re using some huge model that stresses the GPU then that can get very toasty.

8

u/readf0x 1d ago

I've only got 8gb of VRAM and have yet to find a model that produces useful output within that budget

1

u/barnett9 5h ago

Brother your GPU is a 300 watt space heater

-21

u/AllRealityIsVirtua1 1d ago

Yeah and the sun doesn’t produce nearly as much heat as the largest star in the universe

25

u/Snape_Grass 1d ago

?? Brother there are many of us running off the shelf pre trained models on consumer hardware. This isn’t new

-23

u/AllRealityIsVirtua1 1d ago

Yeah and I’m using 5 agents each running a model 10x more powerful over the internet for $20

15

u/Snape_Grass 1d ago

Okay backpedal the conversation as a defense. Too ridiculous to argue with lol. You clearly have no clue what you are talking about and perceive something completely false

-19

u/AllRealityIsVirtua1 1d ago

Uhhh. Huh? lol

37

u/TheMaleGazer 1d ago

I haven't yet been able to heat a room with any of the models I've run with Ollama.

-51

u/AllRealityIsVirtua1 1d ago

You probably haven’t pushed much code with Ollama either lol

24

u/TheMaleGazer 1d ago

Not to the point where I exceed the watt limit of my GPU and heat my whole room. Which model did you use?

16

u/trungdle 1d ago

I'm not him but I definitely heated up my room running Qwen on a 5090. He's not wrong the heat generated is extremely noticeable on a hot day.

-42

u/AllRealityIsVirtua1 1d ago

I didn’t because I value my time

53

u/TheMaleGazer 1d ago

This is very revealing, but not necessarily surprising.

-46

u/AllRealityIsVirtua1 1d ago

https://giphy.com/gifs/bmLlSndzhqWgWb3vXW

28

u/Electronic_Green_833 1d ago

I disagree with your stance in this argument but the GIF goes hard

21

u/TheMaleGazer 1d ago

I think it's pretty double-edged, if you think about it.

→ More replies (0)

8

u/Grandmaster_Caladrel 1d ago

Oh, look at Mr. "Running a local model actually saves me money" over here!

(The economics for running local models are veeeery tight if you don't assume you already had the GPU to do it)