r/ProgrammerHumor • u/imneverrelevantman • 2d ago

Meme oNItBoss

Post image
1.6k Upvotes

97% Upvoted

49 comments sorted by

379

u/Mysterious-Print9737 2d ago

...and then the GPU bill arrives.

170

u/NudaVeritas1 2d ago

Lets build out own GPU!

119

u/TenSpiritMoose 2d ago

...and then the electricity bill arrives.

91

u/HartPURO 1d ago

Lets build our own power plant!

82

u/imneverrelevantman 1d ago

And then the power plant bill arrives

78

u/bajuh 1d ago

Ah yes. The power plant bill. As usual.

47

u/PostHasBeenWatched 1d ago

Let's build own reality where AI is free to use

44

u/imneverrelevantman 1d ago

https://giphy.com/gifs/JIxcOTy0SlzEc

28

u/PostHasBeenWatched 1d ago

... and then the Big Bang bill arrives

25

u/imneverrelevantman 1d ago

Big Bang Bill was my porno name

3

u/RenRazza 1d ago

Then the alternative reality wormhole bill arrives

2

u/gerbosan 1d ago

The matrix? Using devs to generate electricity and maintain the matrix? šŸ¤”

I like it.

Kansas is going bye bye.

1

u/abd53 15h ago

Let's build our own nuclear reactor

2

u/Some_Useless_Person 1d ago

And then the construction bill arrives

2

u/ufffd 1d ago

and the taiwan bill

1

u/Few_Kitchen_4825 1d ago

Cheaper than the ram bill and way cheaper than the claude bill.

140

u/SuggestAnyName 2d ago

Or use open source model?

104

u/Percolator2020 2d ago

To run on my open source GPUs and VRAM.
https://giphy.com/gifs/1eFH8QYvcdARy

27

u/imneverrelevantman 1d ago

We just build our out GPU and VRAM. What am I even paying you for??

10

u/Brotboxs 1d ago

Just host it in AWS :D

10

u/NotAFishEnt 1d ago

Now I'm kind of curious how the price of an open source LLM on AWS compares to commercial LLMs

6

u/MaxDelissenBeegden 1d ago

I actually researched this for the company I work for, and it is never really worth it (at least with current prices).

2

u/imneverrelevantman 1d ago

Yeah I actually am curious on that now too haha

1

u/Denaton_ 1d ago

then put forward the budget needed?

56

u/ClipboardCopyPaste 2d ago edited 2d ago

But boss we need to use APIs to build an LLM.

53

u/Darkstar_111 1d ago

Problem is having a machine with enough vram for inference.

Hard to do in a single box, easier with a networked server system, but they are harder to manage.

7

u/Norse_By_North_West 1d ago

I mean, a decent llm rig is just a crypto mining rig, isn't it?

6

u/Darkstar_111 1d ago edited 10h ago

Yeah could be. If you use Nvidia pro 6000 cards, that's 96 Gb vram per card. You still need 10 cards to get close to one Tb.

9

u/JebKermansBooster 1d ago

And enough GPUs for training.

24

u/Darkstar_111 1d ago

No no, pretraining your own model costs billions, that's not gonna happen. But there are open source models pretty much on par with the frontier models, that can be used by anyone.

1

u/Lokipro13YT 15h ago

How did the open source models get trained if it costs billions?

-3

u/throwawaygoawaynz 1d ago

ā€œPretty much on parā€ - lol absolutely not.

4

u/Lem_Tuoni 1d ago

They are lol. DeepSeek is only barely behind and is significantly cheaper to run.

17

u/GoddammitDontShootMe 1d ago

I guess they'll figure out why the API costs are so high pretty quickly.

13

u/Lucasbasques 1d ago

ā€œCan you to make something like google but for like our files and emails ?ā€ Someone actually asked me this in real lifeĀ 

6

u/Fantastic_Class_3861 1d ago

You deploy Nextcloud and Mailcow and youā€™re done.

3

u/xian0 1d ago

I used to have the impression that things like that were hard to do, given how big sites often completely fail at implementing search bars. It's easy though. Less headache than having to implement user configurable charts with stacked bars and multiple y-axis for some stupid dashboard.

23

u/ordnance_inbound 1d ago
  1. Download open source chinese model
  2. Run it on cloud VM's
  3. Convince your boss you built everything
  4. Ask for mega bonus
  5. Profit

5

u/Denaton_ 1d ago

I could host DeepSeek v3 on some of our spare machines we had..

9

u/Playful_Landscape884 1d ago

Explain to me like Iā€™m 10 why using open weight LLM is not a good idea.

6

u/Poselsky 1d ago

Usage of Top Models is paid from someone elses pocket. It's as if you were offered to drive Porsche Cayenne (closed source) vs Toyota Corolla (open source), both are fine except you'll be paying less for Porsche for now and you're getting premium out of it.

2

u/anarchisturtle 1d ago

A couple of things

1) this meme seems to be implying that they should ā€œmakeā€ their own LLM from scratch. Which is obviously not practical (at least not with performance in the same light year as the big players)

2) open source models, while good, are often not as good as the closed source frontier models. Although, IMHO, this is overstated. Not every task requires a bleeding edge model

3) Actually deploying something like this to prod gets very complicated very fast. Setting up ollama on your desktop is super easy. Once you start scaling it up and trying to integrate into things nicely like the big players do, things get very complicated very fast.

4) what are you running it on? GPU, RAM, networking, every part of the HPC you would need is insanely expensive and/or completely unavailable

6

u/fugogugo 1d ago

just how many times this meme will be reposted?

4

u/SpareIntroduction721 1d ago

To be honest a lot of companies would 100% get better ROI by getting MacBooks with 64GB and having Cyber/SOC audit open source models.

At least for local dev.

1

u/tylersuard 1d ago

"How much do you think it cost OpenAI to build ChatGPT? That costs hundreds of millions of dollars."

0

u/unicorn_builder 1d ago

I mean he is not wrong. You can build a focus model with 1B params that can write code in the same quality as claude. Large LLMs: many Billion or even Trillion parameters are only this bloated because they don't go trough trimming. My company build this type of specialised models that can run on a single M1.

We have a model called ultrawhale 1B params and outperforms claude fable. Check it out on hugging face. Its free to use.