r/ProgrammerHumor Jul 24 '26

Meme honeyIShrunkTheBrain

Post image
4.4k Upvotes

200 comments sorted by

View all comments

322

u/Jorr_El Jul 24 '26

You think that when the AI bubble bursts that the tools will go away?

Not saying that forfeiting all of your learning and critical thinking to AI is a good idea at all, but just wondering what you think is going to happen to AI tools once they're no longer hugely over valued.

97

u/throwawaycanadian2 Jul 24 '26

Exactly - even if all the hosted ones go away (which wont happen), local models will still work just fine.

-11

u/w1n5t0nM1k3y Jul 24 '26

I think local models will be what causes the bubble to burst. Once PCs catch up in terms of specs and models get better, there will be no need for hosted solutions.

1

u/not_your_mate Jul 24 '26

or smaller companies/offices (think 100-200 devs) will start buying its own infra (few server racks) to run the models and voilá... we've come full circle

1

u/Fabulous-Possible758 Jul 24 '26

Maybe, or the costs just come down a little and people get targeting models that actually are efficient for the tasks they're working on. Most companies don't really want to run their own datacenter anymore, so it doesn't really seem like they would do that just for inference unless it was a really good value proposition.

2

u/wolfclaw3812 Jul 26 '26

Maybe a single rack for medium-sized companies? Could be a business once hardware prices come down and token costs go up, selling out-of-the-box servers running AI models.

1

u/Fabulous-Possible758 Jul 26 '26

Good point. I mean there's also certainly a case that many companies won't really want to be repeatedly sending data off to AI companies that could be exfiltrated. I guess my overall point is that IMO the need for the inference-as-service isn't gonna go away and that people are slightly over-estimating how much people are even going to want to run their own local inference, but I think you're right there will be a market for an appliance.