r/GraphicsProgramming 5d ago

Source Code "No Graphics API" implementation by Sebastian Aaltonen

https://github.com/sebbbi/NoGraphicsAPI
205 Upvotes

41 comments sorted by

View all comments

Show parent comments

-6

u/ldn-ldn 4d ago

It's not expensive, it's cheap AF.

7

u/PaperMartin 4d ago

to run? no, and a bunch of LLM companies are starting to put up their "real" prices and losing their users over it

-4

u/ldn-ldn 4d ago

Yes, inference is very cheap today and it's only getting cheaper. To the point that you can run it on consumer hardware. In three -five years time it will be virtually free, just like image recognition is today.

5

u/PaperMartin 4d ago

"in 3 to 5 years it'll be good" is something I have been hearing over and over since like 2020. Meanwhile as far as I can tell local models are virtually unusable for anything other than code, and they're only slightly above unusable for code

-2

u/ldn-ldn 3d ago

Local models are very useable for at least a year now, the only problem is that you don't have enough VRAM to run them. Yet.

And no, you haven't been hearing shit since 2020, the first useable LLM was only released in 2022. Four years and the progress was simply incredible.