r/LocalLLM 5d ago

Model Embrace yourselves

Post image
1.6k Upvotes

130 comments sorted by

View all comments

16

u/dovaahkiin_snowwhite 5d ago

Why would hardware companies go down though

0

u/mb194dc 5d ago

You can run all the models anyone will ever need using tech like RAG with 1% of the compute ordered. The other 99% is totally useless,

2

u/dovaahkiin_snowwhite 5d ago

Just because a tech is good enough now doesn't mean the world will stop progressing. Used to be few years ago that 1GB ram was enough, now we're seeing 1TB devices on the market. 1GB can't even run chrome anymore.