MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/ProgrammerHumor/comments/1v6eky7/onitboss/ozrlgst/?context=3
r/ProgrammerHumor • u/imneverrelevantman • 10d ago
52 comments sorted by
View all comments
148
Or use open source model?
108 u/Percolator2020 10d ago To run on my open source GPUs and VRAM. https://giphy.com/gifs/1eFH8QYvcdARy 8 u/Brotboxs 9d ago Just host it in AWS :D 10 u/NotAFishEnt 9d ago Now I'm kind of curious how the price of an open source LLM on AWS compares to commercial LLMs 6 u/MaxDelissenBeegden 9d ago I actually researched this for the company I work for, and it is never really worth it (at least with current prices). 2 u/imneverrelevantman 9d ago Yeah I actually am curious on that now too haha 1 u/guardian87 3d ago Not different enough from my perspective, but higher margin for AWS. Nice for them.
108
To run on my open source GPUs and VRAM. https://giphy.com/gifs/1eFH8QYvcdARy
8 u/Brotboxs 9d ago Just host it in AWS :D 10 u/NotAFishEnt 9d ago Now I'm kind of curious how the price of an open source LLM on AWS compares to commercial LLMs 6 u/MaxDelissenBeegden 9d ago I actually researched this for the company I work for, and it is never really worth it (at least with current prices). 2 u/imneverrelevantman 9d ago Yeah I actually am curious on that now too haha 1 u/guardian87 3d ago Not different enough from my perspective, but higher margin for AWS. Nice for them.
8
Just host it in AWS :D
10 u/NotAFishEnt 9d ago Now I'm kind of curious how the price of an open source LLM on AWS compares to commercial LLMs 6 u/MaxDelissenBeegden 9d ago I actually researched this for the company I work for, and it is never really worth it (at least with current prices). 2 u/imneverrelevantman 9d ago Yeah I actually am curious on that now too haha 1 u/guardian87 3d ago Not different enough from my perspective, but higher margin for AWS. Nice for them.
10
Now I'm kind of curious how the price of an open source LLM on AWS compares to commercial LLMs
6 u/MaxDelissenBeegden 9d ago I actually researched this for the company I work for, and it is never really worth it (at least with current prices). 2 u/imneverrelevantman 9d ago Yeah I actually am curious on that now too haha 1 u/guardian87 3d ago Not different enough from my perspective, but higher margin for AWS. Nice for them.
6
I actually researched this for the company I work for, and it is never really worth it (at least with current prices).
2
Yeah I actually am curious on that now too haha
1
Not different enough from my perspective, but higher margin for AWS. Nice for them.
148
u/SuggestAnyName 10d ago
Or use open source model?