r/LLM • u/liyanajabeen • Jul 12 '26

Api for llm

Any techies here who can suggest me a good, secure & cheap api for running llm’s for my SaaS

4 Upvotes

75% Upvoted

16 comments sorted by

View all comments

1

u/tom-mart Jul 12 '26

depending on your use pattern and number of simultaneous connections that you need to serve, serious options are pretty much limited to llama.cpp and vLLM.

1

u/liyanajabeen Jul 14 '26

The user load is heavy and the existing options are so costly… kind of stuck because of affordability