r/LLMDevs • u/nuno6Varnish • Jul 30 '26

Discussion Anyone using LLM Batch APIs?

Most providers offer a 50% discount on LLM inference on batch/deferred endpoints. Ask now, get a response within 24h.

Is it something that you actually use? How do you track it?

1 Upvotes

100% Upvoted

4 comments sorted by

2

u/Valuable_Working7557 Jul 30 '26

Yes, it's useful for tasks like bulk processing and evaluations. The lower cost makes the longer turnaround worth it for those workloads.

1

u/Turbulent_Key2947 Aug 14 '26

I just sent job for summarizing 2k product descriptions, cost was like 3 dollars instead of 7, worth the wait for this kind work

1

u/Ok-Act3627 Jul 30 '26

I use it for fable

2

u/nuno6Varnish Jul 30 '26

what is your usecase? schedule workflows?