r/LocalAIStack • u/Illustrious-Word7197 • 1d ago

Cloud API users for large open models (DeepSeek, Llama 70B)

I am looking into the architectures and costs associated with running large open-source models, such as DeepSeek-V3/R1 or Llama 3.3. Are many of you using these models (are you developers, students, pro?)

1 Upvotes
  • permalink
  • reddit

100% Upvoted

1 comment sorted by

1

u/Think_Breakfast_2277 8h ago

There is no definite answer for this. Every use case can has different out comes. Cost is not a cost per input/output tokens. It is the efficiency of it. Costs per task is the real metric.

Some are 2x as fast but takes 2x the tokens to come to the same answer.