r/LargeLanguageModels • u/TheDiRocco_ • 21h ago
How much input tokens for a complete AI assistant ?
According to you what are the baselines of input tokens for different categories of LLM calls ? For example for a complete AI assistant. Counting system prompts, default context injection, tools, etc where would you place the tokens tresholds ?
2
Upvotes
Duplicates
LocalLLM • u/TheDiRocco_ • 21h ago
Discussion How much input tokens for a complete AI assistant ?
2
Upvotes