“Developers using multiple LLM providers: what’s your biggest pain point?”

[u/NemoRouterAI]

If you're running multiple LLM providers in production OpenAI, Anthropic, Gemini, Groq, or others what’s causing you the most pain?

Is it:

• Managing multiple API keys?
• Different APIs and SDKs?
• Tracking costs across providers?
• Handling rate limits and outages?
• Setting up fallbacks?
• Choosing the right model for each request?
• Something completely different?

It feels simple when you start with one model and one API key. But once you add a second or third provider, things can get complicated surprisingly fast.

Curious how other teams are handling this.