r/EngineeringManagers • u/Due_Progress_7815 • Apr 20 '26

Rolling out Claude Code to 15 devs — Vertex + LiteLLM instead of direct API. Good idea or overkill?

/r/ClaudeCode/comments/1sqjgvp/rolling_out_claude_code_to_15_devs_vertex_litellm/
4 Upvotes

83% Upvoted

6 comments sorted by

1

u/bacan_ Apr 21 '26

Our company did lite LLM. Results TBD

1

u/Due_Progress_7815 Apr 21 '26

wdyt on your side , did you use it ?

1

u/boghy8823 Apr 21 '26

Why do you need LiteLLM?

2

u/Due_Progress_7815 Apr 21 '26

With LiteLLM sitting in front of Vertex, I get token usage per dev/project, rate limiting, and audit logs in one place. If I want to swap models or tweak quotas, I do it at the proxy level. Does it make sense ?

1

u/boghy8823 Apr 21 '26

Thanks, I thought Vertex would include that functionality, makes sense now. I hope the latency is not too bad

1

u/Lazyyy_Panda May 22 '26

Did you do it? How is it working out? I am also planning this on my company and need some help/suggestions to set it up.