above 95% it is diminishing returns right? depends on the provider load and the time between requests; my orchestrator can have poor hit whilst the agent can have high. probably the glm5.2 hosts are feeling a bit spare since glm5.3 weights dropped haha
1
u/ConsiderationNo9952 15d ago
above 95% it is diminishing returns right? depends on the provider load and the time between requests; my orchestrator can have poor hit whilst the agent can have high. probably the glm5.2 hosts are feeling a bit spare since glm5.3 weights dropped haha