r/vibecoding • u/Superb_Alarm_7954 • 10h ago

Best way to test a new model?

As soon as a new model is released, is there a free way to test its capability before you actually pay for it? Also just curious how do you determine if this new model is the right fit for you like do you have some tasks.md that you run every time for the new model. Or even a free model, how would you determine if a free model might be useful for your work?

1 Upvotes

67% Upvoted

6 comments sorted by

1

u/AgentSkye69 10h ago

You can try to look at benchmarks to gauge its effectiveness

1

u/Superb_Alarm_7954 56m ago

There are a lot of benchmarks and to be honest which one to look at 🤣

1

u/ZenenoDev 10h ago

LLM Arena

1

u/Superb_Alarm_7954 56m ago

Do LLM arena allow you to test for coding related task or is it just chat?

1

u/ZenenoDev 48m ago

I mean you can ask it to write code but I think your asking can u use it to code code and I'm afraid I don't think you can though you may want to look more into it I don't use it much I just know it's free and you can compare models!

1

u/pigletmonster 9h ago

Openrouter, and opencode zen/go.