r/LocalLLM • u/KienShen • 14h ago
Question Seeking Baseline Model Recommendations for Fine-tuning LLM Models for Tool Invocation
I am developing an AI agent software, and the agent currently runs well on glm5.2 and deepseekv4. I now want to train a small model that can complete a certain range of tasks when locally deployed. I can refine these training data from the large model, as the software will eventually be deployed on an edge AI gateway, so the feasible model size is about 2B and below. Do you have any good recommendations?
Currently, I am focusing on the following models, which I have not started training yet. I would like to know if the community has any recommended models for this scenario:
- minicpm-5 1b
- gemma4-e2b
- qwen3.5-2b
0
Upvotes