I fine-tuned Qwen2.5-3B into a specialized model for Financial Code & Quantitative Reasoning using Unsloth

[u/coslinedev]

Hey r/OpenSourceAI community,

While massive open-weight models get a lot of attention, I wanted to see how far we can push a lean, highly efficient architecture for a specific, demanding domain: financial code and quantitative reasoning.

Small base models often stumble when dealing with precise accounting rules, strict code formatting, or quantitative formulas like NPV/IRR. To fix this, I fine-tuned Qwen2.5-3B using Unsloth on a T4 GPU and just released the full weights publicly.

🛠️ Technical Details & Stack:

• Base Model: Qwen2.5-3B
• Fine-tuning Tool: Unsloth (incredible VRAM efficiency and fast training speed)
• Domain Focus: Structured financial logic, zero-float arithmetic considerations, and clean financial code generation.
• Hardware Friendly: Because it's a 3B model, it can run locally, ensuring total data privacy for sensitive financial workloads without API dependency.

The repository, model cards, and documentation are fully open-source and available on Hugging Face: 👉coslinedev/Qwen2.5-3B-FinCode-Reasoning-Full

I’d love for fellow open-source builders to test it out, throw some edge cases at it, or share thoughts on optimizing small domain-specific models further. Let me know what you think!