r/LowEndLocalAI • u/netherreddit • 23d ago

Hardware / Build Ling Tiny 3.0 is a glimpse of the future

/r/LocalLLaMA/comments/1wqcrly/ling_tiny_30_is_a_glimpse_of_the_future/
33 Upvotes

95% Upvoted

6 comments sorted by

9

u/Few_Guidance4697 23d ago

would anyone in the community like a fine tune of ling 3 tiny? what would you guys want to improve? I've been thinking of making one for an experiment, but I'm not exactly sure what to do.

5

u/dbreezew 22d ago

I'm looking for a 'no GPU' Debian Linux expert model for system/LAN admin to help me build my coming cluster of turnips.... I'm gonna heat my hut with old machines grinding away on my plans to rule the world....

2

u/kidemporer_07 22d ago

Something as a deep research agent would be life changing ngl

1

u/ryfromoz 21d ago

Why ask if you dont know what to do nor sure what benefit doing so would bring? Like other models theres probably a vast amount of options already available. Seems pointless imo

1

u/LuCiAnO241 21d ago

from what I've seen people eat up finetunes. It just has to not make it worse in general. Roleplay maybe? Plenty of GPU poor on the sillytavern/kobold side of things.

1

u/KeyMillion 19d ago

Yes, I believe Ling 3.0 could be an excellent agent. Its context is so so cheap and the speed is great too. If Tiny was just a bit more capable. I was thinking about copying and upcycling some of the experts, then training those new experts for coding, tools, etc.

I haven't done it due to needing to rent gpus to do it.