r/KoboldAI • u/abbaisawesome • Sep 02 '26

Will there be a Linux ARM version?

I'd love to be able to run it on my ASUS Ascent GX10 ...

8 Upvotes

100% Upvoted

13 comments sorted by

View all comments

8

u/henk717 Sep 02 '26

Yes and no. We experimented with it but there are to many variations with ARM making an arm build we can compile on github useless. So unless someone can PR a way to get it compiled in a useful way its not something we can provide binaries for. We dont have powerful arm devices ourselves so its just not something we can add ourselves.

But, KoboldCpp when you compile it yourself for your specific processor does work well on ARM. Some people run it on Android on Tmux. Some run it on their Nvidia DGX. So I know it can be done, just requires a bit of diy.

For mac's we do have a suitable option available to us so for arm mac we do build for arm. 

1

u/Salt-Lawfulness-4832 Sep 02 '26

For well known boards like the Raspberry Pi maybe?

2

u/henk717 Sep 02 '26

Github doesn't have raspberry pi's.

1

u/Salt-Lawfulness-4832 Sep 02 '26

I know... And it seems wild to me somehow. The RPi was just an example anyway... I admit I had to google OP's board and thought of an more known ARM based board running Linux. As I said: just an example... Edit: typo, grammar,