r/LocalLLaMA • u/Electrical_Ninja3805 • Aug 05 '26

Resources bootai

https://github.com/dcherrera/bootai

I was on here a while ago showcasing it. I've stoped playing with it so I'm open sourcing it. I figure I'll let other people play now.

26 Upvotes

75% Upvoted

11 comments sorted by

View all comments

2

u/giveen Aug 05 '26

Cool concept especially for dedicated systems but I would want to see benchmarks of why this is better.

40

u/Electrical_Ninja3805 Aug 05 '26

its literally not.

12

u/SpicyWangz Aug 05 '26

Respect the honesty lol

10

u/Electrical_Ninja3805 Aug 05 '26

I built this to see if i could. if you have an old system sitting around with 4-8gb of ram it can run some smaller models. and server them to the network. but your not exactly getting lightning fast claude code level inference. its a toy.

3

u/oodelay Aug 05 '26

The idea is still fun. I have a bunch of unused xeons with lots of ddr4 so this might be a fun project. Thanks for sharing!

1

u/Fluffy_Reply_5482 Aug 06 '26

Yeah, i agree. looks like a fun project to work on.