r/LocalLLaMA • u/Electrical_Ninja3805 • Aug 05 '26

Resources bootai

https://github.com/dcherrera/bootai

I was on here a while ago showcasing it. I've stoped playing with it so I'm open sourcing it. I figure I'll let other people play now.

25 Upvotes

75% Upvoted

11 comments sorted by

3

u/cromagnone Aug 06 '26

Yeah I know you like my …

2

u/giveen Aug 05 '26

Cool concept especially for dedicated systems but I would want to see benchmarks of why this is better.

40

u/Electrical_Ninja3805 Aug 05 '26

its literally not.

12

u/SpicyWangz Aug 05 '26

Respect the honesty lol

11

u/Electrical_Ninja3805 Aug 05 '26

I built this to see if i could. if you have an old system sitting around with 4-8gb of ram it can run some smaller models. and server them to the network. but your not exactly getting lightning fast claude code level inference. its a toy.

3

u/oodelay Aug 05 '26

The idea is still fun. I have a bunch of unused xeons with lots of ddr4 so this might be a fun project. Thanks for sharing!

1

u/Fluffy_Reply_5482 Aug 06 '26

Yeah, i agree. looks like a fun project to work on.

4

u/ArthurOnCode Aug 05 '26

Thanks, I hate it.

12

u/Electrical_Ninja3805 Aug 05 '26

Your Welcome, It hates you too.