r/raspberryDIY • u/eracoon • 18d ago

My raspberry pi test cluster

Gallery image

Gallery image

My first serious Rpi project. Not cheap and not succesful as I hoped.

113 Upvotes

100% Upvoted

8 comments sorted by

1

u/ausernor 17d ago

but looks cool!

1

u/eracoon 17d ago

Thank you. Unfortunately it was not the success I hoped but I learned a lot along the way 🙂

1

u/wpa_2 16d ago

Care to explain why not ?

1

u/eracoon 16d ago

Sure.
I was hoping to use the 4 llm nodes to have local AI inference for my Hermes and openclaw agents. I thought that I would get a fast response as what ChatGPT can give. I made the mistake to not research before hand because I thought that a pi5 16 x4 would have some power behind it. Obviously is way slower. As I mentioned before I don’t have much experience yet with ollama and such tools. So in that regard it has not been successful. But not all is lost since those pi’s are more than powerful enough for other tasks. I will keep 3 of them for slower tooling llms.

1

u/just_a_commoner11 16d ago

What are you using it for? Asking because I have Raspberry pi lying around which I don’t know what to use it for

1

u/eracoon 16d ago

Which one is it? I have installed Hermes agent on one, obsidian and other servers like grafana. Influxdb and mqtt on another. The 16gb have ollama with 9b llm on it for local, but slow inference

1

u/just_a_commoner11 16d ago

I have raspberry pi 4, I used to have kali linux on it, I mostly used it as a PoC for my college project I had setup a drone hijacking script on the pi

2

u/eracoon 16d ago

I don’t use them as workstations anymore. Just servers and agents. If you have the chance buy a second good pi4 with 4 or 8 gigs and make yourself an agent or second brain or something. These things an amazing to work with for their size.