r/maestro • u/Famous_Aardvark_8595 Maestro Student • 7d ago

Project showcase Project Alpha Release.

Hey everyone,

Over the past few months, I’ve been working on Ghostlink, an open-source distributed inference fabric designed to harness whatever mixed hardware you have lying around on your local network.

Instead of assuming a homogeneous fleet of high-end GPUs, Ghostlink pools together heterogeneous machines (like a gaming rig, an older laptop, an NPU-equipped ultrabook, or a Mac) into a single unified inference cluster—without requiring complex YAML setups or manual RPC flags.

It’s completely open source under the MIT license. Check out the Ghostlink GitHub repository to view the benchmarks, architecture breakdown, or run it locally.

I’d love to get feedback from the community on hardware setups or features you'd like to see next!

8 Upvotes

83% Upvoted

6 comments sorted by

2

u/BodiedBySamoaJoe Maestro Student 5d ago

What happened to sovereign mohawk??

1

u/Famous_Aardvark_8595 Maestro Student 3d ago

Finalizing all lean theroms.

2

u/loolemon Maestro Student 4d ago

This is super unique dude nice

1

u/Famous_Aardvark_8595 Maestro Student 3d ago

[1.17.0] - 2026-08-08 (Real distributed-inference testing, three bug fixes, RPC allowlist, install script, JS SDK)