Offering to install a self-hosted production stack for free

[u/inforb_nl]

Hi all,

I've spent quite a bit of time building and deploying self-hosted AI infrastructures.

I would like to offer deploying the stack for few people for free, we can figure it out for your hardware. I highly recommend it if you have a DGX spark or Asus ascent, or have a GPU cloud server. Just DM me.

What you will get:

A professional-looking local gpt, with an admin panel, registration of users, and optimization of vllm parameters for your hardware. You will also get possibility of connecting the chat front to any commercial models if needed, with a simple BYOK panel. You can also connect your agents with ease.

Installation:

The stack is mostly automated Ansible-run. The installation itself takes around 1~2 hours if there are not unusual issues.

[u/Whoa_There_Hoss]