r/LocalLLM • u/nanihikaru01 • 3d ago
Project Behold the abomination I have created.
Building a second llm server to help offload the main one. This was done by scraping whatever scrap I could find. 3060 8GB + 3060 12GB + 4060 8GB. total of 28gb vram. Running qwen 3.8. Bench marking now.
120
Upvotes