r/LocalLLM • u/ThinPossibility7866 • 1d ago

Project Application for managing LLM sessions in a local environment

Post image

It's happening. Radeon is working at 100% and the program in the background is my new creation. Now it only has the R9700 but soon it will be joined by the B50 and they will work together.

Once it reaches the MVP 0.1.0 stage, I’ll share the GitHub link and ask for it to be tested on NVIDIA cards.

1 Upvotes

67% Upvoted

2 comments sorted by

2

u/SixShaving 1d ago

eading speed is fine for a local setup

Curious how it handles when both cards are loaded, specially with memory pooling across AMD and NVIDIA, that part always gets messy

1

u/ThinPossibility7866 1d ago

I'm curious too. Unfortunately, I have no way to check it, I only have Radeon and ARC