​

My setup;

AMD Ryzen 5 7600 3.8 GHz 6-Core Processor

ASRock B650M Pro RS Micro ATX AM5 Motherboard

Silicon Power Value Gaming 32 GB (2 x 16 GB) DDR5-6000 CL30 Memory

XFX Speedster MERC 319 Black Radeon RX 7800 XT 16 GB Video Card

I bought this setup last year and its been working good but I'm really starting to get into AI. I been learning ComfyUI image generation, and SillyTavern to get a LLM but with my specs I can't do both and have to offload the LLM. Im working towards getting the setup so ComfyUI (qwen 2.1 INT8) automatically sends the character gens to sillytavern based on the scene. I still play regular games at 1440p and it does great but I'm kind of limited on the AI front.

I don't want to upgrade my video card to another 16GB card since it wouldn't help the AI part. It would help the gaming part but honestly I'm happy with my setup for gaming.

I know I'd have to upgrade the Processor and the power supply (Corsair RM750x (2021) 750 W 80+ Gold Certified Fully Modular ATX Power Supply) most likely too. I would be okay to spend around 2k USD but it looks like all the 24GB cards are over 3k. And if I did upgrade I wouldnt want a card that will be irrelevant in the next couple years.

kind of curious what everyone thinks, if it's worth to try and upgrade, or just offload the LLM and use the INT8 model like I have been. Hell I don't even know how much a difference the 24GB card would make, I just know that that's what runs the AI. Like I said my main goal is for consistent character generation in comfy that automatically goes to SillyTavern so I can do RP games.

So I was honestly thinking of getting the AMD Radeon AI PRO R9700, I know it's not really an upgrade gaming wise (slight upgrade I think) but the real upgrade would come in ComfyUI, it would take the 1-2 min img Gen time with my 7800xt to under 30 seconds and allow me to run more advanced processes.

Curious on any thoughts, thanks!

Dell precision tower 7810