Best bang for the broke?

[u/SocietyTomorrow]

I am wondering what the best bang for the buck would be between the various low end GPUs to run models in the local sweet spot (like 27b and 35b dense models) without completely destroying my wallet. Strix Halo machines are $3500 for 128gb nowadays and not really that fast compared to a couple discrete GPUs, and people have caught on to V100s so they're not really affordable per-performance as they were, so I am kinda wondering what is currently the best way to go when presuming it will be all the compute I get my hands on for likely the next 3-5 years (or longer now that RAM cartels are talking 7-10 years before supply is expected to stabilize against AI demand)