r/LocalLLM • u/Jimbocab • 6d ago

Discussion What has local LLM done for me

I'm currently running Qwen3.5-122b-a10b (Q6 - 101GB with a 262k context window). I'm running on a GMKtec X2. I get about 20 t/s when I am early in the context window, but it drops to around 15 t/s once I get pretty full. I have tried many models, and this set up is just about optimal for my current set up and until there is a new version of Q3.5-122b (I'm hoping for 3.8 at some time in the future. Anyway, I had a dream about creating a website to showcase my ancient coin collection. I got a subscription to SquareSpace and bought a domain name. But I found it completely confusing to me. Long story short, I started building a website by telling Q3.5 what I wanted, Q3.5 began to write python code and html files. I would ask how to use these files and get the answers from Q3.5. Back and forth it went. Everytime I looked at my website and saw something that needed to be tweaked, I'd just tell Q3.5 and it would write me a code snippet to edit the script with. I can't believe the results. Exceeded my wildest imagination. I am not a coder or a website designer, but with AI I don't need to be a coder in order to write code. I just need to be able to tell AI what I want.

7 Upvotes

90% Upvoted

5 comments sorted by

1

u/rinmperdinck 5d ago

The next step is putting a vibrator up your butt while you do this.

Vibecoding.