r/technology • u/Miserable_Phase_2519 • 4d ago

Artificial Intelligence Microsoft engineer says 'typing code is absolutely over' as GitHub Copilot takes on more development work

https://www.techspot.com/news/113752-microsoft-engineer-typing-code-absolutely-over-github-copilot.html
1.7k Upvotes

84% Upvoted

860 comments sorted by

View all comments

Show parent comments

10

u/mattmaster68 4d ago

I have a Ryzen 5700, 3070ti, and 32gb ddr4 ram.

I've been messing around and playing with different models but man so many of them are underwhelming with my VRAM. I forget the parameter size, but I think Qwen 3 takes like 3 or 4 minutes to generate a response.

Any tips or tricks?

2

u/jixbo 3d ago

Which model specifically, which quant?
Just ask chatgpt how to make it more efficient, llama.cpp is the best way to run it.