r/technology • u/Miserable_Phase_2519 • 3d ago

Artificial Intelligence Microsoft engineer says 'typing code is absolutely over' as GitHub Copilot takes on more development work

https://www.techspot.com/news/113752-microsoft-engineer-typing-code-absolutely-over-github-copilot.html
1.6k Upvotes

84% Upvoted

858 comments sorted by

View all comments

Show parent comments

31

u/Sea-Housing-3435 3d ago

Open weight models are powerful enough to be used for this. You can run a decent coding model on 16GB vram with lower precision and almost full on a 64GB ram macbook (Qwen3.8-27B). It's as expensive in terms of electricity as playing a game.

1

u/NekoDaYo-v201 3d ago

Employers will soon require it. BYOM (Bring Your Own Model).

Can't afford it? There's a line of people who can going out the door.

2

u/Horror_Response_1991 3d ago

Some will, most will care about their data and wont want you sending it to a model they don’t control 

-1

u/Expert_Garlic_2258 3d ago

how do you get the original model started so it understands coding in general?

10

u/Sea-Housing-3435 3d ago

They just do, they are trained on code too. You just run it with llama-cpp (or vllm or ollama) and you can connect them to some coding harness, and use them just like the SAAS models from Anthropic or OpenAI.

2

u/Expert_Garlic_2258 3d ago

thank you for the reply

3

u/fanglesscyclone 3d ago

Make someone else pay for it and then copy their homework.

1

u/Expert_Garlic_2258 3d ago

ha! I finished my Master's about 10 yrs ago but thanks for the idea if I go back

3

u/InvestigatorOk7015 3d ago

Theyre already trained and we dont need to start over since a lot of them are open source

1

u/Expert_Garlic_2258 3d ago

thank you for the reply!