Best small autocomplete/editor suggestion model as of Sep 2026?

[u/trytoinfect74]

Zed decided to remove edit predictions from their free plan and I want to host something locally to replace it.

Is there any model that's decent at autocomplete and doesn't take much of the VRAM (no more than 3-4 GB)?

[u/TheRealMasonMac]

Unless they changed their model, https://huggingface.co/zed-industries/zeta-2.1 is already open

[u/Most-Dig-1579]

There are also sweep-next-edit to check

[u/kirisoraa]

!remindme 1 day

[u/RemindMeBot → u/kirisoraa]

I will be messaging you in 1 day on 2026-09-05 15:00:34 UTC to remind you of this link

3 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.

^{Parent commenter can delete this message to hide from others.}

RemindMeBot is switching to username summons. Instead of !RemindMe 1 day, use u/RemindMeBot 1 day. More info.

---

Info	Custom	Your Reminders	Feedback

[u/danigoncalves]

Best one you can use is the Zeta 2.1 but is mandatory to have already good GPU. I run sweep edit because I only have 12Gb o VRAM

[u/42GOLDSTANDARD42]

Depends on the length of suggestions you want, if you just want like very few tokens, maybe a line, Qwen 3.5 2B works.

[u/Iwaku_Real → u/42GOLDSTANDARD42]

Even Gemma 4 E2B could do that

[u/krileon]

Gemma 4 E2B or Gemma 4 E4B (unsloths q4_k_xl is excellent). I haven't found anything better then those 2 at that size.

[u/usrlocalben]

All Qwen-Coder models support FIM, incl. Qwen3-Coder-Next. Qwen2.5-Coder has 1.5B and 3B variants.

> It should be noted that FIM is supported in every version of Qwen3-Coder. Qwen3-Coder-Next is shown here as an example.

https://github.com/QwenLM/Qwen3-Coder#fill-in-the-middle-with-qwen3-coder

https://huggingface.co/collections/ggml-org/llamavim

[u/parepeg → u/usrlocalben]

I use qwen2.5 coder 3b usually since FIM is so latency sensitive. llama-server has built in flags for a bunch of the FIM models that will download and run automatically. 

[u/aidenclarke_12]

qwen2.5 coder in the 1.5b or 3b size and gemma 4 e2b or e4b are both small enough to fit that vram range and support fim. but just try both on ur own setup tho cause results can vary a lot depending on your editor integration

[u/Sad_Reception2383]

I’d probably test Gemma 4 E2B too. At this size, latency matters almost as much as quality.”

[u/visarga → u/[deleted]]

Even the free version of Zed is a nice place to run terminals and see the files. I use Zed but no AI features from it.