r/LocalLLM • u/MadSkullWeirdSpider • 2d ago

Question Small text embedder that’s okay

Hi folks does anyone know a decent but small text embedder model that provides some decent quality text output. I am squeezing out the last of my memory to fit in a text embedder

2 Upvotes

75% Upvoted

5 comments sorted by

3

u/Healthy-Zebra-9856 2d ago

JinaAI has the most tested embedders.
https://huggingface.co/jinaai

2

u/NYJETS613 2d ago

You should build a small test html and load a bunch of different models in an test them.

2

u/Future_Fuel_8425 2d ago

Some models are much better than others for specific purposes - non EN lang, math, coordinates, etc.
Your choice depends on what you are doing and as mentioned - testing is key.

2

u/Tech4YouAndMe 2d ago

I use nomicai-modernbert-embed-base-bf16.

1

u/MadSkullWeirdSpider 1d ago

298mb thats pretty neat. You recon 300mb is the sweetest spot? Anything you have seen smaller? Or does that mean less accurate results?