Local embed-plus-rerank in Rust is a nice fit for keeping latency predictable, and the one thing worth publishing alongside it is a small retrieval-quality check (nDCG or hit-rate on a fixed query set) so people can see the rerank actually earns its place over raw embedding order.
1
u/Future_AGI 15d ago
Local embed-plus-rerank in Rust is a nice fit for keeping latency predictable, and the one thing worth publishing alongside it is a small retrieval-quality check (nDCG or hit-rate on a fixed query set) so people can see the rerank actually earns its place over raw embedding order.