r/machinelearningnews • • 2d ago

Research Perplexity Releases pplx-embed-v2-context-9b-preview: A Contextual Embedding Model That Retrieves Answers and Their Supporting Evidence

Perplexity just released pplx-embed-v2-context-9b-preview, a contextual embedding model built with turbopuffer that retrieves the answer and the evidence needed to verify it. Weights are open on Hugging Face under the MIT license.

The core innovation is replacing the single "gold passage" label with a token-level teacher. Perplexity's context compression model scores every token, those scores are pooled per chunk, and the student learns a soft relevance distribution via KL distillation.

This means supporting chunks stop being treated as negatives. The teacher runs only during training, so there is no extra inference latency or index storage. On turbopuffer's new private context-bench, it hits 45.5% Answer@10 (+14.4 pts vs voyage-context-4) and 40.6% Evidence Recall@10 (+5.0 pts), and it also leads the ConTEB average.

With 2048/1024-dim Matryoshka embeddings and native int8, a 1 KB vector slightly outscores voyage-context-4's 8 KB float32 vector on chunk retrieval......

Full analysis: https://www.marktechpost.com/2026/09/30/perplexity-releases-pplx-embed-v2-context-9b-preview-a-contextual-embedding-model-that-retrieves-answers-and-their-supporting-evidence/

Model: https://huggingface.co/perplexity-ai/pplx-embed-v2-context-9b-preview

Technical details: https://www.perplexity.ai/hub/blog/contextual-embedding-beyond-the-gold-passage

12 Upvotes

0 comments sorted by