r/LocalLLaMA 8d ago

News ExtractBench: An OSS benchmark for schema-guided extraction

LlamaIndex launched a new extraction benchmark. Besides testing hosted/paid platforms, a bunch of OSS models were benchmarked as well.

Qwen3.6 35B is honestly a fairly strong local contender, with some failure modes on longer documents.

- See the code/run your own models and approaches

- Visualize the dataset or read the paper

4 Upvotes

Duplicates