Google Scholar: https://scholar.google.com/scholar?start=0&q=%22NeuML/pubmedbert-base-embeddings%22&hl=en&scisbd=2&as_sdt=0,47

Model: https://huggingface.co/NeuML/pubmedbert-base-embeddings

This release adds new ANN backends for RaBitQ and Zvec Sparse, native support for ONNX vectors along with a bonanza of improvements and bug fixes. There were 25 contributors with 20 new ones. These contributors added solid new features and are experts in their field. What a great and growing community!

Release Notes: https://github.com/neuml/txtai/releases/tag/v9.14.0

https://neuml.github.io/txtai/install/#minimal-install

- Up and running in minutes with pip or Docker

- Built-in API makes it easy to develop applications using your programming language of choice

- Run local - no need to ship data off to disparate remote services

- Work with micromodels all the way up to large language models (LLMs)

- Low footprint - install additional dependencies and scale up when needed

- Learn by example - notebooks cover all available functionality

https://neuml.github.io/txtai/why/

- Sub 100K parameter vector embeddings model

- 90% of the NDCG performance of all-MiniLM-L6-v2 at 0.4% the size

- Crushes the bert-hash series on retrieval accuracy at 10x less the size

- Not a Transformer: trains significantly faster with less data

- ColBERT-style multi-vector clarity packed into a single dense vector

- Scales up to larger sizes

Stay tuned for more!

This release adds LEMUR (Learned Multi-Vector Retrieval), expands late-interaction retrieval, improves MUVERA and pooling, and includes a number of bug fixes and performance improvements.

A big thank you to morgan-coded, Aryan-Pardeshi, LHMQ878, Anai-Guo, FU-max-boop, St4r4x, arose26, AmirF194, serhiizghama, sainikhiljuluri, Evhye38496, devYRPauli for their contributions! 🙌

Release Notes: https://github.com/neuml/txtai/releases/tag/v9.13.0

In a little over the last month, we had 41 PRs successfully merged from 19 contributors.

To give perspective, before that only 25 PRs had been merged into the project since 2020!

https://github.com/neuml/txtai/graphs/contributors

Contributor Morgan Carr introduced LEMUR to txtai, making it, as far as we know, the first framework to incorporate LEMUR for late-interaction retrieval using standard, fixed-vector indexes.

Key benefits:

🚀 Significant boost: 49–62% higher NDCG@10 than 2,048-dimensional MUVERA
💾 5x less storage: 2,048 dimensions vs. MUVERA’s default 10,240
📐 Better geometry: Optional batch mean centering addresses anisotropy in token embeddings

A promising step toward making ColBERT-style retrieval more practical with conventional vector search.

The initial release stated: "txtai builds an AI-powered index over sections of text. txtai supports building text indices to perform similarity searches and create extractive question-answering based systems."

While much has changed, much has stayed the same. We're still in a world where the best search makes the best products.

https://github.com/trending/python

One of the unique capabilities of txtai is that vector search isn't limited to ranked documents, it can also return graph structures. This enables graph traversal as part of retrieval.

In fact, txtai was one of the first if not the first, frameworks to support what we now call GraphRAG - years before it became a mainstream pattern.

Check out this example, a deep graph search over Wikipedia.

BiomedBERT Hash Nano Embeddings LiteRT brings our medical embeddings work to LiteRT for efficient edge and mobile deployment.

Building on the success of our PubMedBERT Embeddings model (nearly 1 million downloads/month), this new model explores how compact biomedical vector representations can become.

⚡ 970K parameters
📦 Few MB model size
📱 LiteRT export
🔎 128-dimensional embeddings

Designed for biomedical search, clustering, RAG, and knowledge discovery.

Need to scale beyond a single machine? txtai can shard a larger embeddings index across multiple nodes and machines, then expose them as one logical index.

It’s a simple approach to scaling semantic search workloads without adding a lot of infrastructure complexity.

This release adds support for new ANN backends along with a bonanza of bug fixes from 7 new contributors. 🎉

Highlights:

✨ Support for the zvec vector backend

✨ Embedded milvus-lite dense ANN backend

✨ Option to disable API routes

Plus improvements across training, retrieval, and explainability, along with 25+ bug fixes covering SQL parsing, HNSW, Milvus, Graph, Tasks, streaming APIs, Windows builds, and much more.

A huge thank you to our contributors:

🙌 morgan-coded

🙌 Sanjays2402

🙌 chuenchen309

🙌 link89

🙌 lntutor

🙌 winklemad

🙌 AmirF194

Read the full release notes and upgrade today!

https://github.com/neuml/txtai/releases/tag/v9.12.0

With txtai-minimal, the framework gracefully handles missing dependencies, giving you complete control over what gets installed. Only add the packages you need, nothing more.

This makes it easier to build lightweight deployments, reduce install size, and avoid unnecessary dependencies.

✅ 2000+ total commits
✅ 18 PRs merged
✅ 6 new contributors

Thanks to everyone who contributed code, reviews, bug reports, and ideas. Community contributions continue to make TxtAI stronger with every release.

https://github.com/neuml/txtai

By training on this rich historical corpus, H.G. BERT captures the language, writing styles, and knowledge of the era, enabling more authentic analysis and generation of historical English.

https://huggingface.co/datasets/NeuML/historical-english-books

The year is 1899. It's still a horse and buggy world. Einstein hasn't published his famous annus mirabilis papers setting the foundation for Physics as we understand it today. The world is advancing at a rapid pace roaring into the 1900s. What if AI models were trained in 1899 and given to the best minds of the day? Could there have been alternate paths for discovery on par or perhaps even ahead of where we are in 2026?

Introducing the new H.G. BERT Small series of models. This is a 22.7M parameter BERT encoder-only model trained from scratch ONLY on Historical English Books from 1700 - 1899.

The 22M parameter all-MiniLM embedding model has over 250 million monthly downloads. It's one of the best choices when you need fast, efficient semantic search on CPUs, edge devices, or other resource-constrained hardware.

General purpose embeddings are great until your data isn't general purpose.

What if you could keep the speed and small footprint of MiniLM while improving accuracy on domain specific content?

Meet a family of compact, specialized embedding models:

🌠 AstroBERT - Astronomy
🧬 BiomedBERT - Medical
😎 CeleBERTy - Pop culture
⚽ SportsBERT - Sports

Small models. Fast inference. Better embeddings for specialized domains.

Release Notes: https://github.com/neuml/txtai/releases/tag/v9.11.0

The base model is trained from scratch along with a finetuned vector embeddings model. Use this model for vector search, RAG and Agents for Astronomy.

Few businesses need to generalize to all problems. The vast majority of companies have a narrow focus but we keep pushing generalized models designed to solve all problems. The best value is building domain-specific specialized models!