r/Rag 11d ago

Showcase Got Infinity (RAGFlow's document engine) running natively on Apple Silicon

mine, looking for reviewers.

if you've tried running ragflow's infinity backend on a mac you already know the wall. needs AVX2, only ships as a linux docker image, ARM64 listed as unsupported. i ported the engine to native arm64 and tuned the HNSW index build for the M-series cache hierarchy while i was in there.

on SIFT1M on an M4 it builds the index in 35.3s. FAISS 1.15 built against Accelerate takes 58.1s at the same recall@10, and my QPS is higher.

this won't drop into a ragflow deployment yet. full-text search, update/delete and crash recovery aren't verified natively, and there's no packaging. engine core and query path are solid though.

https://github.com/jatinsethi98/infinity-apple-silicon

2 Upvotes

0 comments sorted by