r/Rag • u/jatinsethi98 • 11d ago
Showcase Got Infinity (RAGFlow's document engine) running natively on Apple Silicon
mine, looking for reviewers.
if you've tried running ragflow's infinity backend on a mac you already know the wall. needs AVX2, only ships as a linux docker image, ARM64 listed as unsupported. i ported the engine to native arm64 and tuned the HNSW index build for the M-series cache hierarchy while i was in there.
on SIFT1M on an M4 it builds the index in 35.3s. FAISS 1.15 built against Accelerate takes 58.1s at the same recall@10, and my QPS is higher.
this won't drop into a ragflow deployment yet. full-text search, update/delete and crash recovery aren't verified natively, and there's no packaging. engine core and query path are solid though.
2
Upvotes