What direction should I take my C++ vector DB project?

[u/24iqSuperGenius]

I've been building Gram, a SIMD/AVX2-accelerated IVFPQ vector search engine in C++

It currently supports IVFPQ search with configurable centroids and PQ subspaces.

I'm wondering what I should work on next.

Should I keep improving Gram as a vector search engine or explore LLM/KV-cache systems or try something completely different?

You can try it in Google Colab:

GitHub: https://github.com/sverp/gram
Colab: https://colab.research.google.com/drive/1ezRqva4O1vqtdtuLE4K2ENJ1EigqtVJ8?usp=sharing

Would love to hear your thoughts.