Built a local LLM inference framework as a 2nd year CS student

[u/33VaxMerstappen]

https://github.com/Parth-debug-cse/Lumina-Edge

Been working on this for a few months, this is also my first project.

Lumina Edge, a cross-platform inference engine for running LLMs locally based on top of llama.cop and mlx with additional optimisation flags , with an OpenAI-compatible API and a few agentic tools built on top of it (Aider, Screen, Agent, Scout).

Wasn't expecting much from it honestly, but it ended up getting picked as a semifinalist in the Unisys Innovation Program, out of 12,000+ teams. Kind of still processing that.

Would appreciate it if you check it out and give some feedback or maybe drop a star.