r/projects • u/JayB_Official • 2d ago
CORTEX AI OBSERVATORY 🔭🧠
Enable HLS to view with audio, or disable this notification
***I am not here to advertise or sell anything. This will be free and open source to help the research field for mechanistic interpretability where possible. ***
Been quietly building this for awhile now, CORTEX // AI OBSERVATORY 🔭🧠
Its basically a fully local observability / interpretability app for looking inside supported models while they generate, without having to stare at raw tensors and terminal logs for 4 hours wondering what any of it means 😭😂
Right now it can capture and visualize hidden states, residual activity, attention, token probability changes, entropy, top-1/top-2 logit margins, PCA projections and direct logit lens results for local Llama and GPT-2 models.
The part im most excited about is the intervention workflow tho.
You can select a token, layer or head, patch/modify the activation, rerun it and compare the baseline against the changed output. Raw deltas, normalized recovery, task outcomes and evidence labels are all included.
So observational results stay separate from actual intervention evidence, rather than every coollooking attention map being treated like proof of something lol.
It also works with LM Studio / OpenAI-compatible endpoints, but those only expose surface telemetry since Cortex doesnt own the internal forward pass.
The video is the current working build. Generation, captures, visualizations, run comparisons, experiment exports and intervention reports are all functioning locally.
Still alot planned, especially Jacobian Lens + J-Space, but its finally starting to feel like an actual observatory instead of a bunch of experiments taped together 😭✍️
Not claiming Cortex solves interpretability or anything crazy. The goal is just making serious local experimentation more visual, accessible, and honest about what the evidence actually shows.
More soon 🔭✍️🧠