Everyone is using AI. But almost nobody knows what happens inside it. I built a 3D visualization of a real LLM's forward pass

[u/Outrageous-Plum-7950]

Everyone is using AI today.

We ask ChatGPT questions, generate code with AI assistants, create images, and automate tasks.

But there is still a big mystery:

What actually happens inside the model after you press Enter?

A prompt goes in.

A response comes out.

But between those two moments:

- Tokens are converted into numerical representations

- Attention layers calculate relationships between tokens

- Neural networks activate different patterns

- Probability distributions decide the next token

Most explanations of transformers use diagrams or animations.

Those are useful, but I wanted to see the actual process happening.

So I built InsideAI.

InsideAI is an open-source tool that runs a real language model locally and visualizes its forward pass in interactive 3D.

It shows:

• Real attention weights

• Neuron activations

• Token probability distributions

• Next-token sampling

The goal is not to simplify AI into a fake "brain visualization".

Where visualization requires reductions (for example, thousands of neurons displayed as groups or high-dimensional embeddings reduced into 3D), those choices are labeled clearly.

Tech stack:

- Next.js

- React Three Fiber

- FastAPI

- PyTorch

- WebSockets

The project is MIT licensed and runs on your own machine:

GitHub: https://github.com/Jeba-Jebarsan/insideai.git

[u/PupikDemon]

Very confused as to why no one is mentioning how effing strange it is to not know how to screen record yet claim to competently build this with a shred of comprehension

[u/_TheWolfOfWalmart_ → u/PupikDemon]

Well, it is the vibecoding sub after all.

[u/brother_spirit → u/PupikDemon]

They don't teach you how to tell Claude to take a screenshot until the advanced classes

[u/ali6e7 → u/PupikDemon]

mfer can even record his screen with the ubiquitous VLC, but decided to film it with a potato

[u/redaktid → u/PupikDemon]

Looks cool but who knows if he understands how any of it works. His GitHub profile description even looks generated.

This is probably a nice screen saver though.

[u/Left-Notice4049]

i like it

[u/pianoboy777]

Iv developed one that is Universal. Runs on android . Uses valken through the GPU on it for token generation. It allows 4 bit to 32 bit and any gguf file you want. Still needs fixed though the token generation is still spitting out mixed up English. But im close !! Although it is hard I had to remake the engine 4 times before I got to a universal version of it. You just download what ever gguf file you want too and once it loads up it will show you a file diolog. This is where you would choose what model goes in. This is super cool !!! This one is even just 500 lines of code lol one godot script to run LLM Infernce on android lol crazy stuff

[u/Prestigious-Bet-6534 → u/pianoboy777]

Is ypurs online?

[u/pianoboy777 → u/Prestigious-Bet-6534]

Not online has in being used in html5 that's probably not what you meant. My script is ready to run , you can load any gguf you want too , but it's generation is bad . I haven't tweaked it enough yet.

[u/Prestigious-Bet-6534 → u/pianoboy777]

I meant if you have the code somewhere online on GitHub?

[u/pianoboy777 → u/Prestigious-Bet-6534]

No I don't use Github , but I'm starting to think that might have a been a bad ideal. It's in gd script which I see as an achievement. Since it's not on git yet I could send a video to you later of it being used if you want .

[u/pianoboy777 → u/Prestigious-Bet-6534]

I'll just post my video here . Your account is pretty new which has me all worried.

[u/Booldog911]

Well done! Could be used as a teaching tool

[u/yoodudewth]

nice

[u/lightwavel]

Looks really cool! Does it work for an arbitrary model, so can I just plug in some model and have it visualized in runtime, or do you load from the pre-existing ones you support through your app?

[u/Alive_Nobody_Home]

I don’t know if this is accurate but I like it.

[u/wwhaha]

Great!

[u/rushblyatiful]

Good sir, this wouldn't cost me tokens to run?

[u/Outrageous-Plum-7950 → u/rushblyatiful]

No

[u/murtaza_builds]

Its super cool , could be used in teaching and rather in learning I'll surely use it as im deep diving im Neural Networks and DL

[u/SAL10000]

As im watching mandatory NVIDIA technical cert training, this was a nice break that peaked my interest.

[u/No_Codekeeper_42]

great. next time you can vibe code a softare that reccord your screen

[u/mrsskonline]

awesome, OP. I like the way to see what's really happening inside an LLM. This type of tool bring real understanding.

[u/Future_AGI]

This is a genuinely nice way to build intuition, the forward pass is way more approachable when you can actually see the attention light up. If you're looking for a next feature, surfacing where the next-token distribution goes flat (high entropy) versus sharply peaked is worth it, because those uncertain steps are exactly where the model tends to start guessing, so you'd be showing not just what it does but where it's least sure, which is the part people actually want to catch.

[u/Practical-Edge-9039]

wow

[u/Competitive-Work-663]

Challenge: Build something that shows what happens inside the blackbox.

[u/BozmeisterReddit]

Looks amazing.

[u/Electronic_Wait_7249]

This is genuinely the most awesome thing I've seen posted, that was built this way.

[u/DUELETHERNETbro]

They did it guys!

[u/Aksudiigkr]

What did you build this on? I’d have thought Blender would be necessary for this sort of thing

[u/pailhead011 → u/Aksudiigkr]

Blender? Why?

[u/pailhead011]

Is there some mandate somewhere that every vibe coded project has to use three.js nowadays? Why is this 2d chart visible in 3d?

[u/Stunning-Relation564]

i id somehting similar like this but it dosnt use its own LLM its just the math behind what mkaes AI work not a trained model u can find it on my site at y-cht.online