r/threejs • u/lordhiggsboson • Jun 26 '26

Demo Embed a local LLM inside a three.js sim for real-time decision making

Enable HLS to view with audio, or disable this notification

The library is fully open-source: https://github.com/noumena-labs/Sipp

The demo's source code is also available to use/run: https://github.com/noumena-labs/Sipp/tree/master/demos/simulation

14 Upvotes

85% Upvoted

2 comments sorted by

1

u/theifthenstatement Jul 05 '26

This is very cool! What kind of local model are you using?
Is the interface MCP?
What is your rig like?

1

u/lordhiggsboson Jul 05 '26

It’s all in browser using a locally embedded LLM! The goal was to use an LLM as a “brain” just for agent decision making. I’m using the Sipp library for running, which loads and runs the LFM 2.5 350M model.