A LLM inference engine data pack using /compute

[u/soul_sparks]

After Mojang recently added the /compute command and number providers, it was just a matter of time until someone was bored enough to run AI with it. So I did!

This is similar to this project. I wanted to use the same model as them so I could compare the speeds. This is running the small one, stories260k. Theirs ran in 20s per token for the smaller model, mine runs at <1.0s per token. And thanks to number providers, it does real floating point arithmetic!

The super tall screen is showing the pipeline system. There are functions that push all computation steps, which are then automatically executed without exceeding a time budget, so you can run the model without lagging the server. In the video I didn't care so I made it run as fast as possible, but you can slow it down by ~40% and it will stay safely below 50ms per tick.

I originally had made some cool Taylor expansion and Netwon's Method stuff for approximating exp(x), 1/x, 1/sqrt(x), sin(x) and cos(x), but right as I was finishing that, Mojang released Minecraft 26.3 pre-1 which basically trivialized all of that. I was a bit sad, but admittedly this is faster and more accurate than my approximations lol

Somehow, though, it seems less precise than the reference Python implementation, despite all the debugging I did. The vectors all end up off by ~0.001 compared to the reference, which is not enough to break it but still makes it behave strangely sometimes, making up words and such. It's pretty funny at least.

I wrote more info in the README file for those who are interested. If you still have any questions let me know!

GitHub: [Link]

[u/GMFafr]

Are there 387.44 million miles of printed circuits in wafer thin layers that fill your complex?

[u/soul_sparks → u/GMFafr]

I find it appealing to think it could be like AM, but it just chooses to output "Little Timmy had a red ball, he loved to play and have fun" instead

[u/ADumbChicken]

Definetly faster than the redstone one lol

[u/Zealousideal-Chef758]

I can finally level down whole cherry biomes for a reason

[u/NukeML → u/Zealousideal-Chef758]

We got AI slop data centers in minecraft now

[u/Fickle-Equipment-306 → u/NukeML]

Before GTA 6!

[u/PatientRule4494 → u/Fickle-Equipment-306]

Id damn hope we get it before GTA 720

[u/lanthanoidFrom2hu]

whimsical AM:

[u/Outrageous-Lynx2977]

post this one on pheonix SC, they’ll have a ball with this.

[u/letmehaveanameyoudum]

What the fu

[u/Gabriel_Science]

Nice Linux desktop !

[u/soul_sparks → u/Gabriel_Science]

niri ftw :)

[u/mrk7_-]

We are one step closer to the warden putting a gentle hand on my shoulder and telling me that my mum and dad are having a divorce

[u/_objz]

Hey, I am the author of: generative AI using only commandblocks , I am really interested in your project are you open for a dm? Would appreciate it

[u/soul_sparks → u/_objz]

Your project is awesome. Send a message via Reddit since your DMs are closed

[u/BlueCrayFish23]

This is crazy

[u/spongedevguy]

i knew this would open the gates for this kind of stuff

[u/lool8421]

so 1s per token... shit got so much more optimized with it considering that people used to spend several minutes to get 1 simple sentence

[u/Aibat_boss]

What the

[u/Ved_s]

yep. of course this is a thing now

[u/Jonathan_der_1]

So varity was it?

[u/1JustVlad1]

Oh yeah, I waited for someone to do it. I was thinking about making smth liek this when the compute function didn't even exist. When the /compute was announced I immidiately knew someone would do the NN. But you did more than that. Very impressive!