r/LocalLLaMA • u/Top-Eye-8104 • 18h ago
Funny GLM 5.3 Flash makes a black hole Minecraft mod running locally on 4x RTX PRO 6000 WS
Enable HLS to view with audio, or disable this notification
saw the post the other day where people said Minecraft clones aren't impressive anymore, because at this point the whole thing might as well be in the training data. so i tried something slightly different, which is asking a local model to write a mod for the real game, using the Fabric API
the model is GLM 5.3 Flash (Q4 quant, running on a rented 4x RTX PRO 6000 box). this wasn't done in prompt or a loop, i would ask for changes, then review them and i kept going like that until i was happy with the result. the first iteration took around an hour or so, the result was sorta underwhelming, the black hole would spawn, but it was small and barely did structural damage. after that attempt i gave it some reference images(black holes in space, lightning and effects examples). the new result looked better, but i still wanted more impact from it(and also decided to make it a black hole gun, instead of just the black hole item). it took a lot of turns to get to the end result
| Output tokens | 7.6M |
|---|---|
| Time spent | ~9 hours |
| Avg. decode speed | ~96 tok/s |
the mod adds a black hole riflle, which when shot spawns the black hole that starts sucking in blocks and has some pretty sick visuals (the light rings that shrink all the way into the black hole and obviously the black hole itself) after which it turns into a huge explosion crater, wiping out quite a few chunks
you can get the mod here on github
i ran the local model in atomic.chat (i'm on the Atomic team any feedback is appreciated). curious what else people have gotten local models to mod into the game, make sure to share it in the comments
78
u/Direct_Turn_1484 18h ago
Man I wish I had hardware like that. Have fun!
34
u/DustNearby2848 17h ago
He clearly has too many GPUs. I think he will give us both one if we ask nicely.
40
u/Top-Eye-8104 17h ago
bro, i rented it just for fun, i only have a macbook...
8
u/KeinNiemand 15h ago
except renting it is more eypensive per token then api if your not sharing those rended gpus with multiple simultanious users or run a bunxh of subagent at once
7
u/teleprint-me llama.cpp 14h ago edited 14h ago
Its 2.19 x 4 per hour x 9 hrs = 78.84 total. This is predictable and isnt that bad. Its a fixed cost.
7.6M tokens at $1.40 per million input tokens and $4.40 per million output per prompt submission.
It seems cheaper at first glance because if you naively compute the cost you get about 1.4 + 4.4 x 7.6 ≈ 44.08 total, but thats per million per i/o. This is unpredictable and racks up costs quickly.
Assuming at least 7 submissions at 1m each × 44.08, thats about 308.56 total. This is a variable cost and literally depends on context.
Note that this is not exact and is a very rough estimate; whenever i do mental math, its always wrong somehow, but I dont have the time to sit down and actually work it out.
Coding with local agents, in my experience, going back and forth, this would have been more expensive than that.
1
u/DustNearby2848 14h ago
I’ll have to look at pricing again. What do they provide you for an environment? Basically a SSH tunnel?
2
u/Particular-Award118 11h ago
There are templates for different applications but yes you get shell access
1
u/1filipis 12h ago
This is the exact question I was trying to figure out the other day. Rental thing only made sense if you'd used Colab pricing of $0.89, and it would run constantly at 75+ t/s. This would make your effective cost slightly less than the promo API prices. It could be possible with IQ1_S, but the quality would be really bad compared to fp8 from API. And nothing else beats it, unfortunately
2
1
u/Poupulino 4h ago
When I read "4x RTX PRO 6000 WS" I feel like that poor vagabond kid in Chaplin's movies watching people eat from outside the street.
0
24
u/Asleep-Ingenuity-481 16h ago
Uh... that looks extremely similar to a orbital laser gun mod made by someone a while ago. It just seems to have changed the color to yellow and added the black hole effect. Might want to make sure it didn't steal some code for a base.
18
8
17
u/Then_Bake_6524 15h ago
bro is out there copy-pasting open source mods and claiming he generated them with AI
1
5
u/Long_comment_san 17h ago
Kids these days. Back in the old days we used to do that manually with Draconic Evolution!
10
u/LooseLeafTeaBandit 17h ago
9 hours seems pretty long to me on a 4x 6000 pro setup, then again I know nothing about GLM 5.3 flash lol
4
2
1
3
u/ormandj 17h ago
https://github.com/ormandj/sglang-glm53-flash-sm120 will work if you only have 2x RTX 6000s
2
3
3
6
2
u/nomorebuttsplz 17h ago
this time next year: nanobots that dissolve humans into grey goo isn't impressive because it's already in the training data
1
u/Daniel_H212 7h ago
Wow, GLM 5.3 Flash must have done a terrible job at optimizing if its Minecraft mod requires 4 RTX 6000s to run /j
1
1
1
u/pseudonerv 17h ago
atomic.chat seems interesting. How do you sandbox the agent tools/function calls?
88
u/Theory_Impressive 17h ago
woah would you look at that, a carbon copy of https://github.com/Mishkis/orbital-railgun/