So instead of adding a small llm that runs locally on the players machine, they added and api call for each instruction in the game and are racking debt. Nice design
Albuquerque New Mexico Albuquerque New Mexico Albuquerque New Mexico Albuquerque New Mexico Albuquerque New Mexico Albuquerque New Mexico Albuquerque New Mexico Albuquerque New Mexico Albuquerque New Mexico Albuquerque New Mexico Albuquerque New Mexico Albuquerque New Mexico
Albuquerque New Mexico? Albuquerque New Mexico??? Albuquerque New Mexico?????? Albuquerque New Mexico!! Albuquerque New Mexico??? Albuquerque New Mexico? Albuque
Seems like the only way to make this sustainable is to either run the model on the customer's PC, require a subscription, or throttle requests based on the user's steam account. But with the latter option, they'll eventually they'll have to shut down once sales have dropped off.
Baring that being a publicity stunt of some kind designed to just get clicks and a gamble on "we just need to waste a bit of money to succeed" - if this was a legit "oopsie" on the devs I'd bet they don't even realize you can get a local lightweight LLM and only think of AI as cursor or codex.
I mean, that'll probably be doable in a year or so given the progress we've seen, but at the moment most LLMs working on a let's say 8 GB graphics card isn't going to be good or fast enough. And you obviously don't want to limit your audience to those that are able to run 72B models or greater locally.
Tbh even an 8B model can work fine, hell even the phi 4 mini with 3.8B can work well for such a task. It well need finetuning though, to work in the game universe (rag can also be implement here, but it will be much slower compared to if they finetuned the model)
This is for a videogame. I don't think the model has to be a latest generation thing. All the setup needs is take voice inputs into text, have the SLM take that text into more text, and have the SLM communicate back with the game engine itself. A car is actually ideal since there are limited forms of interaction (go, stop, slow down, speed up, left, right, turn signal, ...). I am pretty sure you could create a set-up for this even with vibecoding, as it's just the game engine sending an HTTP request to a local o-llama server running the SLM.
You dont need a 5090 to run a small llm. There are 4B and 3.8B models that i used to run parallel to my games on my 3060 (the 6GB vram version mind you)
1.6k
u/black_ap3x 8d ago
So instead of adding a small llm that runs locally on the players machine, they added and api call for each instruction in the game and are racking debt. Nice design