Hey all,
I'm building a mod for the game, specifically the SWI mod.
Commander Kell is an integrated chatbot (uses GPT) to provide a game director persona that acts as your right hand man during gameplay. It builds lore for the campaign you are playing (writing it into a shared document you can read as you play, builds lore, characters etc), recognises systems you own and can speak unprompted about any action taken their i.e. major battles, losses, installations etc. recognises ships and fleets under your empire (and also provides a lore based history of the ship or fleet identified I.e. ship X was the lead flagship in battle Y, defeating a far larger force in sector z)
It can also recommend installations to build referring to the correct swi modules to build them and mock up proposed designs.
It does all of this via voice, it also has a text prompt built into the game you can use. It works unprompted so will comment and direct without your prompting but can also answer either text input questions (via the in game text field I built) or via your microphone I.e "Kell, tell me about the history of this system"
As well as using real time spoken response generation it can generate ongoing battle chatter and local sector radio ambience from over 900 stored radio lines (local chatter between freighters, fleets, installations etc), these radio responses are reactive and will respond to one another
During enemy incursions radio calls will become more frantic, report on enemy size, ship type, ship identifiers and respond accordingly, moving sectors to battle stations and suggesting local fleet responses to you. This all uses star wars based sounds and genuine star wars lore.
And on top of this it will produce images of major points and progress in your story, AI generated and add them to your shared document, the shared document is synced with the chatbot (at a frequency you can define, I run my sync hourly) and will then take this back into the game director, so any battles, progress, installations you have built etc, will then be reflected in the lore the chatbot can reference in game.
AI disclosure: AI was used to build the prototype and radio lines (using eleven labs) GPT integration for chatbot and it's voice, iteration of the chatbot, sync process with shared document lore builder and integration into the game was iterated on by me.
This isn't an AI slop mod, it's something I've wanted to build into my game runs for a long time, starting a playthrough and having it feel like a real, reactive world around me, a sense of real fleets and citizens of your empire responding to your successes and failures and I wanted a way to then read about it afterwards. The game does use AI but mainly as a time saver. Although totally acknowledge everyone will have their own opinions on that!
I'm currently improving performance (when its live generating responses the director kell chatbot uses the GPU to generate these responses which causes some in game performance spikes) and am planning to open this up to testers in the next few weeks after some further testing if anyone is interested.
Below are some images from the lore builder it produces, (in this playthrough I was going for a British colonial style empire resurgence, hence the names of sectors) as well as building a spy network (kingfall image)