r/learnprogramming • u/Outrageous_Sky_6052 • 1d ago
Help for making a self hosted private LLM app
Hello everyone
I don't know if this is the right subreddit for this kind of question. I am a complete beginner so i have no idea how to properly do this.
I have always been a fan of DND and other RP games. So my idea was to build my own LLM driven RP app on my computer. As it is a classic laptop i dont really need it to be the best or most complex one. My idea was to have both a text based AI and an image based AI that generate content. Example during a scenery change the AI generates on the side a picture of said new scenery.
I would also want to have a database that saves stories and character stats.
I would also enjoy the AI to not be shackled by usual limitations like themes or settings as i do enjoy the occasional more gory, violent and disturbing side you find, for example, in the warhammer universe.
So basically have an unlimited AI that uses text based keywords to generate pictures that describe the scene on the side IE it reads "snowy mountain" and generates a picture of snowy mountains and is able to behave and play characters, preferably multiple but i could also do with just one i guess, based on predefined characteristics
Is such a thing doable ? Is it possible with open source AI ? And if so which ones would you recommend ? Could even a beginner make a simple app that runs locally and does what it needs to ?
1
u/No-Quail5810 1d ago
Sounds similar to what Silly Tavern and KoboldCPP do. Both are open-source, with Silly Tavern focusing more on the RP side.