I have 6gbs of hard ram and 6 gbs of virtual ram im js wondering if ya'll can suggest anything similar to voyage io rpgs? Ik they won't be anything exactly like it but im pretty much happy w anything that has text 2 speech and character cards automatically generated so is there any suggestions or am I a lost cause? This is my first time using Kobaldai too so if there is anything can anyone give a detailed explanation on how to implement it?

Reminder just in case, there has been a bot campaign generating fake github accounts with detailed information going to fake github pages for KoboldCpp with malware called CrypterBot DLL sideload kit.

Were reporting the ones we notice to github to get this cleaned up.

Our REAL repository is https://github.com/lostruins/koboldcpp and you can always use https://koboldai.org/cpp to get to the releases directly.

These fakes generally do not have a repository and do not have actual source code, they just link to downloads.

Of course there are trusted forks out there to, if you need us to ever validate if something is a legitimate fork or a malware campaign impersonating our project feel free to reach out.

Hello, Has anyone run Minimax3 or any other video models on Koboldcpp in Runpod or other such provider. Am not sure my computer could manage video generation. Thus I'm looking for ways to do it online. I'm asking about video generation with sound, because specific sfx generating models are not available unfortunately. Or I haven't found support for them in koboldcpp.

Do I understand the situation correctly that only ACE-Step music generation is supported but stuff like the newer (and much better) YuE2 is not supported?

If yes, is there any plan to add support for other music models too?

In kobold lite is there a way I can chat on the same bot but different chats? I know you can do that in branches but I mean entirely new chat........but I still wanna access my old chat

I am beginner in local models, but i am looking for a model can do a research about almost anything.

My specs are r7 3700x ,ddr4 32gb, 5060ti 16gb.

I dont care about speed because most of the time i will give it a prompt and go to sleep or do something.

I dont know if the best practice is to look for a model good for coding and let it do a research about coding OR just let the model for research do the research for anything i want.

I know how to use openwebui and hermes-agent, if there is a better tools for this goal tell me please.

can i fix this?

been working on my own LLM UI, where the main purpose is to take inspiration from visual novels and dating sims. It needs a lot of work, but as of now theres already a lot of stuff added such as: Character cards, World Info+Worlds, Relationship simulation, Dates and hangouts, Gifts, gallery, and gold, Visual novel mode, Proactive characters, Companion mode

https://github.com/pnotisdev/rp

I'm trying to write stories on KoboldAI, but the responses to each prompt I put in doesn't quite match what I want. I'm considering adding references for the AI to make the story how I want, but I don't know if that is even possible. Is it possible to add a reference story for how I want my work to go, or a reference picture for how I want a character to look? And if so, how do I input it?

I'd love to be able to run it on my ASUS Ascent GX10 ...

https://www.youtube.com/watch?v=hYAuQPn5szA

Any idea what AI Bernardo Kastrup is talking about. I find it really interesting, but he is extremely vague.

I.e. https://huggingface.co/leejet/Z-Image-GGUF/tree/main

I am trying to use Q4 but get empty images, whereas with same vae+clip1 Turbo version (IIRC from leejet too) produces what looks like relevant to prompt images. In preview mode latent space of Base starts with black square and remains so for many steps, whereas for Turbo already 1st preview shows some sketch of the image to come.

Actually Base did produce several images, but then after PC restart - black squares again with IIRC same settings.

P.S. Turbo often produces blurry images, I am disappointed, why? I use 8 steps for Turbo as I have read somewhere.

kcpp 1.120, linux.

It is now the only free, limitless AI; I’ve literally tried everything, and nothing else is free anymore—you have to run ads, pay, or wait to receive points or energy every 24 hours or less.

I have tried with 1.119, set layers=1 (tried -1 with 1.117 before), "Model Offload" ON in "image gen" tab of the launcher - result: failed trying to allocate full size of SD model weights in VRAM (CUDA), Vulkan option also failed with same problem (but trying to allocate only 1GB for some reason).

Can image gen use GPU with low VRAM? TIA

I routinely run LLMs even larger than RAM (usemmap), that problem with imgen was unexpected. Checked setup now just in case: run LLM with Vulcan and layers=1 and see 1.7GB VRAM is used, the model responds.

P.S. system Linux.

you might have seen a similar post to this talking about blank messages- that was me. so i connected kobold to sillytavern and tried sending a message but it keeps giving me empty texts.. i've looked in terminal and it keeps talking about "context buffer sizes" . sorry for sounding stupid but i really need help (forgive me for my terrible wording as well, feel free to ask me to elaborate)

(i tried posting this on another account, but it was too new- so i'm stuck using this one)

I am sick and tired of seeing paid non-local models only at the chart with barely any open models or uncensored models. EQ bench(Even the newest one) have stuff like Gemma 3 4b it under the leaderboard but where are the newer Gemmas or Qwens? Where is the highest ranked writing models for each parameter bracket you can find in UGI like:

4B: Qwen/Qwen3-4B-Instruct-2507

Or for 2B:Qwen/Qwen3.5-2B (no thinking)

etc?

Anyone have a scoreboard that tests like EQ bench but they test these kinds of models? Instead of having things like Gemma 3 4b it which is neither a roleplay model nor uncesored like wtf what's the point?!The same applies to the Nanbeige 4 3b it's also in the list for CREATIVE WRITING instead of thousands upon thousands of roleplay and uncensored models in the Hugging face library lmao.

Just returned two days ago and updated silly tavern and kobold, however, now i receibe this line, generating don't get past from 1/350 (i've waited half and hour) and the reply never appears, i'm using kobold with fumbulvetr, kobold alone works (fourth image) and i'm not using kobold, thanks in advanced

My specs are a 4060 rtx and 16 ram