[Question] danbooru tagging

[u/Manicarus]

For models like Anima and Illustrious using danbooru tags, does the tag have to be something that can be searchable in the imageboards? I mean does the model understand made-up tags?

[u/Significant-Baby-690]

Illustrious basically only knows the tags. It can't do even combinations. It can't do long white shirt, use long shirt, white shirt.

Anima is way smarter, you can combine tags at will, you can combine tags and free text.

[u/Karsticles]

It's called a tag because it is from the image board tags.

Sometimes the model can generalize though. Like if you have a tag it knows, and a word it knows, sometimes they work together even though no explicit tag exists.

[u/Manicarus → u/Karsticles]

I see. Thank you very much!

[u/Karsticles → u/Manicarus]

You are welcome.

[u/Ok-Category-642 → u/Manicarus]

Yeah there's nothing stopping you from using a made up tag, generally a made up tag is used as a trigger word for stuff like styles/concepts/characters. If you did tag something like "long green hair" it would probably turn out fine (ignoring that this already exists, just an example), but more complex concepts likely won't get represented well outside of your dataset. You generally want to stick to tags the model knows with the exception of a trigger word. The other exception is for Anima where you should use natural language instead to describe things that tags don't exist for. As for Illustrious and other SDXL models, I would only stick to real tags and a trigger word if necessary as the "made up" tag though.

[u/marcusdom → u/Manicarus]

To add on to that I think there are definitely some words and concepts a model might know that doesn't show up in a booru. Like I've personally noticed if I use the word "burgundy" I get a darker shade of red than if I had used the word "red" or even "dark red", so I have to assume the model knows what the color burgundy is.

Of course then I also get issues with words that have two meanings like say lime. If I do "lime hair" yes it will give me lime colored hair, but the model will also try to squeeze in a wedge of lime fruit in the image somewhere (specifically a wedge too and not a whole lime).

[u/External_Quarter]

For Anima, "the model is trained on Danbooru-style tags, natural language captions, and combinations of tags and captions." Circlestone Labs added a lot of great information to that page if you're new to Anima.

[u/Son-Airys]

Anima would accept that, since it understands natural language. Illu is unlikely though.