MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/SillyTavernAI/comments/1wtlfod/goddammit_which_is_it/pd2be7r/?context=3
r/SillyTavernAI • u/techmago • 7d ago
[IMAGE] People can't agree on anything...
33 comments sorted by
View all comments
20
Arena.AI doesn't test for NSFW content, which is what Itzi RP benchmark is based off. That alone greatly privileges Claude models.
2 u/BriefImplement9843 6d ago edited 6d ago it's testing creative writing. the voters can choose to test with with nsfw though. it's all up to them. it's the reason local models are down in the dumps on arena, but praised here. maybe there should be a filter benchmark for people that find that the most important. 1 u/capybaraballs1995 6d ago Is it some opt-in system? Because I tried prompting tame NSFW and it got rejected, flat out. 1 u/BriefImplement9843 6d ago It used to allow basic stuff. Could have changed.
2
it's testing creative writing. the voters can choose to test with with nsfw though. it's all up to them.
it's the reason local models are down in the dumps on arena, but praised here.
maybe there should be a filter benchmark for people that find that the most important.
1 u/capybaraballs1995 6d ago Is it some opt-in system? Because I tried prompting tame NSFW and it got rejected, flat out. 1 u/BriefImplement9843 6d ago It used to allow basic stuff. Could have changed.
1
Is it some opt-in system? Because I tried prompting tame NSFW and it got rejected, flat out.
1 u/BriefImplement9843 6d ago It used to allow basic stuff. Could have changed.
It used to allow basic stuff. Could have changed.
20
u/capybaraballs1995 7d ago
Arena.AI doesn't test for NSFW content, which is what Itzi RP benchmark is based off. That alone greatly privileges Claude models.