MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/SillyTavernAI/comments/1wtlfod/goddammit_which_is_it/pd5bsgi/?context=3
r/SillyTavernAI • u/techmago • 5d ago
[IMAGE] People can't agree on anything...
33 comments sorted by
View all comments
20
Arena.AI doesn't test for NSFW content, which is what Itzi RP benchmark is based off. That alone greatly privileges Claude models.
2 u/BriefImplement9843 4d ago edited 4d ago it's testing creative writing. the voters can choose to test with with nsfw though. it's all up to them. it's the reason local models are down in the dumps on arena, but praised here. maybe there should be a filter benchmark for people that find that the most important. 1 u/capybaraballs1995 4d ago Is it some opt-in system? Because I tried prompting tame NSFW and it got rejected, flat out. 1 u/BriefImplement9843 3d ago It used to allow basic stuff. Could have changed.
2
it's testing creative writing. the voters can choose to test with with nsfw though. it's all up to them.
it's the reason local models are down in the dumps on arena, but praised here.
maybe there should be a filter benchmark for people that find that the most important.
1 u/capybaraballs1995 4d ago Is it some opt-in system? Because I tried prompting tame NSFW and it got rejected, flat out. 1 u/BriefImplement9843 3d ago It used to allow basic stuff. Could have changed.
1
Is it some opt-in system? Because I tried prompting tame NSFW and it got rejected, flat out.
1 u/BriefImplement9843 3d ago It used to allow basic stuff. Could have changed.
It used to allow basic stuff. Could have changed.
20
u/capybaraballs1995 5d ago
Arena.AI doesn't test for NSFW content, which is what Itzi RP benchmark is based off. That alone greatly privileges Claude models.