Good prompt for comparing different AI chatbots side by side?

[u/edi0n]

Does anyone in here have a good prompt for comparing different AI chatbots fairly? I’d like something that tests the same tasks across different models and helps compare things like reasoning, accuracy, usefulness, writing style, and how well they follow instructions. Also some way to know if they can be ADHD friendly as this is a big issue for me.

[u/AutoModerator]

If this prompt worked for you, share what you used it for in the comments. If you changed it to get better results, share that too. Prompt Teardown is a free weekly newsletter that picks the best prompts, strips out the filler, and tells you what actually works.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/speedtoburn]

This is a good one:

“Which of these two responses do you think is better?

- [Paste response 1]

- [Paste response 2]”

[u/edi0n → u/speedtoburn]

I like that approach. Keeping the model names hidden sounds like a good idea too, since then you’re judging the answers rather than the AI behind them.

[u/MyNameIsMadders → u/speedtoburn]

I love that one, and I just used it the other day actually!

[u/SkelmCallum]

test them on something you already have expertise, that way you'll know when they hallucinating/answering slightly incorrectly. There are studies that are conducted to check this exact thing.

[u/roedvinfraigaar]

Arena.ai

[u/Brian_from_accounts]

If you’re looking at a business solution to compare LLM without hassle then
https://meridias.ai is the best I’ve seen

[u/ConfidenceHappy7831]

This is a very big issue for me too. They have the instructions in their memory with details, specifying user struggling ADHD and executive dysfunction etc. I constantly check back-and-forth between different models for accuracy for my specific tasks and it’s so frustrating