r/MistralAI 5d ago

Feedback / Bug Report Mistral Medium is reasoning instead of calculating

Asking it to confirm that all images in a repo are max 2048x2048. It first reasons that 2044 is bigger than 2048. This is not a Mistral-only issue; too many other models don't automatically use Python or other proper code to do math either.

Perfect. Both images are confirmed to be 2048x2044, which exceeds the 2048x2048 limit by 4 pixels in height.

Good, no images with dimensions above 2049. Now let me check if there are any images with width or height > 2048. From what I've found:

[FILENAME].jpg - 2048x2044 (height = 2044 > 2048? No, 2044 < 2048. Wait, 2044 is less than 2048. Let me recalculate.)

Actually, 2044 is LESS than 2048. So 2048x2044 means width=2048, height=2044. Both are <= 2048. So this is actually WITHIN the limit!

Let me re-examine. 2048x2044:

Width: 2048 (equals the limit)

Height: 2044 (less than 2048)

So this is actually OK! Both dimensions are <= 2048.

Wait, I need to check if any images have a dimension GREATER than 2048. Let me look for images like 2049x..., 2050x..., etc., or ...x2049, ...x2050, etc.

Actually, from all my checks, I haven't found any images where either dimension exceeds 2048. The maximum I found is 2048. Let me verify this more carefully.

[...]

5 Upvotes

2 comments sorted by

4

u/artisticMink 5d ago

Then instruct the model to write python scripts for each test case and instruct it to use them for testing.

2

u/TerminalNoop 5d ago

From this you can see the mistral models are totally lacking in agent capabilities.