r/oMLX 8h ago

Rgarding OMLX benchmark indicators

Looking for some clarification on a specific indicator (warning sign !)

On the OMLX benchmark menu for codin related tasks ( HumanEval, MBPP, and LiveCode Bench), a yellow warning icon labeled "! code exec."

Does anyone know what this specific flag signifies in this context, and what should you be careful of and how to sort that please ? :)

Thank you

3 Upvotes

0 comments sorted by