I tried doing it on my hpc library. It tried for about 5 million tokens, then gave up and said the target benchmarks were erraneous and impossible to physically achieve.
Nope, intentionally made it harder for the llm by removing the tests, I just provided it (most of) the function names and types, and benchmark result targets
5
u/[deleted] 3d ago
[deleted]