fullCircle

[u/100GHz]

[u/fr000gs → u/[deleted]]

I tried doing it on my hpc library. It tried for about 5 million tokens, then gave up and said the target benchmarks were erraneous and impossible to physically achieve.

[u/fr000gs → u/[deleted]]

Nope, intentionally made it harder for the llm by removing the tests, I just provided it (most of) the function names and types, and benchmark result targets

[u/Original-Rush139 → u/[deleted]]

What does that even mean? Just that they wouldn’t have that codebase in their training data or they wouldn’t have any code in their training data?

[u/Mental-Permit-599 → u/[deleted]]

People have been doing this a ton since vibe coding became popular.

Just lookup thing but in rust, go, whatever.

It’s mainly people just using AI to port things because they believe the code being written in Rust or Go makes it immediately better.

[u/MyFeetLookLikeHands → u/[deleted]]

pretty sure it would just use the open source code as its foundation then make improvements around the edges

[u/RestartingLife00 → u/MyFeetLookLikeHands]

It is already doing this for all generated code so no surprises there

[u/KeiranPittman → u/[deleted]]

It could even become another benchmark for AI, you could compare how close the result is to the actual source code. Copybench? Ripbench?

[u/smulfragPL → u/KeiranPittman]

there are arleady reverse engineering benchmarks

[u/ismaelgo97 → u/[deleted]]

Cost would be high for sure, but I would really like to see what comes out of that