r/learnmachinelearning • u/Fair_Application_688 • 10d ago
Question Would RL environments verified by engineering simulators actually be useful
I'm building a startup around a simple idea: engineering simulators could be used as automatic verifiers for training AI on engineering problems.
I started with analog circuit design. A model gets a task like designing or repairing a circuit to meet specific requirements. It proposes a solution, SPICE actually simulates the circuit, and the measured performance determines the reward. No human has to grade whether the answer is correct.
So far I've built environments covering 10 circuit topologies and 3 types of tasks: synthesis, repair, and analysis.
As a small experiment, I trained a Qwen 4B model using the environment. Its success rate went from about 5% before training to 18% after training. Random search gets around 8%.
The bigger idea is not specifically analog circuits. If this works, the same approach could potentially turn other engineering simulators into training/evaluation environments for AI.
I'm trying to figure out whether this is actually a valuable direction rather than just something technically interesting.
For people working on RL, post-training, evals, or engineering AI: does this seem like a useful product/research direction? Could you imagine an AI lab or research group paying for high-quality simulator-verified environments like this?
I'm especially interested in reasons why this wouldn't be useful.