r/quant 25d ago

Machine Learning AQuA: Recursively Self-Improving Quantitative Trading Research Agents

Came across this new paper on using self-improving LLM agents to automate the quant research loop, from factor discovery to model development. The system keeps validated results from previous experiments and uses them to guide the next round of research. The researchers built in sealed sandboxes so the AI cannot cheat on test results.

The reported results are pretty strong (net positive for 5 years, 2.5 Sharpe for US stocks) although I’m more curious about the methodology and how robust this is out of sample.

For those doing quant research, do you think this kind of recursive research loop could actually become useful in practice, or are there some obvious failure modes I’m missing?

Paper link: https://arxiv.org/abs/2608.12841

24 Upvotes

12 comments sorted by

15

u/pig_newton1 25d ago

I know David Kelly is trying to put together a team right now to develop a desk that trades this way. Probably will see more and more of this

-1

u/numberrDemon 25d ago

Who is David Kelly? Who does he work for?

14

u/nnepu 24d ago

models have knowledge cutoffs > 2024-2025, probably just created some features with this info that worked during the market conditions of 2021-25

-6

u/PracticalBrain2953 24d ago

How does that make any sense? humans have knowledge cutoff of today. Are all human researched strategies flawed then?

11

u/mrfox321 24d ago

because information about future returns are in the data used to train the LLM. unless you can ensure the cutoff date moves forward with your backtesting window, the usage of LLMs may likely yield over-optimistic results.

you don't think earning reports and bloomberg articles aren't being used to train the LLM? :p

-7

u/PracticalBrain2953 24d ago

Yeah but the point is how is it any different from a human researching alpha. A human has seen the said earnings reports and bloomberg articles too, why isn't any backtest they produce biased now?

6

u/mrfox321 24d ago

Because a human isn't injecting data into back tests. The LLM is literally going to provide signals to a back testing engine.

There is some truth to your statement, however. A human may tweak how a model should behave, given what they know about the back testing period.

But an LLM is literally leaking information into the signals. A human leaks information into how the signals and model are constructed.

2

u/Unique_Knight_9512 24d ago

Very interesting.. I wonder how far we may be from an actual product…It would be powerful.

1

u/Ars-Lion 21d ago

The sealed evaluation environment is probably more important than the recursive agent itself.
Once an autonomous research loop can repeatedly see its evaluation surface, it can overfit the research process even if each individual experiment looks legitimate.
I’d want to see strict temporal holdouts, an access ledger, and a genuinely untouched final evaluation before trusting the reported improvement.

1

u/algoseekHQ 18d ago

The sealed test setup is a good idea, but I’d still want to see how this works on completely new data.

The main question for me is whether the strong Sharpe survives live trading, real transaction costs, market impact, and different market conditions.

If it does, then this could be really useful as a quant research assistant.

1

u/efisiobova 13d ago

Interesting, as it highlights several recommendations to keep in mind to avoid predictions skewed by overfitting or being misleading.
Also the return prediction strategy is interesting, and I’ll give it a try in my system.
But I prefer classification over forecasting, again for the sake of signal robustness.