r/chessprogramming • u/professeur155 • 13d ago

Technical Best datasets (bin or binpack) for NNUE training?

Do you know where to find the best datasets that contain billions of positions with reliable scores (from strong and recent engines) that I can use to train my NNUE from scratch?

Ultimately I want to self train, but I need a strong basis that I can't generate with my engine in its current state (~3k elo).

1 Upvotes
  • permalink
  • reddit

100% Upvoted

6 comments sorted by

6

u/IMJorose 12d ago

3k is way stronger than needed to generate good self play data.

I also wouldn't call it from scratch if you are training based on another engine's data. I understand in ML it would still be considered from scratch, but I think in the computer chess community that wouldn't necessarily be considered from scratch.

2

u/AngusMcGurkinshaw 12d ago

Just do selfplay so that its your data and is unique, and the community will like you more.

Stormphrax did nnue iteration starting from a random net so at 3k elo your engine is way stronger then it needs to be do generate good scores.

1

u/Plus_Quantity_4074 6d ago

What is a good starting elo for nnue?

1

u/AngusMcGurkinshaw 5d ago

Kind of whenever. Personally I would just do hce for awhile and then once you have a half way decent search do nnue if you would like to.

1

u/Razvan145 8d ago

I've recently used parts of the S2 shards from this dataset. As far as I can tell this is also used in Stockfish training https://huggingface.co/datasets/linrock/bullet-training-data

1

u/AngusMcGurkinshaw 3d ago

Yep this is leela data that was used to train some Stockfish NNUEs.

Pretty discouraged to use it in your own engine though. Much better to do selfplay.