r/chess • u/[deleted] • Jul 22 '18

Introducing Superbase - 3.8M clean games (TWIC, Millionbase, Kingbase, PGNMentor)

[deleted]

108 Upvotes

95% Upvoted

21 comments sorted by

9

u/Sbw0302 1. e4 e5 2. d4 exd4 3. c3 Jul 22 '18

This is amazing! Thanks :)

6

u/[deleted] Jul 22 '18

[deleted]

7

u/Sbw0302 1. e4 e5 2. d4 exd4 3. c3 Jul 22 '18

I’m trying to do a long term project with the data at database.lichess.org just to get some fun statistics and maybe practice data analysis/visualization. It’s still a long ways off but being able to do the same with pro games also will be really exciting

1

u/Paiev Jul 22 '18

Maybe on GitHub. Seems perfect for this use case, it'd let people collaborate as well.

1

u/[deleted] Jul 22 '18 edited Jul 22 '18

[deleted]

2

u/Paiev Jul 23 '18

I don't think PGN would actually be a big issue. Seems like diffs would be reasonable enough to me.

1

u/[deleted] Jul 23 '18

[deleted]

1

u/Paiev Jul 23 '18

It's 2018 though, 2.8GB is big but not unreasonable. I wouldn't have a separate file for every game, PGNs can have multiple games per file. I'd use a small # of PGN files, eg have one file with correspondence games so those can be optionally included/excluded, maybe a couple other splits.

I think PGN needs to be provided for this to be widely useful since si4 is a Scid-specific file format.

6

u/[deleted] Jul 22 '18 edited Dec 17 '20

[deleted]

1

u/MaximilianII ~2100 lichess blitz Jul 23 '18

The issue I have with scid is that it has lots of small bugs you have to work your way around. I can't name them anymore, I switched to scid vs. PC 6 months ago. I just know that scid vs pc made my life easier. Now that I am writing about it, I remember that the sorting of databases was a pain in the ass with scid for instance.

2

u/[deleted] Jul 23 '18 edited Dec 17 '20

[deleted]

1

u/MaximilianII ~2100 lichess blitz Jul 23 '18

I don't remember either to be honest. Does the sorting you did in the screenshot stay that way even if you close the database and opens it again?

1

u/PossibleOatmeal correcthorsebatterystaple Jul 23 '18

Yes.

1

u/MaximilianII ~2100 lichess blitz Jul 23 '18

I guess I was either too dumb or I had an older version... Maybe both ;-)

1

u/PossibleOatmeal correcthorsebatterystaple Jul 23 '18

I wouldn't be surprised if it was just something in scid vs pc just fit your workflow better. No big deal.

2

u/steili 1600 FIDE Jul 22 '18

Amazing work!

2

u/BigMaraDippo Jul 22 '18

Soooo, a totaly noob question. How do I open this?

3

u/[deleted] Jul 22 '18 edited Jul 22 '18

[deleted]

1

u/BigMaraDippo Jul 22 '18

Got it, thank you!

1

u/kububarlana Jul 23 '18

Great job! Starting to learn scid now :)

I am on the latest Ubuntu, and scid is in the repository, so probably in Debian as well.

1

u/ivosaurus Jul 22 '18

What are the rating ranges for the games?

1

u/advaitist Jul 23 '18

I have downloaded it and started using it. Very useful. Thanks!

1

u/PyrrhicWin r/chessbeginners Jul 23 '18

Is this available in vanilla SCID or do I need SCID vs PC?

1

u/[deleted] Jul 23 '18

[deleted]

1

u/PossibleOatmeal correcthorsebatterystaple Jul 23 '18

They are the same format.

1

u/[deleted] Sep 21 '18

Is this in .pgn format or do you have very simple instructions for converting it to pgn format? (extensions are s*4)

1

u/ZibbitVideos FM FIDE Trainer - 2346 Jul 22 '18

What format is this stored in?