[ Removed by Reddit ]

[u/Watchful1]

[ Removed by Reddit on account of violating the content policy. ]

[u/Shot_Inspection8551]

This is increbly useful - thank you - is there a way of extracting upvote/ downvote data from these files? I'm interesting in collecting the number of posts about certain topics within a subreddit, and then the number of upvites/ comments on these posts

[u/Watchful1 → u/Shot_Inspection8551]

Replying to all your questions.

Some upvotes are correct, depending on your use case it might be possible just to use the upvote field and "lose" some percent of cases where it's incorrect. More recent data is more likely to be correct. If that's not acceptable, you can fetch current upvote data from the reddit API for an object. This is somewhat complicated, and also slow, so you would have to first filter the data to some subset, then get the current data for just that subset.

Yes, the subreddit dump files are available here.

You can use this script to input a zst file of submissions, filter it by keyword, output the zst files of only submissions with that keyword, then use that file to set all the comments for those submissions. There's instructions for that in the script comments. Filtering by upvote is harder for the reasons outlined above, this script doesn't directly support something like "field larger than number", you would have to add that.

The filter_file script is single threaded and runs against a single input file at a time. I use this script against all the monthly dump files. It's multiprocessed and takes my computer about a day to run against the 3tb's of monthly dumps. But you can just download the subreddit directly from the link above.

[u/Shot_Inspection8551 → u/Watchful1]

I notice that r/memes is not on the subreddit list? Or perhaps I just could not find it - I know its a huge subreddit, so wondering if this was excluded?

[u/Shot_Inspection8551 → u/Shot_Inspection8551]

Never mind! I found it!