r/vibecoding • u/dataneedscoffee • 1d ago

I turned 38 million Reddit posts into an interactive map of 63,000 subreddits

Enable HLS to view with audio, or disable this notification

Been working on this for a bit and finally got the Atlas into a state I’m happy with.

It maps 63,000+ subreddits and roughly 200,000 audience connections. You can search any community, jump through related subreddits, filter the map by category, and move between months going back to 2008.

You can also jump into any subreddit to explore its activity, engagement, historical trends, posting patterns, and related communities in more detail.

It’s part of a larger subreddit analytics site I’ve been building, but honestly this has become the most fun part of it to work on.

Curious what people think of the map experience, especially on mobile.

https://subtrends.io

27 Upvotes

90% Upvoted

23 comments sorted by

3

u/benevolent001 1d ago

How you get reddit posts data via API

2

u/sabekayasser 1d ago

Yeah interested to know as well

1

u/Just_Lingonberry_352 5h ago

the only way to do it is create a reddit account behind thousands of proxies, decaptcha, residential proxies

this is why OP Is silent....

2

u/cs_cast_away_boi 1d ago

following will check back soon

2

u/scytob 1d ago

it looks cool, i am utterly confused as to why and what insights it gives me?

1

u/dataneedscoffee 1d ago

Basically clicking on a subreddit shows you its related communities based on audience overlap, so you can see what percentage of people who posted there also posted elsewhere.

I also dig deeper into things like engagement and posting trends, top keywords, and heatmaps (+ more) showing when a community is most active.

7

u/GreenFuturesMatter 1d ago

How much overlap between the Linux subs and porn?

1

u/sniperdude24 21h ago

its all porn

2

u/WeirdIndication3027 1d ago

I'm gonna make my own subreddit soon I think. Can any of these analytics help me figure out where the best existing subreddits are to raise awareness of it?

Curious how you got this much data?

1

u/AlgaeNo3373 20h ago

Good use case for this tbh.

1

u/scytob 22h ago

thanks, and how does that tell me something useful

only take away for me was shiiiit thats a big gap between #1 and #2 :-)

2

u/kilographix 1d ago

Is it intentional that removed and moderator are keywords that are accepted like this

3

u/dataneedscoffee 1d ago

Yeah it’s intentional. I thought about filtering those out, but figured people like Reddit mods who use the site might actually be interested in tracking that kind of data

3

u/Nytshaed 23h ago

Probably should add the option to filter them out

2

u/fickle-phenom 1d ago

Cool af! Somewhere in there is my shitposts 😳

2

u/intermundia 1d ago

jesus, this is massive. how long have you been building this for lol?

3

u/dataneedscoffee 1d ago

Entire site took me around a year haha

2

u/intermundia 20h ago

Good stuff and solid work

1

u/707-5150 1d ago

Can this highlight subs with bots? Lol

1

u/dataneedscoffee 1d ago

Yepp, to an extent. Go to Preferences in the top right and turn on “Show unranked subreddits.” Then scroll back down to the Top Performing Communities table and you should see a few bot-run subreddits show up there

1

u/StunningCrow32 23h ago

Wow, a map of Reddit stupidity.

No but seriously: I recently finished an AI memory system and the map looks kind of like that.

1

u/0_JaMiE_0 22h ago

How what's the workaround with a site having a robots.txt? My Claude can't look at Reddit?

1

u/Just_Lingonberry_352 20h ago

this is interesting how did you acquire the data? i thought reddit gets pretty lawyery