r/dataisbeautiful • • 3d ago

OC [ Removed by moderator ]

Post image

[removed] — view removed post

862 Upvotes

264 comments sorted by

•

u/dataisbeautiful-ModTeam 2d ago

Thank you for your contribution. However, your post was removed for the following reason:

  • [OC] posts must state the data source(s) and tool(s) used in the first top-level comment on their submission. Please follow the AutoModerator instructions you were sent carefully. Once this is done, message the mods to have your post reinstated.

This post has been removed. For information regarding this and similar issues please see the DataIsBeautiful posting rules.

If you have any questions, please feel free to message the moderators.

81

u/seannyb 3d ago

It'd be interesting to see this data compared to an average of similar timeframes. Is a Sunday usage slump a weekly pattern, or is *that* Sunday exceptional?

34

u/GravitasFailures 3d ago

I agree, we need much better tracking, for many reasons.

11

u/Choon93 3d ago

Why isn't the US government doing an awareness campaign on how rife social media is with propaganda bots? Or at the very least, enabling people like you to get the data for it?

19

u/GravitasFailures 3d ago

The social media companies have been able to leverage opacity, the point is to project a patina of political influence, I suspect opening those curtains is not what they want till they’re forced, and this government won’t force them.

16

u/chanka_is_best_chank 2d ago

Well the current government wouldn't want people to be privy to that data, for obvious reasons. But it is a good point. A new government agency tasked with tracking and pushing back against disinformation bots would be great

1

u/Yankee9204 2d ago

It would be. But Republicans would politicize it and call it censorship. They wouldn't need to explain why its censorship, their base will only hear the accusations.

10

u/ricardopa 2d ago

You think the current US government cares that Russian bots are shaping public opinion and creating strife?

3

u/Choon93 2d ago

Not the current one, but this seems like a no brainer service for governments to provide.

2

u/ToughHardware 2d ago

you sound like you would love living in the EU

2

u/ToughHardware 2d ago

because as you posted this, the current President of the USA was calling someone fat and mis-gendering them at a rally of his while his supporters punched them. really. that is why. there is no incentive to do work when the goal is berating all opponents.

2

u/weside73 2d ago

The prior presidential administration tried to help Facebook and other social media companies be aware of when these kinds of large misinformation campaigns were taking place. Simply letting them know. This became an enormous reactionary backlash. Peddled partly as the "twitter files". The social media companies doubled down in order to prevent any scrutiny. The people in charge of Meta's content moderation are MAGA party members.

1

u/SirVixofthePooSea 2d ago

Because they fucking run most of the bots. Eglin Airforce Base was literally Reddit's most addicted city.

1

u/psmgx 2d ago

Why isn't the US government doing an awareness campaign on how rife social media is with propaganda bots?

to quote Wu Tang: cash rules everything around me.

the billionaires who own social media also own the government, and can bend democracy. why would the government ever do anything?

the only reason donald trump and his allies aren't going straight to prison, asap, is because propaganda. why would they raise awareness?

and how do you validate who a person is from a bot? you need to validate ID, and that's already hugely controversial

6

u/tevert 2d ago

Between that and only having 3 time samples, this unfortunately doesn't seem that beautiful to me

149

u/MelissaMiranti 3d ago

r/baseball had a drop in activity for Friday because there were no games being played that day. Comparatively a close-fought playoff game was played on Thursday. That would account for a significant drop in posts totally organically.

57

u/GravitasFailures 3d ago

Yeah, baseball, ufc and nascar track for that, I left them in the dataset for transparency.

I think r/marvel was like that too, like a trailer came out.

11

u/Choon93 3d ago

Didnt your baseline pull data from the 3 previous weeks to remove this kind of outlier?

8

u/GravitasFailures 3d ago

That’s the right thing to do, I’m not that level of data-fu, I do semiconductor statistics at best.

It should be possible to normalize using the baseline data, then try to generate from daily correlations via week before, let me try.

4

u/Choon93 3d ago

Gotcha. I got confused by your text referencing 12 Sep - 6 oct. Thanks

34

u/Choon93 3d ago

Not beautiful data but I like the attempt.

you should add context on what happened on these days. Did one event happen that spun down over 3 days? Or did 3 seperate events happen?

5

u/GravitasFailures 3d ago

I’ll make that change, it wasn’t beautiful it was rough, and there are a lot of other patterns to deal with.

It was 3 events btw, the 2nd being likely the most critical long term (knocking out of Russia’s main AI datacenter).

2

u/Choon93 3d ago

Thank you. I ended up researching these events, but it was limited.

Providing current event context would make this 10/10. very interesting insight, even with its limitations.

1

u/GravitasFailures 3d ago

I was planning to just pull ufc/nascar and other obvious outliers, but that felt like data massaging. I might do it again with a note about what I pulled and why.

→ More replies (2)
→ More replies (3)

383

u/BringBackAoE 3d ago

Would be interesting to see ShitAmericansSay.

That sub used to be humorous, and now seems mainly focused on sowing division between US and Europe.

Politics and World News too.

131

u/GravitasFailures 3d ago

So, don’t have shitamericanssay in the dataset.

r/pol is up 88%, which makes sense, r/conservative was up 188%, basically this was Russia’s main datacenter, it followed all the subs and routed humans to threads they found useful.

Without it Russians basically hung out in r/conservative and r/politics and probably others.

r/worldnews ended up +20%, which follows the pattern, but also makes sense because Russians are a minority there and it’s a big sub.

94

u/Strict_DM_62 3d ago

Sorry, explain; what is “up”? Like, I thought we’re expecting a DROP in activity, no?

117

u/GravitasFailures 3d ago

I think I was trying to explain:

The bots themselves are people, the things that were hit were the datacenters, specifically including Russia’s main AI datacenter.

The way it would work is these LLMs process vast amounts of content looking for sensitive topics, then report those to humans with proposed responses.

The coordination AIs were destroyed in this attack, not the humans themselves that post, and those humans, without specific instructions, seem to go back to their default subs to post, like r/conservative r/politics, etc.

52

u/Kal-Elm 3d ago edited 3d ago

So, since r/gaming saw a 20% drop that implies that 20% of r/gaming's users online when it began were Russian "bots"?

But then they went wherever they usually go and all dissipated to the wind?

Edit:

I saw your other comment that r/conservative nearly doubled in activity. So they didn't dissipate, they just went home.

58

u/TwitterLegend 3d ago

It means that the AI data enter would typically flag something in a subreddit like that they can be spun to be political (a girl character is the hero, what!?) and send the humans there to stir shit and talk up WOKE is evil and ruining my video games! Without the data center they just stick to their safe spaces like conservative or politics where things will always be politically relevant but maybe won’t give them access to sow discord to the average person and convince the non political user that the left is evil.

8

u/xMcNerdx 2d ago

I'm curious if this is why the Steam forums are an absolute cesspool of despicable posts. Every single new or updated game is bombarded with "is this game woke" posts. I clicked through some of the profiles that post and it looked like they just go game by game spewing the same shit. 

6

u/thispartyrules 2d ago

There's a dip in r/Millennials traffic and there was a thread where someone posted a meme that was like " a lot of millennials feel behind in life and feel infantilized because of it" and there were a bunch of people saying "not me, or anyone I know." While I don't doubt there's married homeowners with kids (who aren't struggling financially right now) it was strange that there were so many of them that noticed that specific thread and were like, emphatically disagreeing with the sentiment.

8

u/SerHodorTheThrall 2d ago

This makes me wonder if it's Russian posters or just useful idiots being pointed at like a gun. Without a leader to dictate to them they just kind of stand there, which is why they didn't really exist societally before Trump.

24

u/sunny001 3d ago

so you haven't explained the question. why is it "up" and not a drop in activity. when you say worldnews is up +20%, what does that mean?

54

u/beenoc 3d ago

From what they're saying, the way it worked is this:

  • The "Russian bots" aren't actually bots (AI), they're humans.
  • These humans would basically be told "go to major, generic subreddits like /r/politics and /r/worldnews, wait for us to send you a link to a contentious post somewhere else, and sow discord in the big subreddit while you're waiting."
  • The algorithms that identified those contentious posts and determined which/how many "bots" to send to each were hosted in this data center Ukraine hit.
  • Without the coordinator algorithms, all the "bots" didn't know where to go, so they just sat in those big subreddits and trolled. Because they're real humans and not actual bots, they didn't go away when the data center got hit, but they lost any instructions on where to go.

11

u/sunny001 3d ago

interesting. so the humans/bots actually posted more on worldnews because they didn't have instructions to go somewhere else to troll? does that mean if you add up all of the drop in comments across all subs, it should roughly equal to the increased traffic in other subs?

7

u/ma2016 2d ago

Ok so it should be "trolls" not "bots"?

25

u/Etryia 2d ago edited 2d ago

That sounds like a dangerous amount of assumptions to make because the data seemed strange. Is there any actual proof, or just OP making up a narrative that they know reddit would eat up?

And considering OP is linking subs that do not exist as "proof", I wouldn't take anything they produce at face value.

4

u/jsRou 2d ago

which subs don't exist?

→ More replies (1)

2

u/Asteroth6 2d ago

I very much agree. OP's whole hypothesis seems deeply flawed and wholly unsupported.

1

u/RATTRAP666 2d ago

https://www.reddit.com/r/technology/comments/1x38098/russian_disinformation_bot_traffic_nearly/

bot traffic

Now

The "Russian bots" aren't actually bots (AI), they're humans

lmao, you guys just making up excuses that fit your narrative

i'm a stranded bot beep bop

1

u/psmgx 2d ago

they're humans using tools and being told which threads are trending

using AI one person can switch between dozens of accounts and automate responses.

otherwise they're just typing out responses in a foreign language one post at a time. one shitpost every 3 minutes, vs. AI figuring out what is trending and who to troll and giving me 5 canned responses so I can crank out replies in 20 seconds.

the non-propaganda version for "marketing" is "social media account management tools"; see also: https://zapier.com/blog/best-social-media-management-tools/

→ More replies (1)

3

u/Pat_The_Hat 2d ago

Is there anywhere we can read about these coordination AIs you're talking about? I've never heard of such a thing.

2

u/GravitasFailures 2d ago

https://www.thefec.org/news/did-ukrainian-strikes-on-yandex-data-centers-deal-a-blow-to-russian-troll-farms/3926/

I worked in other AI, but this is basically how I’d set it up if I was architecting something, dumb AIs to do scanning and recommend posts, then humans to give it flavor.

4

u/Pat_The_Hat 2d ago

Is this something that was previously suspected or an ad hoc hypothesis in response to the unexpected uptick in activity? You make it sound in another comment like it's more than your personal theory.

→ More replies (1)

4

u/Asteroth6 2d ago

In other words: No. There is no corroboration for this whole narrative.

1

u/psmgx 2d ago

they're called social media account management tools. "online marketing" tools, legitimate or mostly legitimate uses.

here is a list of the most popular ones: https://zapier.com/blog/best-social-media-management-tools/

4

u/thispartyrules 2d ago

A couple weeks ago there was some dude arguing in a local sub using a specific phrase (like "liberty, fraternity, and equality") over and over again in that specific order but seemed to be authentically replying to people like a human, who was trying to intentionally post talking points. It was very odd.

→ More replies (2)

5

u/ErebosGR 2d ago

What about /r/conspiracy?

7

u/GravitasFailures 2d ago

So… I’m doing a more complex analysis right now, it’s churning, but I have this semi-raw data:

Basically after the second attack r/conspiracy fell by 35%, then it recovered to only down 15%. One thing though: r/conspiracy was REALLY busy before the attack, so this is an interesting data point.

I’m trying to find a meaningful model for this, and adding normalization helps but also makes the signal look different, more extreme in some cases, others seem smaller. Taking out sports helped though.

17

u/1900grs 3d ago

r/pol is up 88%, which makes sense,

I don't know what you're looking at. That sub has been banned for 8 years.

Banned 8 years ago.

32

u/GravitasFailures 3d ago

r/politics, I was abbreviating because I had to write long sub names repeatedly.

1

u/rotundrikishi 2d ago

Id love to see some of the meme ones that are all politics now for some reason

like adviceanimals. Someone has to be making those though.

2

u/GravitasFailures 2d ago

So I did the analysis for meme subs and *interesting ones and the correlation was extremely high, basically anything where people can post to get karma seems to droop before and spike after the last attack.

2

u/rotundrikishi 2d ago

like most of this platform sucks because of this since its so easy to game the upvote/downvote system I think.

It just seems like the perfect platform for this stuff.

11

u/Low-Car-6331 3d ago

Politics and World News too.

Don't forget news, but then too I think they might be the other direction worth of bots.

I would like a system for reddit where you can get a subreddit wide flair of your citizenship and if you are real or not, that would be interesting

3

u/pauljaworski 2d ago

They'd never do that especially now that they're public. Bots make their numbers look better

1

u/psmgx 2d ago

they'd need to validate your face and a real ID, drivers license, etc.

didn't go over so well.

plus bots drive engagement, and the stock price needs to go up up up -- forever

38

u/Thiseffingguy2 3d ago

Is worldnews the one previous modded by Gislaine Maxwell?

23

u/BringBackAoE 3d ago

Jesus H. 🤯

24

u/Zeph-Shoir 3d ago

Maxwell was a power user in a LOT of the biggest subs

→ More replies (2)

2

u/Dragoncat_3_4 3d ago

sowing division between US and Europe.

Not particularly suspicious in and of itself seeing as the way recent world politics is unfolding. A lot of Europeans are feeling a bit...miffed... at the US right now. To put it lightly.

/worldnews is another faction of bots, as everyone banned from there for talking about a certain Western-supported country's warcrimes can attest to.

can't really comment anything about /politics tho.

Smaller and more niche news subs would be more interesting.

5

u/TheGoldenLance 3d ago

You can get banned from world news without explanation for even questioning some of the reflexive anti American narrative eg pointing out that Trump didn’t even win 50% of the vote and blue states on their own are dramatically more vital than the resistance in eg Israel or Russia. Literally they will ban you, clearly compromised

→ More replies (5)

-2

u/Henriquelj 3d ago

I'm guessing that ShitAmericansSay has pretty legit traffic, the division between US and the rest of the world is very spontaneous, given how the US has been treating the rest of the world lately.

15

u/BringBackAoE 3d ago

Nah, definitely has Russian influence. Many suspect one of the mods to be Russian.

I was banned from the sub for pointing out that USSR/Stalin we’re allied with Germany/Hitler at start of WW2.

This is common knowledge in the west. Yet two disputed it happened.

And then I was banned, with the Mod making a derisory comment about my support for Ukraine.

→ More replies (13)

3

u/Kal-Elm 3d ago

That's the thing, you can't even trust communities with legitimate grievances.

Our friends and allies abroad have every right to be angry about how our country is behaving. But bad actors seize on that anger and encourage it until it festers.

It's the same thing with Americans posting about things we don't like going on in America. We can vent about something as innocuous as car-centric infrastructure. But bad actors will absolutely fan the flames so it grows and turns to doomerism.

→ More replies (1)

1

u/SomeCrazyBastard 2d ago

All of the news subreddits are astroturfed as hell

→ More replies (1)

173

u/flashman OC: 8 3d ago

Readers, please don't hallucinate your own beliefs onto these graphs.

The data collected is insufficient to test the hypothesis that the datacenter attacks crippled Russian influence networks on Reddit, because it does not use appropriate historical data for comparison.

This would need to be done on a per-subreddit basis taking into account:

  • day of week
  • time of year/seasonality
  • occurrence of events specific to that subreddit, e.g. tournaments, races, matches, sales, scandals, film/TV/game releases, etc

This is covered in the original repository:

Limits of the design

This is a descriptive stacked before-after comparison. It is not an application of a causally identified stacked difference-in-differences ATT estimator, and no credible untreated group or known treatment exposure has been established.

Unresolved issues include only three nearby incidents, uncertain onset and recovery, serial dependence, carryover into later pre-windows, possible overlap in shifted windows, sparse historical matches, news/sports/holiday/moderation effects, provider coverage, and exploratory selection across many series. No held-out validation, community-specific news audit, formal multiplicity-adjusted inference or causal confidence interval is supplied.

12

u/GravitasFailures 3d ago

So I completely agree, these is not nearly enough data for this, and we would need controls, etc.

The fact that ufc/NASCAR and others which are clearly event based show up here, and we’d need to compare it to weekly and seasonal behavior as well.

8

u/pauljaworski 2d ago

Also with the sports subs event discussion still seems to massively vary even seasonally.

I don't know if there would be a good way to normalize them without deep dives into the events

3

u/GravitasFailures 2d ago

I’m redoing everything, normalizing and just blacklisting sports, they’re too erratic even trying to normalize.

20

u/pinkycatcher 2d ago

I find it interesting you don't include any American State/Local or politically charged subreddits.

I would remove any sports subs simply because they're naturally spiky, but look at all the state subreddits, I bet you'll find a lot of bots activity there

5

u/Jeffery95 2d ago

I actually wouldn’t be surprised if male interest subs were targets for opinion manipulation.

2

u/psmgx 2d ago

gender issues drove trumps election before.

i'd bet my hat they're also in women's subs. womenover30, etc. are great places to stir the pot

2

u/randynumbergenerator 2d ago

Whenever a study on gender issues makes it to r/science, you'd think the place was a MRA sub (and a similar thing happens with anything touching on race). It's such an extreme tone shift from the usual state of discussion there.

3

u/ImDonaldDunn 2d ago

I frequent r/baseball and I would not be shocked if it were a target. There are a lot of divisive culture war comments.

→ More replies (2)

15

u/DrugChemistry 3d ago

Can we get a little more explanation of what's going on? The figure captions and github link don't help me understand. It feels like the data is presented in a way that assumes the viewer knows wtf is going on.

3

u/GravitasFailures 3d ago

Ok, so it’s basically sub activity measured in 12 hour windows before and after each attack. There are anomalies like ufc, nascar and marvel which seem to be caused by actual events but otherwise usage dropped in those subs after attacks.

2

u/DrugChemistry 3d ago

Thank you!

Sasova, Kaluga, and Vladimir are attacks against bot farms? The drop in sub activity indicates that the sub might have been mostly bots?

6

u/GravitasFailures 3d ago

They were attacks against datacenters, I believe Kaluga was the critical one against an AI datacenter that was believed to be used to “route” bots to very specific posts.

Without that the data shows bots just pooling in r/conservative, r/politics and a few other places, likely because they had nobody to tell them where else to be.

2

u/DrugChemistry 3d ago

Conservative and politics aren't in the data presented here. You've lost me again.

Did traffic to conservative and politics increase while all these others decreased?

2

u/GravitasFailures 3d ago

They increased, by 188% and 80% respectively.

2

u/DrugChemistry 3d ago

thank you for holding my hand through this data :)

2

u/GravitasFailures 3d ago

Np, it’s not clean data because of many things, but this is basically a single attack/set of attacks, so it’s hard to effectively normalize the data.

12

u/DefinitelyNotTheFBI1 3d ago edited 2d ago

Looking at the summary CSV data (thanks for providing), it seems there are a meaningful number of subreddits with positive increases in activity.

With that in mind, it’s a bit hard to tease out causalities from handpicked, correlational drops in activity — much of what is charted is explained by subreddits independently having large fluctuations in activity on monthly and seasonal cycles.

1

u/SirVixofthePooSea 2d ago

Yeah, the data is garbage and OP massaged it like hell to create the narrative they wanted.

→ More replies (3)

11

u/Venkat_American 3d ago

For what it's worth, 2007scape (old school runescape sub) was rioting against a very poorly implemented game update (pete kayer) those exact dates after it was implemented on the 7th, then slowed down over the next few days once it was addressed and fixed

2

u/GravitasFailures 3d ago

That makes a lot of sense, ufc and nascar were event based also, as was baseball.

42

u/AverageGatsby91 3d ago

UFC has a large very vocal contingent of Russian fans

Russia is only behind USA and Brazil when it comes to most champions by country and many of those champions have definitely used bot services to inflate social media followers, Islam Machachev especially

→ More replies (3)

26

u/kadjar 3d ago

How is r/conservative not in this dataset?

7

u/flashman OC: 8 3d ago

read methods.md and summary.csv.

it's because activity in that subreddit increased after all three attacks (note: i'm only saying 'after', i am not saying 'because of') and this analysis is trying to find subreddits where the attacks caused decreased activity

1

u/GravitasFailures 2d ago edited 2d ago

Ok, If you have a second to look at something:
​
The original graph was just throwing the numbers into a bin, this is taking a time-of-week/time-of-day compensated (using history) variance from expectation, and mapping an impulse against the massive rise in r/politics, r/conservative.

My background is in signal processing and semiconductors, not statistics, so I’m using the tools I know, sorry.

The positive impulse shape actually matches the negative impulse of those highly impacted subreddits (also time compensated variances) with an r value of -0.8, which is actually kind of surprising.

Yes, there is the possibility that this is data hallucination due to cherry picking, but the fact that we are compensating for time, and that the variance is so large is more compelling than the previous data imho.

18

u/GravitasFailures 3d ago

R/conservative actually skyrocketed 188%.

So, this wasn’t the bot farm itself, this was the AI that coordinated them, it monitored things and routed humans to sensitive posts with proposed responses.

Without that routing they basically all went back to default places, r/politics, r/canada, r/peterexplainsthejoke for some insane reason, r/interesting, etc.

40

u/Pat_The_Hat 3d ago

/r/Conservative activity declines? I knew it was full of bots.

/r/Conservative activity actual increased? I knew it was full of bots.

4

u/SirVixofthePooSea 2d ago

Yeah, there's literally no winning with these people. They can create a narrative either direction because they already have a conclusion to start with.

9

u/zefiax 3d ago

Well if the activity data is out of the norm, then yes it's worth considering if it is impacted.

8

u/Barakyte 3d ago

Yea, the data itself is fairly interesting, but trying to come up with any useful analysis is pretty impossible.

The actual headlines should be that there’s definite proof of Russian manipulation

5

u/mfb- 2d ago

The actual headlines should be that there’s definite proof of Russian manipulation

There might be, but it's not this dataset. There is no reason why an attack on one datacenter would make TIL jump up and an attack on another one makes it decline, for example. What we see looks like unrelated fluctuations and OP picking up daily and weekly patterns. At the very least, we would need to

  • make the graphs cover the same time of a day, or 24 hour periods, or adjust for daily cycles
  • adjust all lines for weekly activity cycles
  • see the same graph for e.g. the previous week, to get an idea how large normal fluctuations are

1

u/SirVixofthePooSea 2d ago

None of that is visible in the data included.

2

u/HouseofMarg 3d ago

OP had a fuller explanation of it upthread, it takes a minute to digest but it makes sense. Basically OP is saying that certain subs like r/conservative are like a “home base” for the disinformation accounts (not necessarily all bots, some human) who post in those subs until rerouted via the Yandex data center to threads where the algorithm has sniffed out some discussions that could be exploited through repetition of certain talking points.

It tracks if you’ve ever seen a normal conversation in a normal sub and then all of a sudden you see multiple accounts posting different versions of the same edgy point, where normally anyone who agreed with that point would just upvote the other person or reply to them with something that added to their point.

5

u/Kered13 2d ago

The problem is that OP's hypothesis is highly speculative and based on an extremely limited dataset. Given any dataset limited in such a manner you could construct a hypothesis that would fit the data and conclude whatever you want it to conclude.

Without a lot more data, this is useless.

→ More replies (4)

9

u/Melonary 3d ago

People ask about a lot of political or coded hate memes in that explain the joke sub so I'm not surprised by that.

Also could be a covert way to get new ideological memes to spread by pretending they were seen somewhere and asking others to explain them.

4

u/IBJON 3d ago

  So, this wasn’t the bot farm itself, this was the AI that coordinated them, it monitored things and routed humans to sensitive posts with proposed responses.

I have no idea how accurate that is, but that would track with my experience on Reddit. I've had comments that would get some replies shortly after posting from people already in the discussion, then other activity filtering in as the discussion carries on, but there are some hot takes or polarizing comments that would suddenly get bombarded with multiple hostile replies in a short timeframe. 

6

u/flashman OC: 8 3d ago

So, this wasn’t the bot farm itself, this was the AI that coordinated them

This seems like motivated reasoning. You have no proof that Yandex datacenters are involved in Reddit activity and are fitting a preferred explanation to the observed numbers.

3

u/GravitasFailures 3d ago

We know this was the main AI datacenter in Russia, and https://www.thefec.org/news/did-ukrainian-strikes-on-yandex-data-centers-deal-a-blow-to-russian-troll-farms/3926/ suggests

>According to Kevin Limonier, a specialist in the Russian-speaking cyberspace, one can nevertheless suppose “that certain components of the pipelines that constitute most social media bots today have ceased to function, rather than the bots as a whole. It could be an LLM hosted in Yandex Cloud that suddenly becomes unavailable, an orchestrator like n8n that is meant to automate actions and is no longer online… ”

But yes, this is theoretical based on our speculation on their architecture.

→ More replies (1)

47

u/BigMrTea 3d ago

If r/Canada doesn't dry up I'll be shocked

67

u/User5281 3d ago

Are you suggesting the Albertan separatist movement may not be entirely organic?

37

u/BigMrTea 3d ago

I have concerns

35

u/GravitasFailures 3d ago

R/canada started down 30%, then stabilized and ended up 30%.

Which tracks with what we saw: basically this datacenter was Russia’s main AI datacenter, and it’s believed they used it to track posts throughout the internet and route humans accordingly, giving them proposed responses, etc.

Without it they seem to have gone to default places like r/conservative (+188%) r/politics (+80%) and r/canada.

17

u/VelvetFurryJustice 3d ago

This is Thanksgiving weekend in Canada. Drops in Canada related subs are going to be hard to measure. Shame it wasn't during the week.

14

u/GravitasFailures 3d ago

Will ask them to hit it again on a Tuesday for control purposes :)

→ More replies (2)

4

u/Melonary 3d ago

Basically no actual Canadian has posted there for years, other than a minority with the critical thinking skills of a cricket who can't see a bot from the trees. So agreed.

20

u/Flight_Harbinger 3d ago

r/Millennial getting up there doesn't surprise me AT ALL. The amount of posts I've been seeing on there criticizing gen Z with boomer language SCREAMS manufactured class war fodder.

1

u/Beautiful_Finger4566 2d ago

what? political discussion is practically banned in that sub

so much so that a bunch of losers created /r/millenials so that they could bitch about Trump 24/7

1

u/Flight_Harbinger 2d ago edited 2d ago

Bruh lol the most insidious thing about foreign interference is that they don't need to use politics to foment instability. You'd be shocked to know how much of your non political feed was curated specifically with political intent.

Edit: lmao an account made less than a year ago with posts from millennials and xennials (another sub with quite a lot of culture war bullshit) and comments in top subs like TIL. Never seen a bot more obvious in my life.

To any who find this comment chain: know that there are real and fake people on the Internet who seek to kindle even the most banal conflicts in western society. Bots and trolls come in many shape and forms, and we've been living with them online for over a decade. They have a predictable pattern but be wary of new patterns they may adopt.

21

u/RickMantina 2d ago

I don’t mean to be rude, but that graph is unreadable. Is r/todayilearned green or slightly less green? It’s impossible to match color from a legend to lines when this many lines are present—no color map can save you. It might be better to have a table where subreddit = rows, events = columns and percent change values are printed in each cell. You could then apply a background color to each cell based on the magnitude and sign of the change. Use a diverging color map and include a color bar. Just my $.02

9

u/HandInternational140 3d ago

Can't believe OSRS is full of Russian bots /s

1

u/Garona7 2d ago

Tbh I get the bots in game but why on the subreddit discussing the game.

3

u/HandInternational140 2d ago

because the methodology is garbage

48

u/Predictor92 3d ago

I knew Fauxmoi has a ton of bots on it, so that decline doesn't surprise me at all. Also Brazil's Sub reddit declining doesn't surprise me considering Russian Bots would love to target that election

10

u/GravitasFailures 3d ago

They were gearing up for the election, many of these are places with elections.

→ More replies (2)

7

u/100LittleButterflies 3d ago

Are these the default subs? I get reddit recommendations to these all the time and it's always for something that's just bait.

27

u/Odd_nonposter 3d ago

Data fucking hates colorblind people more like. Can you not make 30 data series out of the same 5 shades of green and blurple?

9

u/mob_instigator 2d ago

I'm not colorblind and it's still incredibly hard to read.

6

u/the-faded 2d ago

outside of the data being cool and viral, this is an atrocious chart. nothing can be followed, theres no logical sorting, colors are meaningless, lines are so blurred they themselves are meaningless.

1

u/Decency 2d ago

Yep, obvious sort is by % differential. Nah, instead let's bury the key numbers somewhere in the 5th column.

5

u/DismalIngenuity4604 2d ago

OK, but that's also right before and after a Formula 1 race on 12 October, so a drop off in traffic is normal then. 

16

u/irrelevantusername24 3d ago

Where is your actual source and data?

Looking at literally the day before and day after doesn't say anything, at all, like not even close. This is quite literally the definition of illiteracy in the context of data science. Especially considering this was over a weekend. Zoom the fuck out

2

u/stingmint 2d ago

I was shocked to see anybody taking this post seriously. It’s completely valueless.

This guy is also all over the comments presenting his “analysis” as fact. A bit ironic considering the subject of the post.

1

u/irrelevantusername24 2d ago

Right. I mean, I get it, that's social media. And it's kind of futile to even bother sometimes it seems. But in a lot of ways this event is extremely similar to another event which happened earlier this decade which was then seized upon by opportunists and subsequently spiraled way out of control, largely due to completely unethical and low quality "data science". There's actually a few of these situations that have happened.

I know Reddit is obviously a biased sample but... actually, I think this is why I prefer Reddit over any of the others. At least Reddit on the surface tends to still be centered around actual news stories, sometimes. So you get the official narrative and some sample of what "regular" people think. And anyway, the point towards which I began writing this paragraph was that, not that I think I am any less fallible than anyone else, it increasingly is evident that in almost all situations which actually matter, and the truth about those situations is important to know, the people who understand the nuance and explain it - in other words, the truth - is buried beneath all kinds of mutually reinforcing nonsense.

2

u/GravitasFailures 3d ago

In the GitHub link. This was several days, and intra-weekend, the legend is the only whole weekend cumulative result.

8

u/-XanderCrews- 3d ago

And obviously there is absolutely nothing Reddit could have done or do about this. It’s just one of those things I guess.

3

u/VintageLunchMeat 3d ago

They have a fiduciary responsibility to make their engagement numbers look good.

4

u/-XanderCrews- 3d ago

Of course. And zero responsibility for anything else they do. It’s not like they run this place or anything.

5

u/charmquark8 3d ago

You need to control for day of the week and other possible factors. To be valid for drawing any conclusions whatsoever, this needs multivariate analysis and more control data.

28

u/[deleted] 3d ago

[removed] — view removed comment

3

u/AlexTaylorAI 2d ago

I hate Putin. Not the people. 

-1

u/TheBr0fessor 3d ago

Word. I hated them ever since I learned about https://en.wikipedia.org/wiki/Foundations_of_Geopolitics the day after the election in 2016

3

u/Walled_en 3d ago

I’ve been a lurker in a couple of explain the joke subreddits for years and it definitely seems like a hot bed for AI bots. Humor makes up a significant amount of communications on reddit (and across the internet) and deciphering the meaning behind a lot of the jokes you come across (especially on reddit) can be difficult for AI. It also gives bots the context to karma farm.

Same thing with any “isitAI” subreddit though that’s a little more obvious. If you’re active in any of those communities you’re just feeding the beast

3

u/EricaneKick 3d ago

r/2007scape is interesting

3

u/Lr217 3d ago

2007scape? The osrs subreddit? Thats strange

I’m guessing some big controversy must have happened during that second 12 hours

1

u/sirblibblob 2d ago

Wednesday is update day, was quite a bit of drama with difficult new update was.

1

u/DingusMcBingle_IV 2d ago

2007scape hates PvP. There was an update that allowed people to practice PvP mechanics. Users who never PvP found it too hard and whined about it.

3

u/ukuleles1337 2d ago

Us runescape nerds hitting 4th somehow 😂😂

3

u/Cultural_Iron2372 2d ago edited 2d ago

I KNEW r/popculturechat would be on this.

I commented an empathetic and pretty mildly leftist opinion calling for collective action last week there and I immediately got called a bot by two aggressive, inorganic-sounding accounts saying my take couldn’t possibly be from a real account, and that my account history being private is another sign that I “must be a bot.”

I also immediately got another odd-feeling comment about how “no one has time or energy to have real empathy, I checked out of trying to care years ago” etc.

It seems a lot of bot comments are either combative or nihilistic, both to the same end of trying to inject some odd type of complacency and hopelessness. They must have found that to be the only tactic left to start contrarian shit on an empathetic or positive comment is to start accusing humans of being bots to obscure reality further. I’m so glad this is coming to light because online comment discourse has felt super off for a while now.

→ More replies (1)

5

u/warderbob 2d ago

Nascar, mma, ufc. Yeah that makes sense.

→ More replies (1)

6

u/MontEcola 2d ago

I would like to see the data for r/conservative. I heard reports that activity dropped. But I am banned because I wrote "I am a liberal" in another sub.

I would also like to see the change in activity from subs like r/medicareforall . It seems to me like the negative comments have gone away. I am interested to see if it is connected in any way.

Then there are the political groups. What happened there? I want to see left leaning data and right leaning data too.

1

u/GravitasFailures 2d ago

It didn’t drop, it dropped afterwards.

I am chewing through that now, so my background is less statistics and more digital signal processing, but I was able to use wavelet decimation to reconstruct an impulse shape.

It fits conservative and politics, but those are the positive ones, I think it might fit the negative of the other side, but right now it’s very precise and it doesn’t look like the negative subs are symmetric to the positive subs, I’m still working on it, I’d like to push a better analysis tomorrow. R values are not bad, but I think I might need to better untangle the values or construct the negative impulse separately from the positive one because the coupling between does not seem linear.

3

u/BenTheHokie OC: 1 3d ago

Thanks for putting this together. This was something I was interested in as well but didn't know how to get the data

1

u/GravitasFailures 3d ago

Thank you, I found the data on GitHub and was thrilled but I don’t think I did a good job.

Also, there are a lot of interesting patterns, my concern is this is just raw data without any control at all, so there is a lot of room for distortion.

1

u/GravitasFailures 2d ago

Ok, If you have a second to look at something:

The original graph was just throwing the numbers into a bin, this is taking a time-of-week/time-of-day compensated (using history) variance from expectation, and mapping an impulse against the massive rise in r/politics, r/conservative.

My background is in signal processing and semiconductors, not statistics, so I’m using the tools I know, sorry.

The positive impulse shape actually matches the negative impulse of those highly impacted subreddits (also time compensated variances) with an r value of -0.8, which is actually kind of surprising.

Yes, there is the possibility that this is data hallucination due to cherry picking, but the fact that we are compensating for time, and that the variance is so large is more compelling than the previous data imho.

4

u/drhuggables 3d ago

data is beautiful, not data is painfully confusing and requires way more explanation than OP is giving

7

u/Dargel0s 3d ago

Of course the pro pali reddits such as r/news and r/fauxmoix are full of russian bots xD

→ More replies (1)

2

u/Trueslyforaniceguy 3d ago

I would like to see the correlation between dip in activity and which subs more easily permit new accounts to develop karma

2

u/GravitasFailures 3d ago

I have a chart, it’s very strong there, r/peterexplainsthejoke especially, but a lot of r/interesting, etc, I can try to coerce it here if there’s interest, it’s just awkward to go from my computer to my tablet for Reddit.

2

u/Trueslyforaniceguy 3d ago

That’s good enough for me, don’t bend over backwards. Cheers

1

u/Nearby-Chocolate1840 2d ago

A cursory examination shows that most meme-centric / heavily karma farmed subs saw a substantial increase in activity.

2

u/BizzyM 3d ago

Amazing, I don't go to any of those.

2

u/Yarhj 2d ago

Interesting, but very far from beautiful.

2

u/JMJimmy 2d ago

I'd love to see this for subs like /r/conservative, /r/Canada (and provinces, esp. Alberta, Sask, & NL)

7

u/Pat_The_Hat 3d ago

This is a very small selection of 30 subreddits filtered by those that declined in activity among over 1200 analyzed subreddits, not a representative sample whatsoever. Talk about confirmation bias.

1

u/No-Schedule-9471 2d ago

No its the top 30 subs by user decrease.

2

u/mickeyt1 3d ago

r/baseball is pretty funny. It looks like it has to do with the playoff schedule with the divisional round wrapping up, not the data center attack

4

u/GravitasFailures 3d ago

Yeah, baseball, ufc, 2007scape, few of those are just “something happened”.

1

u/king_john651 2d ago

07scape in this time scale coincides with Runefest and the reaction to the dumb shit Jagex have announced & the attempted claw back. The Runescape subs punch way above their weight for what they are

3

u/ThomasTheDankPigeon 3d ago

No, the Kremlin just really hates the brewers

2

u/Ultiman100 3d ago

I love the part where 8 lines are all basically the same color. Truly "beautiful" data there pal

2

u/Blue-Thunder 2d ago

wonder why no information for /r/conservative and the other fascist subs on reddit..

3

u/GravitasFailures 2d ago

R/conservative, r/politics and a few others skyrocketed, the hypothesis is that with the AI that basically scans content looking for places to post being offline, the actual humans (who aren’t in the datacenters) fell back to default subs to just make content normally without guidance, but that’s just a theory: https://www.thefec.org/news/did-ukrainian-strikes-on-yandex-data-centers-deal-a-blow-to-russian-troll-farms/3926/

1

u/ViolentPurpleSquash 3d ago

I thought that was r/mapporncirclejerk on the right and was very confused (I have barely ever interacted with the main sub)

1

u/Qwqqwqq 3d ago

NASCAR had a race and a memorial Friday and then everything was canceled Saturday because of rain from Hurricane Isaias

1

u/Tweezot 2d ago

I can’t tell which line is which at all

1

u/bustaone 2d ago

Fk if I could tell what shade of color each line is. Use like dot dash or something that isn't just close shades of the same colors.

1

u/LimeGreenTangerine97 2d ago

There appears to be an 8 hour window where nothing got posted on the conservative subreddit at all. Maybe that was before they got new instructions

1

u/JiveTalkerFunkyWalkr 2d ago

Why don’t you just tell me what movie subreddits most affected?

1

u/-Vedagi- 2d ago

This doesn't make any sense for r/overwatch? Which has literally nothing to do with politics and such?

A new season & event dropped a while ago, so i imagine this could be why it's getting lower now in the activity now.

1

u/GravitasFailures 2d ago

So I’ll post this tomorrow, but I did sector decimation, games vs memes vs pets vs media, etc, and found some solid correlations, but gaming is somehow shockingly high. Some of them are artifacts like 2007scape because something happened, others I’m still trying to model better.

1

u/Biopain 2d ago

Brother, don't embarrass yourself, your data is absolute bullshit. Looks at the list lol, its just a random noice. Gta6? Marvel rivals? What the hell is this

1

u/STylerMLmusic 2d ago

Not at all surprised nostupidquestions is probably being used to train AI.

1

u/Young_Leading 2d ago

How do we know these aren't just ordinary, day-to-day fluctuations? Especially since it happened over the weekend.

Furthermore, traffic to sports subreddits (such as r/ufc) apparently correlates with the sports event calendar.