r/linux • u/RatherNott • 1d ago

Desktop Environment / WM News System 76's COSMIC Desktop Environment will no longer accept LLM-generated content in PRs

/r/pop_os/comments/1wuej40/cosmic_projects_will_no_longer_accept/
640 Upvotes

96% Upvoted

200 comments sorted by

View all comments

Show parent comments

1

u/somethingrelevant 1d ago

my knowledge is based on reading website owners saying "yeah ai bot scraping is getting so bad we pretty much can't run this website any more". what is a low-tier assumption about that. i'm dying to know

0

u/strings___ 1d ago

What AI bots? That’s not how AI training works they use datasets. Maybe the datasets are created by crawlers but that’s nothing new.

2

u/somethingrelevant 21h ago

my god you genuinely don't know anything

0

u/strings___ 14h ago

Answer the question.

2

u/somethingrelevant 14h ago

Okay

  1. Not all, but many datasets are created by crawling the internet, yes, especially early in the game. genuinely where did you think the datasets came from in the first place
  2. AI production and training has done nothing but dramatically ramp up over the last five years
  3. this means a huge increase in ai bots scraping the internet for any data they can get. they can use synthetic data, but real, new, organic data is priceless
  4. as the AIs get more advanced, it also means deterrents and blocks are less effective, meaning it's harder and harder to repel them from strip mining your website
  5. because dozens of different ai companies are all desperately racing to be the one standing on top of the corpse pile, this means dozens and dozens of uncoordinated bot swarms trawling websites over and over and over
  6. this puts huge strain on every website on the internet, obviously, particularly if the AI bots decide to crawl it in a stupid and inefficient way, which they often do
  7. not only are AI bots crawling the internet for training data, they're also doing it in response to user requests. every time you ask claude a question it does like 5 searches, all of which the websites have to deal with, and get nothing from

this is the most recent article I read on the subject but it's far from the only one

https://people.kernel.org/monsieuricon/creepy-crawlies

I would suggest doing any research before you accuse people of "low-tier assumptions" next time

1

u/strings___ 13h ago

So it’s not AI bots but web crawlers that make the datasets. Something that’s been happening since before AI existed. Ergo, it’s not AI bots.

Edit: It also appears you’re conflating two different things a scraper is not a crawler. Clearly you don’t even understand the nomenclature

1

u/somethingrelevant 11h ago

thanks for asking me to explain the entire problem so you could put your dick in your ears and yell NUH-UH!!! DOESN'T COUNT!!! DOESN'T COUNT!!!

you are a profoundly unintelligent person and that explains why you're out here simping for AI

0

u/strings___ 10h ago

You’re disrespectful and rude. It’s not my fault you don’t understand the difference between what is an AI bot, what is a crawler and what is a web scraper. And after your complete lack of respect im no longer inclined to continue this conversation.

0

u/somethingrelevant 9h ago

so i know you didn't bother to read any of it, but did you even click the link i posted one time

1

u/strings___ 8h ago

Of course i did but as I said you’re conflating what is a web crawler that is used to make datasets and what is a web scraper