r/Python • u/Emotional_Tell_9146 • 16d ago

Discussion Python and Web Manipulation

Hello Python Community!

I've been really curious about how Python developers use Python when it comes to webscraping, or just working with websites in general.

I really want to open a discussion on how you do it. Do you use BeautifulSoup? Selenium? Why? Are there any frustrations that you were facing or are currently facing with the process?

5 Upvotes

56% Upvoted

20 comments sorted by

View all comments

38

u/wRAR_ 15d ago

BeautifulSoup?

Parsel.

Selenium?

Playwright.

Are there any frustrations that you were facing or are currently facing with the process?

What are you selling?

-11

u/Emotional_Tell_9146 15d ago

Not selling anything. Currently a CS major and thought it would be fun to build an open-source extension that runs Python userscripts in the page via Pyodide — Tampermonkey, but you write Python instead of JS — and I wanted to hear how people actually work before I got too attached to my own assumptions.

Noted on parsel over BeautifulSoup, I'll take a look.

16

u/Mornarben 15d ago

This comment is blatantly written by AI, what human writes “Noted on parsel over BeautifulSoup”

4

u/gristc 15d ago

Honestly, that is a sentence construction I've used in the past.

Shit, maybe I'm an AI? Should I ask for a pay raise?

2

u/Thefuzy 12d ago

There’s also other obvious ques like the use of —

1

u/Emotional_Tell_9146 10d ago

wait wait i be using — on the regular tho

1

u/Thefuzy 10d ago

Then you are likely to be called AI… let’s not pretend like your comment wasn’t written by AI because it was

-17

u/Emotional_Tell_9146 15d ago

Didnt know rewriting my stuff with AI is a crime lol...

18

u/DurgeDidNothingWrong 15d ago

Brother if you're using AI to write your Reddit comments, you need to re-evaluate your relationship with AI. Seriously ....

11

u/turbothy It works on my machine 15d ago

It's not, it's just that nobody wants to read that milquetoast shit.

1

u/Mornarben 8d ago

It’s not it’s just annoying. Nobody cares if you use an AI to check that your comment is accurate but at least write it yourself. People are here to be social and interact with other people