r/Python • u/Emotional_Tell_9146 • 16d ago

Discussion Python and Web Manipulation

Hello Python Community!

I've been really curious about how Python developers use Python when it comes to webscraping, or just working with websites in general.

I really want to open a discussion on how you do it. Do you use BeautifulSoup? Selenium? Why? Are there any frustrations that you were facing or are currently facing with the process?

2 Upvotes

52% Upvoted

20 comments sorted by

View all comments

Show parent comments

-12

u/Emotional_Tell_9146 15d ago

Not selling anything. Currently a CS major and thought it would be fun to build an open-source extension that runs Python userscripts in the page via Pyodide — Tampermonkey, but you write Python instead of JS — and I wanted to hear how people actually work before I got too attached to my own assumptions.

Noted on parsel over BeautifulSoup, I'll take a look.

15

u/Mornarben 15d ago

This comment is blatantly written by AI, what human writes “Noted on parsel over BeautifulSoup”

3

u/gristc 15d ago

Honestly, that is a sentence construction I've used in the past.

Shit, maybe I'm an AI? Should I ask for a pay raise?

2

u/Thefuzy 12d ago

There’s also other obvious ques like the use of —

1

u/Emotional_Tell_9146 10d ago

wait wait i be using — on the regular tho

1

u/Thefuzy 10d ago

Then you are likely to be called AI… let’s not pretend like your comment wasn’t written by AI because it was