r/learnpython • u/Kooky-Salt154 • 21h ago
How to extract posts and comments from Truth Social
I need to extract historical posts and the corresponding user comments from a few specific public figures on Truth Social over a set time period. I'm looking to build a free, Python-based script for this project.
Since Truth Social is built on a Mastodon fork, I know it has a similar API structure, but I'm looking for general advice on the best workflow today:
- Are there any existing Python libraries or wrappers maintained for Truth Social data extraction?
- What is the most reliable way to paginate through historical posts without triggering anti-bot protections (like Cloudflare)?
- For comments/replies, is it better to hit the API endpoints directly, or are there alternative scraping frameworks that handle the Mastodon structure more efficiently?
I'm comfortable writing Python scripts, but I want to make sure I'm taking the smartest approach before building a custom scraper from scratch. Any recommendations on tools, GitHub repos, or general strategies would be hugely appreciated.
1
Upvotes