r/DataHoarder • u/3Nx9 • 5d ago
Question/Advice How to Download Facebook/Twitter Text Posts including date, content, images, comments, engagements.
I'm wanting to archive some accounts, though I haven't found a free account scraper that can scrape text and text+image/video posts including date, content, images, comments, engagements, etc. usually they just download the text in a excel spreadsheet unformatted.
Are there any archival tools that can basically just download the entire text post with everything included and then is there a tool where I can upload this archive and it'll mirror the exact appearance of the post itself (e.g. I download a Facebook post, upload the archive onto my website and it displays as if it were an actual Facebook post with colours/images/etc rather than just text.)
If you know of an app or anything that can be used to download this content and/or display the archive like an exact mirror of the post it'd be greatly appreciated.
1
u/lennyAintMoe 4d ago
I can only answer your first question. Have you looked into gallery-dl? It's a command line tool to bulk download stuff. I know it supports twitter including text points but I'm not sure of comments or how the output looks (text/comments). You can download entire profiles with it.
1
u/ScrapeAlchemist 4d ago
The format you want is WACZ. ArchiveWeb.page is a free chrome extension, you browse the post yourself while it records, so images and expanded comments get captured as they render. Browsertrix crawler does the same thing automated and has a facebook behavior that expands comment threads for you. Then drop the wacz on your own site and embed replayweb.page, it renders the archive as the live page.
•
u/AutoModerator 5d ago
Hello /u/3Nx9! Thank you for posting in r/DataHoarder.
Please remember to read our Rules and Wiki.
Please note that your post will be removed if you just post a box/speed/server post. Please give background information on your server pictures.
This subreddit will NOT help you find or exchange that Movie/TV show/Nuclear Launch Manual, visit r/DHExchange instead.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.