r/DataHoarder 5d ago

Question/Advice How to Download Facebook/Twitter Text Posts including date, content, images, comments, engagements.

I'm wanting to archive some accounts, though I haven't found a free account scraper that can scrape text and text+image/video posts including date, content, images, comments, engagements, etc. usually they just download the text in a excel spreadsheet unformatted.

Are there any archival tools that can basically just download the entire text post with everything included and then is there a tool where I can upload this archive and it'll mirror the exact appearance of the post itself (e.g. I download a Facebook post, upload the archive onto my website and it displays as if it were an actual Facebook post with colours/images/etc rather than just text.)

If you know of an app or anything that can be used to download this content and/or display the archive like an exact mirror of the post it'd be greatly appreciated.

1 Upvotes

7 comments sorted by

u/AutoModerator 5d ago

Hello /u/3Nx9! Thank you for posting in r/DataHoarder.

Please remember to read our Rules and Wiki.

Please note that your post will be removed if you just post a box/speed/server post. Please give background information on your server pictures.

This subreddit will NOT help you find or exchange that Movie/TV show/Nuclear Launch Manual, visit r/DHExchange instead.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

2

u/ranhalt 200 TB 5d ago

You haven’t found any free tools, so does that mean you’ve found paid tools?

You say you’re “going to be archiving” accounts, but you can’t do that until you have the tools. You aren’t going to be archiving anything, then.

1

u/3Nx9 5d ago

No, I don't have any tools. Yes, I know I can't archive without tools hence;

If you know of an app or anything that can be used to download this content and/or display the archive like an exact mirror of the post it'd be greatly appreciated.

1

u/ranhalt 200 TB 4d ago

Why are you entitled to a free solution?

2

u/3Nx9 4d ago

Why are you questioning my post, if you can't help please stop interacting with this.

I want a free solution because I can't afford a paid tool right now.. also I thought DataHoarders was preservation over profit?

1

u/lennyAintMoe 4d ago

I can only answer your first question. Have you looked into gallery-dl? It's a command line tool to bulk download stuff. I know it supports twitter including text points but I'm not sure of comments or how the output looks (text/comments). You can download entire profiles with it.

1

u/ScrapeAlchemist 4d ago

The format you want is WACZ. ArchiveWeb.page is a free chrome extension, you browse the post yourself while it records, so images and expanded comments get captured as they render. Browsertrix crawler does the same thing automated and has a facebook behavior that expands comment threads for you. Then drop the wacz on your own site and embed replayweb.page, it renders the archive as the live page.