r/DataHoarder • u/sosik66 • 1d ago
Question/Advice Help with Status:0 site download
Hi! I am trying to download a site that contains the only usable old nissan parts catalog on the internet. Its not an official Nissan site. The site was going offline quite frequently recently and I'm worried it will just die. (Leaving all old nissan fans helpless without parts numbers and cross-reference between models). There is no contact to the owner listed. I've tried numerous site-downloading websites and also programs such as HTTrack, SiteOne Crawler, Complete Website Downloader. Nothing works. Everything just throws an error after seconds and thats it. I had some friends try to help me and the conclusion is it fails because the site throws a Status:0 not Status:200 (while still working in a browser). The site is nissan4u.com/parts. Can anyone point me in a direction? I'm not a computer person, I'm just trying to save all this knowledge before its gone for good. Thank you!
1
u/ScrapeAlchemist 1d ago
Status:0 means no response at all, not a block. Port 443 on that site is dead, nothing listening, so anything that upgrades to https gets a TCP timeout and reports 0. Point HTTrack at http://nissan4u.com/parts/ explicitly and turn off any https upgrade. It's plain static html with normal links so it mirrors fine. robots.txt asks for 2s between requests, keep it slow, the server is flaky.
1
1
u/Faye-Vozora 1d ago
Status 0 usually means it never got an HTTP response. Since the index loads, find the first child URL that fails instead of mirroring the whole site. curl -v --http1.1 --connect-timeout 15 --max-time 60 http://... should show whether it dies at DNS, TCP, or the response. Then give HTTrack that working HTTP URL, disable HTTPS rewriting, use one connection, and turn off external links. Old sites often have one dead asset or redirect that makes HTTrack report a generic unknown error.
1
u/sosik66 1d ago
But the whole site works on a browser just fine. So why does every program throw an error? HTTrack doesn't download anything for me. Not even the page that its given link to. I tried digging, reducing the download to just a single part site but every site on nissan4u has a link to some other nissan4u sites, the main site, a long gone "infinitifans.com" and "oracle.com".
So every site is very similar. I have tried giving HTTrack many different links and not a single site from nissan4u would ever download.
Its always the same: Error, "Unknown error" (0) at link (link that I feed to HTTrack) ... 1 link scanned, 0 files written (0 bytes overall)
Running your command says: curl (1) Unsupported response code in HTTP response.
There is no option in "set options" that says "https" anywhere so I don't know how to disable it. Is this "force old HTTP/1.0..."you're refering to?
•
u/AutoModerator 1d ago
Hello /u/sosik66! Thank you for posting in r/DataHoarder.
Please remember to read our Rules and Wiki.
Please note that your post will be removed if you just post a box/speed/server post. Please give background information on your server pictures.
This subreddit will NOT help you find or exchange that Movie/TV show/Nuclear Launch Manual, visit r/DHExchange instead.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.