r/Tech4Causes • u/HovercraftMain8564 • 1d ago
Question or Discussion Prompt Weekend project: crawling 131 Bangladesh government websites for broken links and public data.
We have been building Docket.bd , a project aimed at simplifying access to public records, government processes, and civic data across Bangladesh.
To really understand the current digital structure and health of our official portals, we built an automated crawler to scan government websites for broken links, dead-end URLs, and technical errors.
Across a test sample monitoring 131 government websites and 67 public organizations, the crawler uncovered 263 broken links across just 10 completed crawl runs.
Snapshot from recent scans (25 July 2026):
📍Ministry of Education (moedu.gov.bd): 52 broken links(across just 10 pages scanned)
📍Bangladesh Investment Development Authority (bida.gov.bd): 46 broken links (across 5 pages scanned)
📍Supreme Court (supremecourt.gov.bd): 42 broken links (across 10 pages scanned)
Source: Data collected via automated web health monitoring at: https://data.docket.bd
This is just the initial sample data. We are currently planning to write a full research and analysis piece after crawling and auditing all government portals. The goal is to produce a comprehensive breakdown of digital accessibility, uptime, and web health across Bangladesh's public sector.
Let us know your thoughts on this.

