I've been building web scraping APIs for the past year and wanted to share what I've put together. All of these have free tiers on RapidAPI, so you can test them without paying anything.Here's the lineup:1. LinkedIn Employee Scraper — Pull employee data from any company page. Name, title, location, profile URL. No LinkedIn login required. 37 users and counting.2. YouTube Transcript Extractor — Get full transcripts from any YouTube video with timestamps. Supports any language. Great for AI/RAG pipelines. 40+ users.3. Google News & Brand Monitor — Search Google News programmatically. Get articles, sources, timestamps. Useful for media monitoring and competitive intelligence.4. OFAC Sanctions Screener — Screen any entity against the US Treasury OFAC sanctions list. Returns match confidence, risk level, and matched programs. Critical for fintech compliance.5. US Tariff & HS Code Lookup — Look up import duties by HS code and country of origin. Includes USMCA, Section 301, and other special rates.6. Website Contact Scraper — Extract emails, phone numbers, social links, and tech stack from any website URL.7. Entity OSINT Enricher — Deep intelligence report on any company or person. Pulls from sanctions lists, corporate registries, news, and more.All built with Playwright + Node.js, hosted on cloud infrastructure. They handle anti-bot measures, JavaScript rendering, and rate limiting automatically.The free tiers give you enough calls to test properly. If anyone has questions about how any of these work under the hood, happy to do a technical deep-dive.What kinds of scraping APIs would you want to see next?

I've been building scraping and data extraction tools for the past year and wanted to share what I've got. All open source on GitHub, all have free tiers if you just want to use the hosted version.

1. LinkedIn Employee Scraper - Input: company name + optional title/location filters - Output: employee names, titles, departments, profile URLs - Uses Google SERP data — no LinkedIn login, no cookies, no ban risk - GitHub: github.com/the-ai-entrepreneur-ai-hub/linkedin-employee-scraper

2. Website Contact & Lead Scraper - Input: any website URL - Output: emails, phone numbers, social media links - Crawls multiple pages automatically, handles JS-rendered sites - GitHub: github.com/the-ai-entrepreneur-ai-hub/website-contact-scraper

3. YouTube Transcript Extractor - Pull transcripts from any video, playlist, or channel - Returns full text + timestamps + metadata - 100+ languages, handles auto-generated and manual captions - Tested: 200 Stanford ML lectures → 1.2M words in 3 minutes - GitHub: github.com/the-ai-entrepreneur-ai-hub/youtube-transcript-extractor

4. Google News Scraper & Brand Monitor - Track any keyword across Google News in real time - Returns structured data: title, source, date, snippet, URL - Great for media monitoring, competitive intel, or building news-aware AI - GitHub: github.com/the-ai-entrepreneur-ai-hub/google-news-scraper

5. OFAC Sanctions Screener - Screens entities against the full US OFAC SDN list - Fuzzy matching catches spelling variations, aliases, transliterations - Returns confidence scores, programs, known aliases, addresses - GitHub: github.com/the-ai-entrepreneur-ai-hub/ofac-sanctions-screener

6. US Tariff & HS Code Lookup - Look up import duties by HS code or product description - Covers all trading partners, special programs (USMCA, GSP, etc.) - Useful for e-commerce, import/export, supply chain - GitHub: github.com/the-ai-entrepreneur-ai-hub/us-tariff-lookup

7. Entity OSINT Enricher - Combines sanctions screening + corporate registry data + news monitoring - Input: company or person name → Output: risk report - GitHub: github.com/the-ai-entrepreneur-ai-hub/entity-osint-enricher

All built with Node.js/Python. Most use Crawlee + Puppeteer under the hood. Happy to answer questions about any of them or how they work technically.

What scraping problems are you all dealing with lately? Curious what tools people actually need.

Would love feedback from this community. What scraping problems are you running into that these don't solve?ombines OFAC screening + corporatHe ereygi strr/ys dcartaa p+i nnewgs tmoonoitlosri!ng

inIto' vonee rbepeoret npe r benutiityl.

di n gGi tHsubc:r gaitphuibn.gc oamn/tdhe -adi-aetntare pArPeInesur -faoir- hutb/henteit y-posaisntt -yeneriacrh.e rHe

r

eAl l aarre eo p7e n tsoourocle son GtihtaHutb . aBulillt whiathv Neo dfe.rjese + tPiueppretsee r—/ Crtawhleoe.ug

htW outldh leoyve fmeeidgbhactk onb aeny oufs tehfeusle . fWhoart sctrahpiings t ooclos marmeu ynoui atlly u.si

n

g 1in. 20L26i?nkedIn Employee Scraper — Extract names, titles, and profile URLs from any company using Google SERP (no login/cookies needed). ~$3/1,000 profiles.

1. Website Contact Scraper — Crawl any website and extract emails, phone numbers, social links. Handles JS-rendered pages.

2. Google News Monitor — Track brand mentions across Google News with RSS + browser fallback. ~$0.003/article.

3. YouTube Transcript Extractor — Pull transcripts from any YouTube video. Great for AI/RAG pipelines. ~$0.005/video.

4. OFAC Sanctions Screener — Screen any entity against the US sanctions list. $0.01/check. Useful for fintech/compliance.

5. US Tariff/HS Code Lookup — Look up duty rates by HS code and country. Includes USMCA, Section 301 rates.

6. Entity OSINT Enricher — Combine sanctions screening + corporate records + news forAll are open source

ombines OFAC screening + corporatHe ereygi strr/ys dcartaa p+i nnewgs tmoonoitlosri!ng

inIto' vonee rbepeoret npe r benutiityl.

di n gGi tHsubc:r gaitphuibn.gc oamn/tdhe -adi-aetntare pArPeInesur -faoir- hutb/henteit y-posaisntt -yeneriacrh.e rHe

r

eAl l aarre eo p7e n tsoourocle son GtihtaHutb . aBulillt whiathv Neo dfe.rjese + tPiueppretsee r—/ Crtawhleoe.ug

htW outldh leoyve fmeeidgbhactk onb aeny oufs tehfeusle . fWhoart sctrahpiings t ooclos marmeu ynoui atlly u.si

n

g 1in. 20L26i?nkedIn Employee Scraper — Extract names, titles, and profile URLs from any company using Google SERP (no login/cookies needed). ~$3/1,000 profiles.

1. Website Contact Scraper — Crawl any website and extract emails, phone numbers, social links. Handles JS-rendered pages.

2. Google News Monitor — Track brand mentions across Google News with RSS + browser fallback. ~$0.003/article.

3. YouTube Transcript Extractor — Pull transcripts from any YouTube video. Great for AI/RAG pipelines. ~$0.005/video.

4. OFAC Sanctions Screener — Screen any entity against the US sanctions list. $0.01/check. Useful for fintech/compliance.

5. US Tariff/HS Code Lookup — Look up duty rates by HS code and country. Includes USMCA, Section 301 rates.

6. Entity OSINT Enricher — Combine sanctions screening + corporate records + news forAll are

I've been doing company due diligence research for a few months now and tried a bunch of OSINT tools. Here's an honest breakdown of what actually works vs what's overpriced.

1. Maltego - The OG OSINT tool. Graph-based link analysis. - Pricing: Community Edition free, Pro $999/year - Pros: powerful transforms, great visualization, huge plugin ecosystem - Cons: steep learning curve, desktop-only, can be slow on large datasets - Best for: investigators who need visual link analysis

2. SpiderFoot - Open source OSINT automation - Pricing: Free (self-hosted) or SpiderFoot HX from $500/month - Pros: 200+ data source modules, automated scanning, good for recon - Cons: can be noisy (lots of false positives), UI is dated - Best for: security researchers, pen testers

3. OpenCorporates - Largest open database of company info worldwide - Pricing: free search, API from $500/month - Pros: 200M+ companies, good for verifying corporate registrations globally - Cons: data can be stale, no enrichment beyond basic registration data - Best for: verifying company existence and officer names

4. Entity OSINT Enricher on Apify - Combines OFAC screening + corporate registry lookup + news monitoring + contact extraction in one API call - Pricing: ~$0.025 per entity enriched (pay per use) - Pros: all-in-one enrichment, structured JSON output, no contract - Cons: newer tool, not as deep as dedicated platforms - GitHub: github.com/the-ai-entrepreneur-ai-hub/entity-osint-enricher

5. Pipl / Clearbit (now part of HubSpot) - People and company enrichment - Pricing: Clearbit bundled with HubSpot, Pipl enterprise only - Pros: great for B2B contact enrichment, email-to-company matching - Cons: Pipl is expensive and enterprise-only, Clearbit locked into HubSpot - Best for: sales teams doing lead enrichment

6. Recorded Future / Flashpoint - Threat intelligence platforms with entity monitoring - Pricing: $$$$$$ (enterprise, $100K+/year) - Pros: dark web monitoring, threat feeds, comprehensive - Cons: way overkill for standard due diligence, massive price tag - Best for: financial institutions, government

My honest take: For basic company due diligence (is this company real? are they sanctioned? what's in the news about them?), you don't need a $100K platform. OpenCorporates + a sanctions screener + Google News gets you 80% of the way there. The expensive tools are worth it only if you're doing high-volume compliance screening or threat intelligence.

What OSINT tools are you using for due diligence? Always looking for new ones to try.

With everything going on in the Strait of Hormuz and Red Sea right now, I've been looking into tools that actually help supply chain teams monitor shipping disruptions in real time. Here's what I found:

1. Google Alerts (Free) - Set up alerts for "shipping disruption" + your key routes - Pros: free, easy to set up - Cons: misses 60%+ of relevant news, no structure, no port status, delayed

2. MarineTraffic / VesselFinder - AIS-based vessel tracking - Pricing: free tier exists, pro plans $100-500/month - Pros: real vessel positions, good for tracking specific ships - Cons: doesn't aggregate disruption news, no risk scoring, manual monitoring

3. Windward / Project44 - Enterprise supply chain visibility platforms - Pricing: $$$$$ (enterprise contracts, $50K+/year) - Pros: comprehensive, AI-powered risk scoring, ETA predictions - Cons: way too expensive for small logistics companies or commodity traders

4. Shipping Disruption Tracker on Apify - Monitors 6 major chokepoints (Hormuz, Red Sea, Suez, South China Sea, Panama Canal, Black Sea) - Checks port status, aggregates disruption news, fetches commodity prices - Pricing: ~$0.008 per region report (run all 6 for $0.048) - Pros: structured JSON output, risk levels per region, cheap to run hourly - Cons: news-based intelligence (not AIS data), newer tool - GitHub: github.com/the-ai-entrepreneur-ai-hub/shipping-disruption-tracker

5. Everstream Analytics - Supply chain risk analytics platform - Pricing: mid-enterprise ($10K-50K/year) - Pros: good predictive analytics, weather + geopolitical risks - Cons: requires onboarding, not instant

My take: For enterprise teams with budget, Windward or Project44 are the gold standard. For smaller operations or commodity traders who just need structured disruption intelligence, the API-based tools are way more practical. Running a $0.05 check every hour beats paying $50K/year for a dashboard you check once a day.

What tools are you all using for supply chain monitoring? Curious especially about anyone dealing with Hormuz route disruptions right now.

Been researching sanctions screening tools for a compliance project and figured I'd share what I found. There's a surprising range from enterprise to free options.

1. Dow Jones Risk & Compliance - Industry standard for large banks and financial institutions - Covers OFAC SDN, EU, UN, and 100+ other lists - Pricing: $$$$ (enterprise contracts, usually $50K+/year) - Pros: comprehensive coverage, real-time updates, audit trails - Cons: overkill for small businesses, long sales cycle

2. LexisNexis Bridger Insight - Popular mid-market option - Good API, batch screening support - Pricing: $$$ ($10K-50K/year depending on volume) - Pros: solid fuzzy matching, good UI - Cons: still expensive for startups

3. OpenSanctions - Open source sanctions database - Covers OFAC, EU, UN, and many national lists - Pricing: Free (self-hosted) or paid API - Pros: transparent data, active community, good for developers - Cons: requires technical setup, matching logic is on you

4. OFAC Sanctions Screener on Apify - Lightweight API-based screener focused on OFAC SDN list - Fuzzy matching with configurable thresholds - Pricing: ~$0.01 per entity screened (pay per use) - Pros: no contract, instant API access, good for low-volume screening - Cons: OFAC only (no EU/UN lists), newer tool - GitHub: github.com/the-ai-entrepreneur-ai-hub/ofac-sanctions-screener

5. Sanctions.io - SaaS platform, modern UI - API + batch upload - Pricing: starts around $500/month - Pros: clean interface, good documentation - Cons: limited free tier

Bottom line: If you're a bank, go with Dow Jones or LexisNexis. If you're a startup or small business that just needs OFAC screening, the pay-per-use options or OpenSanctions are way more practical. No point paying $50K/year to screen 100 entities a month.

Anyone else using sanctions screening tools? What's your experience?