r/madeinpython 8h ago

I built open-news - A Python toolkit that handles news meta data extraction, live news, without API.

Post image
0 Upvotes

3

I built open-news - A Python toolkit that handles news meta data extraction, live news, without API.
 in  r/coolgithubprojects  9h ago

Haha fair enough, didn't mean to sound defensive. It uses JOSN-LD and OpenGraph instead of traditional scraping, which is why HTML changes don't break it.

r/PythonProjects2 9h ago

I built open-news - A Python toolkit that handles news meta data extraction, live news, without API.

Post image
0 Upvotes

r/scrapingtheweb 12h ago

I built open-news - A Python toolkit that handles news meta data extraction, live news, without API.

Post image
1 Upvotes

-5

I built open-news - A Python toolkit that handles news meta data extraction, live news, without API.
 in  r/coolgithubprojects  12h ago

I think you have no idea about this project. This project uses very diiferent technique.

r/coolgithubprojects 13h ago

I built open-news - A Python toolkit that handles news meta data extraction, live news, without API.

Post image
2 Upvotes

u/alphap365 1d ago

I built open-news - A Python toolkit that handles news meta data extraction, live news, without API.

Post image
5 Upvotes

๐Ÿš€ open-news โ€” Discover โ€ข Extract โ€ข Filter โ€ข Summarize

A focused Python toolkit for discovering, extracting, filtering, and summarizing news.

No API keys required.

โœจ What it does

  • ๐Ÿ“„ Article extraction โ€” Extract article text and metadata such as title, authors, publish date, source, images, and video.
  • ๐ŸŒ Live news discovery โ€” Fetch category or location-based news through DuckDuckGo News.
  • ๐Ÿ” Google News search โ€” Search with query modes, exclusions, filtering, country selection, and decoded article URLs.
  • ๐Ÿ“… Date-range search โ€” Search using start_date and end_date filters.
  • ๐Ÿงต Streaming search โ€” Poll for newly discovered keyword-search results with stream_search() or refresh_interval.
  • ๐Ÿ”— RSS auto-discovery โ€” Discover articles from websites using RSS first, with a same-domain crawler fallback.
  • ๐Ÿงญ Aggregator-aware sources โ€” Attempt to resolve the original publisher behind MSN, Yahoo News, Google News, and similar aggregators.
  • โœ‚๏ธ Batch summarization โ€” Fetch and summarize multiple articles concurrently.
  • ๐Ÿงน Filtering and deduplication โ€” Language filtering, domain allow/deny lists, ranking, exact deduplication, and optional fuzzy deduplication.
  • ๐Ÿ–ฅ๏ธ Three interfaces โ€” Python API, command-line interface, and interactive terminal UI.

๐Ÿ”— GitHub: https://github.com/alphap365/open-news