NewsNow Multi-Source News Aggregation

Problem

Many pipelines need to pull tech, finance, community, and general news at the same time, but individual RSS or web feeds are inconsistent, unstable, and serial fetching is slow. One slow or failing source can delay the entire job.

How it works

This skill aggregates 39 NewsNow sources and turns fetching into a controlled batch task:
- Concurrent requests: multiple sources are fetched in parallel with ThreadPoolExecutor and max_workers=6, reducing overall wait time.
- Timeout handling: a default per-source timeout of about 12 seconds prevents one bad source from blocking others.
- Caching: a server-side cache of roughly 30 minutes reduces repeated upstream requests.
- Lightweight dependencies: it uses the Python standard library and targets Python 3.8+.
A typical flow is to select source IDs such as github, juejin, hackernews, or wallstreetcn, then call the Python API to get structured news items for daily briefs, topic monitoring, or deduplication.

Boundaries

The focus is source aggregation and fetching, not editorial quality scoring or guaranteed long-term availability. Some sources, including linuxdo, kuaishou, and xiaohongshu, are marked unavailable in the docs. Callers should still clean fields, deduplicate items, rate-limit requests, and handle exceptions.