Commit Graph
6 Commits
Author SHA1 Message Date
simonandClaude b2aa62dfa5 docs: 新增 intlnews_usage.html 操作手册
网页版操作手册包含:部署指南、操作命令、新闻源状态、
数据存储、MCP 服务、配置参考、排障指南、变更记录

Co-Authored-By: Claude <noreply@anthropic.com>
2026-07-23 09:29:36 +08:00
simonandClaude ea472c8bf8 docs: 更新 README 操作手册
- 13 个源清单及状态表
- 部署架构图更新(海外服务器已停用)
- Pi 前置条件/操作命令/常见问题

Co-Authored-By: Claude <noreply@anthropic.com>
2026-07-23 09:27:59 +08:00
simonandClaude f0adf713b7 docs: 更新 continuation.md 2026-07-23 会话记录
- investing.com 反爬策略调整(Google News RSS + magic/stealth)
- forexlive→investinglive 迁移
- 各源抓取状态表更新

Co-Authored-By: Claude <noreply@anthropic.com>
2026-07-23 09:26:53 +08:00
simonandClaude 5c106120bf feat: 增强反爬策略 + forexlive 迁移 investinglive
- crawler.py: 启用 magic/stealth 全自动反检测, --disable-webrtc,
  delay_before_return_html=3s, remove_consent_popups, 过滤列表页URL
- rss_crawler.py: 新增 _make_rss_client() 支持 httpx 代理,
  Google News RSS 跳过 article_url_pattern 域名过滤
- sources.yaml: investing.com 改用 Google News RSS 代理绕过Cloudflare;
  forexlive -> investinglive (域名已301重定向)
- domestic_crawl_8g.sh: HTTP_PROXY/HTTPS_PROXY 在 .env 加载前设置

Co-Authored-By: Claude <noreply@anthropic.com>
2026-07-23 09:25:23 +08:00
simon fe8b417ab6 初始化 2026-07-18 16:13:52 +08:00
simon c0070f0a5c Initial commit 2026-07-18 16:11:58 +08:00