From 16f00ff40354fc1e011d478855fd768de5127e04 Mon Sep 17 00:00:00 2001 From: claude_dev Date: Mon, 7 Sep 2026 18:40:50 +0800 Subject: [PATCH] =?UTF-8?q?docs:=20spec=C2=A718.9=20=E8=A1=A5=E9=A6=96?= =?UTF-8?q?=E8=B7=91=E6=97=A5=E5=AE=9E=E5=BD=95+=E7=AC=AC=E4=BA=94?= =?UTF-8?q?=E9=A1=B9=E5=81=8F=E5=B7=AE(=E5=B7=A8=E6=BD=AE=E5=8D=95?= =?UTF-8?q?=E5=93=8D=E5=BA=94=E5=90=8Cid=E4=B8=A4=E6=9D=A1=E6=89=B9?= =?UTF-8?q?=E5=86=85=E5=8E=BB=E9=87=8D)=20[nas]?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- .../specs/2026-07-21-data-source-fusion-design.md | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/docs/superpowers/specs/2026-07-21-data-source-fusion-design.md b/docs/superpowers/specs/2026-07-21-data-source-fusion-design.md index 667b7f3..c3453f0 100644 --- a/docs/superpowers/specs/2026-07-21-data-source-fusion-design.md +++ b/docs/superpowers/specs/2026-07-21-data-source-fusion-design.md @@ -679,6 +679,16 @@ stock/corpus/run_corpus.sh`(scp -O 手动同步);容器必带 `--user 1024:100 - --until 语义=完成当前 unit 后停(首 unit 必跑);day-1 全文洪峰由 daily --until 10:30 墙钟+backfill ③账本反扫兜底。 +**首跑日实录(2026-09-07)**: daily 全量(ann/news 各 6168/6168 unit+fulltext 2478 洪峰 +墙钟截断)→backfill ①ann 到 5542/6168 时巨潮 502 连击(15:45~15:47,服务端故障 +rate_limited=False)触发域冷却——fail-closed 不标 done,无缝切 ②news(eastmoney 不受 +波及)跑至 17:30 墙钟,rc=1 由次日自愈(设计内行为)。当日落库:ann_meta 43.0 万行/ +news_meta 87.8 万行/news_fulltext 2673 行/PDF 2 份;news depth 已见 2015-05-11(np-listapi +实际可达远深于 2023-09 预估)。**首跑揪出并修复第五项偏差**: 巨潮单次响应同 +announcementId 可挂两条(整行相同或 ann_time 差 1 秒),`_filter_new` 批内不比对→双双 +落盘成重键行(3 行,verify FAIL)——修=批内 seen 截留(a889b2f)+存量 3 part 原子去重, +修后 verify_corpus 全域 PASS(rows=uniq=ledger)。 + ## 参考(调查来源) - xtdata 官方:https://dict.thinktrader.net/nativeApi/xtdata.html