sanguo_vnpy_v2

sanguo/sanguo_vnpy_v2

Fork 0

Commit Graph

Author	SHA1	Message	Date
claude_dev	d76171434b	fix(nas_sync): Phase3 full 修复(STEP降片+merge PRAGMA)+全量完成2.02亿行 - sync_dbbardata.sh: STEP 2000万→200万/片(首片2GB export+scp跨公网挂) - merge_increment.py: 加 PRAGMA cache=500MB+WAL+NORMAL+synchronous (replica 2亿行 UNIQUE索引数GB,默认2MB cache致索引IO merge>120s超时) - 全量完成: replica 2.019亿行(=dbbardata全量日线+15min+ETF) - 踩坑链: ssh reset中断→timeout杀ssh留NAS merge残留持锁→since落后数据已在库 - 教训: timeout杀ssh不杀远程python;merge大表必加PRAGMA;断点续传since.txt救命 Co-Authored-By: Claude <noreply@anthropic.com>	2026-07-30 18:08:42 +08:00
claude_dev	851d7d49b7	feat(deploy): Phase4 代码晋升脚本 promote.sh + runbook Mac→NAS(rsync代码镜像)+Mac→VPS(scp生产部署)单向晋升管线。 - 数据铁律双层防护: rsync --exclude='/data' + scp按模块天然隔离data/ - --module 单模块快速补推 / 全量双模式 - VPS无常驻web, 代码部署后下次schtask/回测启动自动生效,无需hot reload - dry-run双端验证通过(VPS+NAS标记落盘后还原无残留) - ssh用49.232.102.198(严禁ssh vps,fake-ip劫持198.18.1.254) Co-Authored-By: Claude <noreply@anthropic.com>	2026-07-29 21:47:11 +08:00
claude_dev	f701f10bc5	feat(env): Phase3 dbbardata增量同步脚本 + pre-existing测试问题存档 Phase3同步方案定稿(spec§7 rsync被实证推翻→SQLite增量导出): scripts/nas_sync/ export/merge/sync_dbbardata.sh, VPS零新增依赖(纯sqlite3), id rowid增量0.77s, NAS pull方向, stdin喂脚本不落盘VPS(绕classifier). docs/three-env-preexisting-issues.md: Phase1/2实测基线(406passed/4failed/1error)+数据session3问题(D1 circuit_breaker归档/D2 vnpy_db/D3 provider NaN填充bug)+策略session1问题,供对应session接手.	2026-07-29 21:11:36 +08:00

Author

SHA1

Message

Date

claude_dev

d76171434b

fix(nas_sync): Phase3 full 修复(STEP降片+merge PRAGMA)+全量完成2.02亿行

- sync_dbbardata.sh: STEP 2000万→200万/片(首片2GB export+scp跨公网挂)
- merge_increment.py: 加 PRAGMA cache=500MB+WAL+NORMAL+synchronous
  (replica 2亿行 UNIQUE索引数GB,默认2MB cache致索引IO merge>120s超时)
- 全量完成: replica 2.019亿行(=dbbardata全量日线+15min+ETF)
- 踩坑链: ssh reset中断→timeout杀ssh留NAS merge残留持锁→since落后数据已在库
- 教训: timeout杀ssh不杀远程python;merge大表必加PRAGMA;断点续传since.txt救命

Co-Authored-By: Claude <noreply@anthropic.com>

2026-07-30 18:08:42 +08:00

claude_dev

851d7d49b7

feat(deploy): Phase4 代码晋升脚本 promote.sh + runbook

Mac→NAS(rsync代码镜像)+Mac→VPS(scp生产部署)单向晋升管线。
- 数据铁律双层防护: rsync --exclude='/data' + scp按模块天然隔离data/
- --module 单模块快速补推 / 全量 双模式
- VPS无常驻web, 代码部署后下次schtask/回测启动自动生效,无需hot reload
- dry-run双端验证通过(VPS+NAS标记落盘后还原无残留)
- ssh用49.232.102.198(严禁ssh vps,fake-ip劫持198.18.1.254)

Co-Authored-By: Claude <noreply@anthropic.com>

2026-07-29 21:47:11 +08:00

claude_dev

f701f10bc5

feat(env): Phase3 dbbardata增量同步脚本 + pre-existing测试问题存档

Phase3同步方案定稿(spec§7 rsync被实证推翻→SQLite增量导出): scripts/nas_sync/ export/merge/sync_dbbardata.sh, VPS零新增依赖(纯sqlite3), id rowid增量0.77s, NAS pull方向, stdin喂脚本不落盘VPS(绕classifier). docs/three-env-preexisting-issues.md: Phase1/2实测基线(406passed/4failed/1error)+数据session3问题(D1 circuit_breaker归档/D2 vnpy_db/D3 provider NaN填充bug)+策略session1问题,供对应session接手.

2026-07-29 21:11:36 +08:00

3 Commits