sanguo_vnpy_v2

sanguo/sanguo_vnpy_v2

Fork 0

Commit Graph

Author	SHA1	Message	Date
claude_dev	b2aab85105	feat(nas_sync): 小表全量同步管线(constituent_unified+bs_adjust_factor) CI/CD / test (push) Successful in 10s Details CI/CD / nas-smoke (push) Successful in 2s Details CI/CD / vps (push) Successful in 18s Details 新增 export_table.py/merge_table.py/sync_tables.sh: VPS stdin喂python全量dump → scp → NAS全量替换(DROP+CREATE+INSERT,幂等可重跑)。sync_dbbardata.sh 每日increment末尾连带跑 sync_tables,保持NAS副本成份股/复权因子不陈旧。修复NAS组合回测选股恒空(NAS副本缺constituent_unified表,phase3只导dbbardata)。	2026-07-31 08:18:36 +08:00
claude_dev	d76171434b	fix(nas_sync): Phase3 full 修复(STEP降片+merge PRAGMA)+全量完成2.02亿行 - sync_dbbardata.sh: STEP 2000万→200万/片(首片2GB export+scp跨公网挂) - merge_increment.py: 加 PRAGMA cache=500MB+WAL+NORMAL+synchronous (replica 2亿行 UNIQUE索引数GB,默认2MB cache致索引IO merge>120s超时) - 全量完成: replica 2.019亿行(=dbbardata全量日线+15min+ETF) - 踩坑链: ssh reset中断→timeout杀ssh留NAS merge残留持锁→since落后数据已在库 - 教训: timeout杀ssh不杀远程python;merge大表必加PRAGMA;断点续传since.txt救命 Co-Authored-By: Claude <noreply@anthropic.com>	2026-07-30 18:08:42 +08:00
claude_dev	f701f10bc5	feat(env): Phase3 dbbardata增量同步脚本 + pre-existing测试问题存档 Phase3同步方案定稿(spec§7 rsync被实证推翻→SQLite增量导出): scripts/nas_sync/ export/merge/sync_dbbardata.sh, VPS零新增依赖(纯sqlite3), id rowid增量0.77s, NAS pull方向, stdin喂脚本不落盘VPS(绕classifier). docs/three-env-preexisting-issues.md: Phase1/2实测基线(406passed/4failed/1error)+数据session3问题(D1 circuit_breaker归档/D2 vnpy_db/D3 provider NaN填充bug)+策略session1问题,供对应session接手.	2026-07-29 21:11:36 +08:00

Author

SHA1

Message

Date

claude_dev

b2aab85105

feat(nas_sync): 小表全量同步管线(constituent_unified+bs_adjust_factor)

CI/CD / test (push) Successful in 10s

Details

CI/CD / nas-smoke (push) Successful in 2s

Details

CI/CD / vps (push) Successful in 18s

Details

新增 export_table.py/merge_table.py/sync_tables.sh: VPS stdin喂python全量dump → scp → NAS全量替换(DROP+CREATE+INSERT,幂等可重跑)。sync_dbbardata.sh 每日increment末尾连带跑 sync_tables,保持NAS副本成份股/复权因子不陈旧。修复NAS组合回测选股恒空(NAS副本缺constituent_unified表,phase3只导dbbardata)。

2026-07-31 08:18:36 +08:00

claude_dev

d76171434b

fix(nas_sync): Phase3 full 修复(STEP降片+merge PRAGMA)+全量完成2.02亿行

- sync_dbbardata.sh: STEP 2000万→200万/片(首片2GB export+scp跨公网挂)
- merge_increment.py: 加 PRAGMA cache=500MB+WAL+NORMAL+synchronous
  (replica 2亿行 UNIQUE索引数GB,默认2MB cache致索引IO merge>120s超时)
- 全量完成: replica 2.019亿行(=dbbardata全量日线+15min+ETF)
- 踩坑链: ssh reset中断→timeout杀ssh留NAS merge残留持锁→since落后数据已在库
- 教训: timeout杀ssh不杀远程python;merge大表必加PRAGMA;断点续传since.txt救命

Co-Authored-By: Claude <noreply@anthropic.com>

2026-07-30 18:08:42 +08:00

claude_dev

f701f10bc5

feat(env): Phase3 dbbardata增量同步脚本 + pre-existing测试问题存档

Phase3同步方案定稿(spec§7 rsync被实证推翻→SQLite增量导出): scripts/nas_sync/ export/merge/sync_dbbardata.sh, VPS零新增依赖(纯sqlite3), id rowid增量0.77s, NAS pull方向, stdin喂脚本不落盘VPS(绕classifier). docs/three-env-preexisting-issues.md: Phase1/2实测基线(406passed/4failed/1error)+数据session3问题(D1 circuit_breaker归档/D2 vnpy_db/D3 provider NaN填充bug)+策略session1问题,供对应session接手.

2026-07-29 21:11:36 +08:00

3 Commits