This website requires JavaScript.
Explore
Help
Register
Sign In
sanguo
/
sanguo_vnpy_v2
Watch
2
Star
0
Fork
0
You've already forked sanguo_vnpy_v2
Code
Issues
1
Pull Requests
Actions
Packages
Projects
Releases
Wiki
Activity
Files
d54f648efc7a29a1e945310d58e69acdc91440bd
sanguo_vnpy_v2
/
scripts
/
nas_sync
T
History
claude_dev
20ff70e85d
CI/CD / test (push)
Successful in 15s
Details
CI/CD / nas-deploy (push)
Successful in 34s
Details
CI/CD / nas-verify (push)
Successful in 15s
Details
refactor(data): 5m改同库设计——用户二次拍板2026-08-20:放弃独立库,5m直接写NAS副本主库dbbardata表(interval='5m'与镜像行d/15m唯一键正交=结构性互不干扰)——①bs_5m_eod缺省库改/volume1/stock/sanguo_vnpy_v2/data_backup/quant_trading.db(=同步目标=NAS回测provider读的库portfolio_worker.py:180),NAS就地5m回测/回放reader零改动,未来VPS扩容导interval='5m'反向merge一次迁移②同库安全性实证:同步链export不带id列+NAS侧INSERT OR IGNORE按UNIQUE去重→键永不相交双向碰不到;纯merge无文件覆盖NAS本地行不会被删;id由NAS AUTOINCREMENT自分配无跨库冲突③ensure_schema防重复索引:PRAGMA index_list/index_info识别已有同列唯一索引(NAS侧uq_dbbardata)跳过,免数GB无谓开销+双倍写放大④merge_increment补busy_timeout=60000(副本库从此有第二个写者,无它撞写锁当场locked失败,60s与5m侧对齐)⑤写锁竞争说明:双写者WAL+busy_timeout串行化,与每日增量merge(秒级)重叠单股失败次日LOOKBACK=7自愈;+2测试(缺省库契约钉死/副本已有索引不重复建);40+153绿(data_platform 155) [nas]
2026-08-20 10:10:04 +08:00
..
export_increment.py
feat(env): Phase3 dbbardata增量同步脚本 + pre-existing测试问题存档
2026-07-29 21:11:36 +08:00
export_table.py
feat(nas_sync): 小表全量同步管线(constituent_unified+bs_adjust_factor)
2026-07-31 08:18:36 +08:00
merge_increment.py
refactor(data): 5m改同库设计——用户二次拍板2026-08-20:放弃独立库,5m直接写NAS副本主库dbbardata表(interval='5m'与镜像行d/15m唯一键正交=结构性互不干扰)——①bs_5m_eod缺省库改/volume1/stock/sanguo_vnpy_v2/data_backup/quant_trading.db(=同步目标=NAS回测provider读的库portfolio_worker.py:180),NAS就地5m回测/回放reader零改动,未来VPS扩容导interval='5m'反向merge一次迁移②同库安全性实证:同步链export不带id列+NAS侧INSERT OR IGNORE按UNIQUE去重→键永不相交双向碰不到;纯merge无文件覆盖NAS本地行不会被删;id由NAS AUTOINCREMENT自分配无跨库冲突③ensure_schema防重复索引:PRAGMA index_list/index_info识别已有同列唯一索引(NAS侧uq_dbbardata)跳过,免数GB无谓开销+双倍写放大④merge_increment补busy_timeout=60000(副本库从此有第二个写者,无它撞写锁当场locked失败,60s与5m侧对齐)⑤写锁竞争说明:双写者WAL+busy_timeout串行化,与每日增量merge(秒级)重叠单股失败次日LOOKBACK=7自愈;+2测试(缺省库契约钉死/副本已有索引不重复建);40+153绿(data_platform 155) [nas]
2026-08-20 10:10:04 +08:00
merge_table.py
feat(nas_sync): 小表全量同步管线(constituent_unified+bs_adjust_factor)
2026-07-31 08:18:36 +08:00
promote.sh
feat(ci): CI/CD分层(NAS自动验证+VPS dispatch)
2026-07-31 15:14:05 +08:00
sync_dbbardata.sh
feat(nas_sync): 小表全量同步管线(constituent_unified+bs_adjust_factor)
2026-07-31 08:18:36 +08:00
sync_parquet_daily.sh
feat(nas_sync): parquet per-date 每日增量同步脚本
2026-07-31 22:02:29 +08:00
sync_parquet_resumable.sh
feat(nas_sync): parquet 断点续传脚本(逐文件scp+NAS size校验跳过,治VPS无rsync) [nas]
2026-08-12 08:45:24 +08:00
sync_parquet.sh
fix(nas_sync): sync_parquet.sh 加保活+retry(防6.24G跨公网broken pipe)
2026-08-01 07:37:31 +08:00
sync_tables.sh
feat(nas_sync): 小表全量同步管线(constituent_unified+bs_adjust_factor)
2026-07-31 08:18:36 +08:00
sync_valuation_daily.sh
fix(nas_sync): sync_valuation_daily 改scp-r(单tar跨公网broken pipe)
2026-08-01 02:04:19 +08:00
vps_restart_resident.sh
feat(ci): vps-deploy末步自动重启常驻进程(supervisor/影子柜台)——根因:部署只推码+重启API,常驻python进程16h跑旧代码(2026-08-15实录);vps_restart_resident.sh:盘中保护(北京工作日09:15-15:30跳过防杀撮合现场)+动态查PID(账户号会变,name=python.exe+sanguo_live supervisor/sanguo_trader.shadow两模式,免wmic自匹配)+taskkill /F /T杀树带走runner_live/shadow子进程+schtasks重拉+120s验证≥2进程;用户2026-08-16要求部署自动化 [nas]
2026-08-16 18:07:02 +08:00
vps_update_dist.py
ci(vps-deploy): 纳入前端dist同步+API重启(治公网前端无管线手动步骤): Mac构建+tar+scp→VPS换dist(脚本入仓scripts/nas_sync,vps_update_dist.py); 重启加端口释放等待(防end→run竞态10048静默崩,今日实踩)+起服探活(上限10min) [nas]
2026-08-14 10:06:54 +08:00