claude_dev cbf2db8069 fix(nas): sync_parquet.sh加互斥锁防周日双触发撕损——DSM id=6(周日04:00)当年配置即跑本脚本全量但从未实证(无parquet.log,当时标注待用户DSM UI确认命令),08-21又挂了sync_valuation_daily.sh周日钩子(~03:3x)同一脚本,两路若同日都触发=双scp -r并发写同文件撕损parquet;mkdir原子锁+>6h陈旧覆盖(单跑70min远不到)+trap EXIT清理,哪路先到哪路跑,后到skip留痕 [nas]

2026-08-21 23:18:06 +08:00

..

export_increment.py

feat(env): Phase3 dbbardata增量同步脚本 + pre-existing测试问题存档

2026-07-29 21:11:36 +08:00

export_table.py

feat(nas_sync): 小表全量同步管线(constituent_unified+bs_adjust_factor)

2026-07-31 08:18:36 +08:00

merge_increment.py

refactor(data): 5m改同库设计——用户二次拍板2026-08-20:放弃独立库,5m直接写NAS副本主库dbbardata表(interval='5m'与镜像行d/15m唯一键正交=结构性互不干扰)——①bs_5m_eod缺省库改/volume1/stock/sanguo_vnpy_v2/data_backup/quant_trading.db(=同步目标=NAS回测provider读的库portfolio_worker.py:180),NAS就地5m回测/回放reader零改动,未来VPS扩容导interval='5m'反向merge一次迁移②同库安全性实证:同步链export不带id列+NAS侧INSERT OR IGNORE按UNIQUE去重→键永不相交双向碰不到;纯merge无文件覆盖NAS本地行不会被删;id由NAS AUTOINCREMENT自分配无跨库冲突③ensure_schema防重复索引:PRAGMA index_list/index_info识别已有同列唯一索引(NAS侧uq_dbbardata)跳过,免数GB无谓开销+双倍写放大④merge_increment补busy_timeout=60000(副本库从此有第二个写者,无它撞写锁当场locked失败,60s与5m侧对齐)⑤写锁竞争说明:双写者WAL+busy_timeout串行化,与每日增量merge(秒级)重叠单股失败次日LOOKBACK=7自愈;+2测试(缺省库契约钉死/副本已有索引不重复建);40+153绿(data_platform 155) [nas]

2026-08-20 10:10:04 +08:00

merge_table.py

feat(nas_sync): 小表全量同步管线(constituent_unified+bs_adjust_factor)

2026-07-31 08:18:36 +08:00

promote.sh

feat(ci): CI/CD分层(NAS自动验证+VPS dispatch)

2026-07-31 15:14:05 +08:00

sync_dbbardata.sh

feat(nas_sync): 小表全量同步管线(constituent_unified+bs_adjust_factor)

2026-07-31 08:18:36 +08:00

sync_parquet_daily.sh

feat(nas_sync): parquet per-date 每日增量同步脚本

2026-07-31 22:02:29 +08:00

sync_parquet_resumable.sh

feat(nas_sync): parquet 断点续传脚本(逐文件scp+NAS size校验跳过,治VPS无rsync) [nas]

2026-08-12 08:45:24 +08:00

sync_parquet.sh

fix(nas): sync_parquet.sh加互斥锁防周日双触发撕损——DSM id=6(周日04:00)当年配置即跑本脚本全量但从未实证(无parquet.log,当时标注待用户DSM UI确认命令),08-21又挂了sync_valuation_daily.sh周日钩子(~03:3x)同一脚本,两路若同日都触发=双scp -r并发写同文件撕损parquet;mkdir原子锁+>6h陈旧覆盖(单跑70min远不到)+trap EXIT清理,哪路先到哪路跑,后到skip留痕 [nas]

2026-08-21 23:18:06 +08:00

sync_tables.sh

feat(nas_sync): 小表全量同步管线(constituent_unified+bs_adjust_factor)

2026-07-31 08:18:36 +08:00

sync_valuation_daily.sh

fix(nas): NAS同步链补两个断更域+周日周更全量挂载——2026-08-21晚全域巡检实锤:每日链(dbbardata增量03:00/小表/events四类/valuation+financial_abstract 03:09)全绿,但①valuation_baostock(bs_eod每晚写pe/pb按年parquet)NAS断更自08-16②fundamentals_baostock(08-20新域,fund腿每晚回灌profit/dupont)NAS完全不存在,两域无任何同步器覆盖;③per-stock周更14子域(balance/cashflow/top_holders等,sync_parquet.sh 6.24G全量)从未被调度,仅08-16手动跑过一次,top_holders已漏VPS 08-16 18:18批次。修=扩展sync_valuation_daily.sh(每日实跑载体):循环外加valuation_baostock+fundamentals_baostock两域scp -r(MB级秒级,03:09时VPS写盘已静止,同款3次重试)+周日(date +%u=7)setsid脱离挂sync_parquet.sh周更全量(ak-weekly周六重写后周日兜底);sync_parquet.sh全量清单补fundamentals_baostock源+du对齐;bash -n过 [nas]

2026-08-21 23:16:03 +08:00

vps_restart_resident.sh

feat(ci): vps-deploy末步自动重启常驻进程(supervisor/影子柜台)——根因:部署只推码+重启API,常驻python进程16h跑旧代码(2026-08-15实录);vps_restart_resident.sh:盘中保护(北京工作日09:15-15:30跳过防杀撮合现场)+动态查PID(账户号会变,name=python.exe+sanguo_live supervisor/sanguo_trader.shadow两模式,免wmic自匹配)+taskkill /F /T杀树带走runner_live/shadow子进程+schtasks重拉+120s验证≥2进程;用户2026-08-16要求部署自动化 [nas]

2026-08-16 18:07:02 +08:00

vps_update_dist.py

ci(vps-deploy): 纳入前端dist同步+API重启(治公网前端无管线手动步骤): Mac构建+tar+scp→VPS换dist(脚本入仓scripts/nas_sync,vps_update_dist.py); 重启加端口释放等待(防end→run竞态10048静默崩,今日实踩)+起服探活(上限10min) [nas]

2026-08-14 10:06:54 +08:00