inkreach-prefect

76 Commits 6 Branches 0 Tags

3 Commits

Include renames

Author	SHA1	Message	Date
yeuimu	4a7c44a354	feat: RIIN 商品拉取改用 goods/list 批量接口(200/批串行)替换逐单 order/goods CI / test (pull_request) Successful in 1m11s Details - api/riin/client.py: 新增 get_order_goods_batch(distribution/order/goods/list) - flows/shared/clients.py: fetch_goods_concurrent → fetch_goods_for_orders, 批量 200/批、串行、批间 2s,批级重试;移除逐单全局限速(340~500ms)机制 - flows/riin/_pipeline.py: 适配新批量拉取 - flows/shared/db.py: 存在性预查 unnest cast timestamp[] → timestamptz[] (入参为带时区偏移的 tz-aware datetime,timestamptz 才能稳定匹配) 背景:旧逐单接口高频被软限流(成功返回空 data),10-28 起日均缺口 13~33%; 批量接口调用量从日均 ~1 万次降到 ~50 次,已实测回补 7689 单/9717 条商品全量成功。	2026-10-31 10:01:50 +00:00
yeuimu	4ec7cf2dd6	feat: 详细日志(分页/映射/批次进度)+ Artifacts 摘要(sync-summary/verify-report)	2026-07-23 09:01:39 +00:00
yeuimu	4cba1da4e1	init: Prefect ETL sync project (RIIN/SDS → PG) with 12 sync flows	2026-07-23 08:13:09 +00:00

Author

SHA1

Message

Date

yeuimu

4a7c44a354

feat: RIIN 商品拉取改用 goods/list 批量接口(200/批串行)替换逐单 order/goods

CI / test (pull_request) Successful in 1m11s

Details

- api/riin/client.py: 新增 get_order_goods_batch(distribution/order/goods/list)
- flows/shared/clients.py: fetch_goods_concurrent → fetch_goods_for_orders,
  批量 200/批、串行、批间 2s,批级重试;移除逐单全局限速(340~500ms)机制
- flows/riin/_pipeline.py: 适配新批量拉取
- flows/shared/db.py: 存在性预查 unnest cast timestamp[] → timestamptz[]
  (入参为带时区偏移的 tz-aware datetime,timestamptz 才能稳定匹配)

背景:旧逐单接口高频被软限流(成功返回空 data),10-28 起日均缺口 13~33%;
批量接口调用量从日均 ~1 万次降到 ~50 次,已实测回补 7689 单/9717 条商品全量成功。

2026-10-31 10:01:50 +00:00

yeuimu

4ec7cf2dd6

feat: 详细日志(分页/映射/批次进度)+ Artifacts 摘要(sync-summary/verify-report)

2026-07-23 09:01:39 +00:00

yeuimu

4cba1da4e1

init: Prefect ETL sync project (RIIN/SDS → PG) with 12 sync flows

2026-07-23 08:13:09 +00:00