Add scheduled EventBridge rule for nightly KB sync #4

Closed
opened 2026-04-12 03:54:12 +00:00 by amoussa1229 · 1 comment
amoussa1229 commented 2026-04-12 03:54:12 +00:00 (Migrated from github.com)

Currently the Knowledge Base must be manually synced after new documents are uploaded to S3. Add an EventBridge scheduled rule to trigger an ingestion job automatically on a nightly basis.

Implementation:

  • Add an EventBridge rule in lib/constructs/knowledge-base.ts (or a new construct) on a cron schedule (e.g. nightly at 2am UTC)
  • Target: Lambda or Step Functions that calls StartIngestionJob on the KB data source
  • Grant the Lambda bedrock:StartIngestionJob on the data source ARN

Knowledge Base IDs (for reference):

  • Knowledge Base ID: LSDCNHTH6O
  • Data Source ID: Y0GK8GHTKK
Currently the Knowledge Base must be manually synced after new documents are uploaded to S3. Add an EventBridge scheduled rule to trigger an ingestion job automatically on a nightly basis. **Implementation:** - Add an EventBridge rule in `lib/constructs/knowledge-base.ts` (or a new construct) on a cron schedule (e.g. nightly at 2am UTC) - Target: Lambda or Step Functions that calls `StartIngestionJob` on the KB data source - Grant the Lambda `bedrock:StartIngestionJob` on the data source ARN **Knowledge Base IDs (for reference):** - Knowledge Base ID: `LSDCNHTH6O` - Data Source ID: `Y0GK8GHTKK`
amoussa1229 commented 2026-04-13 19:45:15 +00:00 (Migrated from github.com)

Two new nightly KB syncs have been deployed and tested, partially addressing this issue:

  • 50d5c3c — Merge PR #6: purchase-orders DynamoDB → KB sync (9,279 POs)
  • 1dc275d — Merge PR #7: WorkOrders + Comments DynamoDB → KB sync (1,942 WOs)

Both run daily at 02:00 UTC alongside the existing Notion sync. Schedule frequency will be increased once we move toward production cadence.

Two new nightly KB syncs have been deployed and tested, partially addressing this issue: - 50d5c3c — Merge PR #6: purchase-orders DynamoDB → KB sync (9,279 POs) - 1dc275d — Merge PR #7: WorkOrders + Comments DynamoDB → KB sync (1,942 WOs) Both run daily at 02:00 UTC alongside the existing Notion sync. Schedule frequency will be increased once we move toward production cadence.
This repo is archived. You cannot comment on issues.
No description provided.