procurement-ingest/lambdas/wo
Adam Moussa 3584b892bc
harden ai_fallback gate: review fixes + security-review findings
Review follow-up on the ai_fallback validation gate (PR #104), plus
findings from a fan-out /sh-security-review of the change surface.

Reviewer FIX items:
- Neutralize forged <email> delimiters in the untrusted body before
  wrapping, so an in-body </email> cannot escape the data block.
- Fail closed on non-dict model output instead of crashing the handler
  into async retries; count ai_fallback_rejected parses in the
  fallback-rate alarm and add a dedicated rejected-parse alarm so a
  gate-rejection drift outage is not silent.
- Return a distinct invalid_status reason (was malformed_site_code);
  validate ISO-8601 dates; README + docstring updates.

Security-review findings (detector fan-out + proof-or-kill verifier):
- ReDoS (confirmed, medium): the tag neutralizer used two \s* around an
  optional /, backtracking quadratically on "<" + a long whitespace run
  (~32s at 100k chars -- one email could time out the Lambda). Collapse
  to a single [\s/]* class: linear, same defanging.
- Unhashable-type crash (confirmed): a JSON list/dict for email_type or
  status made `x in <set>` raise TypeError, escaping the gate into
  retries. Guard with isinstance(str) before membership.
- Unicode/newline regex (confirmed): _WO_ID_RE/_SITE_CODE_RE used ^..$
  with \d, admitting fullwidth digits ("12345" as a lookalike
  partition key) and trailing newlines. Switch to \A[0-9]+\Z (and the
  handler's inline recheck to [0-9]) so neither passes.
- Alarm comment (confirmed, low): corrected the "slow trickle still
  pages" wording -- rejections >~25-30 min apart page on neither alarm,
  the same knowingly-accepted residual as sender-auth-rejected.

Refuted: residual free-text prompt injection is inherent to trusting
allowlisted senders, not a new primitive; no DynamoDB key-poisoning
bypass survives both gates ('#' can never enter work_order_id).

7 new regression tests. All 260 tests pass; ruff clean; cdk synth OK.
2026-07-16 16:14:21 -04:00
..
email_processor harden ai_fallback gate: review fixes + security-review findings 2026-07-16 16:14:21 -04:00
web_ui Land safe fixes from 2026-06-17 security sweep (#97) 2026-07-15 20:17:46 -04:00