Commit graph

1 commit

Author SHA1 Message Date
trvon
bbec4093cd
fix(daemon): rate-limit repeating warnings that flood the daemon log
With 5 x 10 MB rotation the daemon log covered about three hours on the
audited machine, mostly one of a few lines repeated:

- "Failed to submit extraction ...: entity_graph_jobs channel full"
  (11k lines) from GraphComponent, echoed per batch by PostIngestQueue's
  "KG batch failed", plus "Entity channel full, dropping job";
- the per-document "Title+NL extraction for <hash> in N ms" info line;
- session-watcher scan/indexing warnings retried every pass.

Add yams::common::LogRateLimiter, a small lock-free helper that admits
one message per interval and reports how many it held back ("(N similar
messages suppressed)"), and use it at those sites (60 s for the queue
paths, 10 min for the session watcher, including its first-failure
warning per path). The Title+NL timing line is per-document progress
and moves to debug. The drop counters are unchanged, so status still
shows the full numbers.

Signed-off-by: trvon <me@trevon.dev>
2026-09-27 14:00:25 -06:00