strawberry/fuzz
trvon 7149a90893
gate: refuse in-sample and degenerate evidence, and identify the model
Four findings from a four-lane audit made the promotion gate unable to support
its own claims.

In-sample evaluation: training walks the whole post-warm-up store and the gate
evaluates the same windows, with nothing checking provenance - replay.cpp itself
listed point_in_time_splits_and_overlap_not_assessed. Models now record the
window range they learned from (file format v2; v1 still loads as unknown) and a
content fingerprint, evaluation reports its own range plus in_sample, and
promotion_gate fails with the reason: an overlapping range, no recorded range,
or no digest. Unprovable provenance never counts as out-of-sample.

Degenerate baseline: with rarity-greedy on 0 hits, hits_per_cpu_second() returns
0.0, so ">= 1.5x rarity" reduced to "model hit something" and the recall check
was vacuous. A cell whose baseline scored no hits or spent no CPU now fails,
naming the budget refusals that starved it.

Stale models: cells keyed on a bare filename, so a later cycle that refused to
train left an older cycle's dist/gate models to be judged, and nothing bound a
verdict to the file it judged. Cells and reports carry the model digest, and
fleet gate sets refused (non-zero exit) for a cell without one or for a
(model, period) whose digests disagree across nodes instead of pooling them.

3 seeds are not generalization: they vary initialisation and the per-node
shuffle over identical windows. The procedure document now says so and states
what would test generalization (disjoint periods, models trained on an earlier
cut, out-of-sample ranges).

Tests: in-sample flagged, disjoint range not flagged, unprovable provenance
fails, 0-hit and 0-CPU baselines fail, mixed digests refused, legacy report
refused, range round-trip and fingerprint, v1 compatibility.
2026-11-19 16:20:40 -07:00
..
seeds fuzz: target the YARA rule partitioner 2026-11-17 13:45:12 -07:00
fuzz_block_decoder.cpp Add compressed event store 2026-10-25 18:17:17 -06:00
fuzz_cmdline_redactor.cpp Unify file ids, record uid/comm, redact command lines 2026-10-26 17:58:48 -06:00
fuzz_config.cpp Harden against crashes and I/O faults 2026-10-25 18:17:17 -06:00
fuzz_evidence_records.cpp Add doctor checks and maintenance actions to the daemon 2026-10-27 09:27:23 -06:00
fuzz_governor_parsers.cpp governor: fail-safe host pressure, diagnostic diskstats, capped scan buffers 2026-11-17 13:45:07 -07:00
fuzz_io_faults.cpp Harden against crashes and I/O faults 2026-10-25 18:17:17 -06:00
fuzz_ioc_list.cpp Privacy: tracker list feeds (advisory only, never block) 2026-10-28 05:25:53 -06:00
fuzz_legacy_kv.cpp Drop unqlite-cpp and import legacy databases 2026-10-25 18:46:21 -06:00
fuzz_manifest.cpp Add compressed event store 2026-10-25 18:17:17 -06:00
fuzz_mcp_handle.cpp Harden against crashes and I/O faults 2026-10-25 18:17:17 -06:00
fuzz_model_file.cpp gate: refuse in-sample and degenerate evidence, and identify the model 2026-11-19 16:20:40 -07:00
fuzz_opensnitch_events.cpp Privacy: attribute tracker contacts to programs via OpenSnitch events 2026-10-28 06:15:28 -06:00
fuzz_policy_apply.cpp Harden against crashes and I/O faults 2026-10-25 18:17:17 -06:00
fuzz_procargs.cpp Read process facts on macOS without procfs 2026-10-27 09:55:09 -06:00
fuzz_rarity_state.cpp Stage 4: keep the live rarity model across daemon restarts 2026-10-27 23:25:01 -06:00
fuzz_record_decoder.cpp Add compressed event store 2026-10-25 18:17:17 -06:00
fuzz_replay.cpp Replay: add strict read-only training summaries 2026-11-03 06:54:17 -07:00
fuzz_rule_partition.cpp fuzz: target the YARA rule partitioner 2026-11-17 13:45:12 -07:00
fuzz_segment_reader.cpp Replay: add strict read-only training summaries 2026-11-03 06:54:17 -07:00
fuzz_status_snapshot.cpp Harden against crashes and I/O faults 2026-10-25 18:17:17 -06:00
fuzz_telemetry_records.cpp Stage 4: execute a promoted model's inspections, under guardrails 2026-10-27 21:03:57 -06:00
fuzz_tokenizer.cpp Add the tokenizer and rarity model for the learning stages 2026-10-26 21:21:28 -06:00
fuzz_trace_dsl.cpp Inject scripted attack traces into replay and score them 2026-10-26 22:37:44 -06:00
meson.build fuzz: target the YARA rule partitioner 2026-11-17 13:45:12 -07:00