4 commits
| Author | SHA1 | Message | Date | |
|---|---|---|---|---|
|
|
085e8bdd2d |
Stage 4: pre-register threat-grounded traces (cutoff 2025-07-01, family split)
Some checks failed
Build and Test / build (debug, clang) (push) Has been cancelled
Build and Test / build (debug, gcc) (push) Has been cancelled
Build and Test / build (release, clang) (push) Has been cancelled
Build and Test / build (release, gcc) (push) Has been cancelled
Build and Test / macos (push) Has been cancelled
Build and Test / docker (push) Has been cancelled
Written before any threat trace is collected or evaluated. Train on families first reported before 2025-07-01, evaluate on families first reported after it (new-family bucket primary), from public write-ups and Atomic Red Team only: Triage and MalwareBazaar terms forbid ML training. Adds gate criterion 5 (model recall >= rarity-greedy on new families). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> |
||
|
|
bbfda149a5 |
Stage 4: execute a promoted model's inspections, under guardrails
Some checks failed
Build and Test / build (debug, clang) (push) Has been cancelled
Build and Test / build (debug, gcc) (push) Has been cancelled
Build and Test / build (release, clang) (push) Has been cancelled
Build and Test / build (release, gcc) (push) Has been cancelled
Build and Test / macos (push) Has been cancelled
Build and Test / docker (push) Has been cancelled
A promoted model (promoted.sbm, written only by `model promote` after the gate) can now request real inspections. Only two, both additive: - memory_scan: through the daemon's memory-scan queue; - deep_rescan: the root's image re-scanned on demand; new matches are recorded as indicators of kind model_inspection (findings titled "YARA match found by a deeper rescan the inspection model requested") and positive labels. watch_subtree has no mechanism and rescan_on_next_rules is the retro-hunt's job, so both are masked out of acting decisions (kExecutableActions), and replay's policy evaluation uses the same action set. Guardrails: - InspectionExecutor (bounded queue, one low-priority worker, submit() never blocks); WorkClass::model_inspect lets the governor defer it, and a deferred decision is dropped. - Each action rechecks that the promoted model is still active at the decision's generation (demoting or replacing it revokes queued work), that the root's node id and raw image path still match (decisions carry root_image, not the feature template), and skips protected processes. A deep rescan discards its result if the process, image or rules changed during the scan. - An acting decision is durably written before it is dispatched; every attempt becomes an inspection_outcome record (queued, scanned, skipped, deferred, revoked, queue_full, failed). - Source invariant R10: no file may couple learning types to the exec-guard, OpenSnitch or policy APIs (daemon_app.cpp and main.cpp, the wiring points, are reviewed by hand). Models never block, contain, kill or create findings directly. - Config model_act and model_lambda; status model block reports acting stats; timings.model_inspection. docs/evaluation/stage4-execution-gate.md amends the gate's method (not its thresholds): executable action set, greedy promoted decisions, budgets as estimated inspection seconds by scan profile. Also: TerminalSafeBuf's destructor no longer lets an exception escape; the health message clamps huge durations; replay timestamp overflow; the Docker test build runs with -j2. Tests: test_inspection_executor (every skip and execute path, revocation, queue limits); shadow and replay acting cases; R10 fixture; fault injection and invariant updates. Validation reported by the session that wrote it: 48/48 local, 46/46 Docker plus privileged live checks, 20 fuzz targets (9.5M runs), three paired KPI runs without regressions (no acting model was loaded, so active-inspection cost is not measured yet). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> |
||
|
|
b6d667b797 |
Stage 4: evaluate inspection policies in replay; gated promotion
Some checks failed
Build and Test / build (debug, clang) (push) Has been cancelled
Build and Test / build (debug, gcc) (push) Has been cancelled
Build and Test / build (release, clang) (push) Has been cancelled
Build and Test / build (release, gcc) (push) Has been cancelled
Build and Test / macos (push) Has been cancelled
Build and Test / docker (push) Has been cancelled
- replay --policy-eval: over ranked windows, simulates the model and rarity-greedy (the same chooser, rarity score / 48 as the value), each with its own hourly budget, and tallies the shadow decisions the daemon logged. Hits are inspected "extra" positives: late labels or injected evaluation traces on windows rules did not flag at exec time. Labels are known after the fact, so every action's payoff is computable without propensity weighting. Reports CPU-seconds, inspections, hits, recall, hits per CPU-second and budget refusals. - docs/evaluation/stage4-promotion-gate.md (pre-registered): at least 10 extra positives, model efficiency >= 1.5x rarity-greedy, model recall not lower. promotion_gate() checks it. - strawberry model promote [--inject FILE] [--warmup H] [--yes]: replays with the shadow model, applies the gate and only then writes promoted.sbm; asks for confirmation. - learn/inspection.hpp: options, the greedy chooser and the inspection_action record, shared by shadow mode and the evaluation. - Fix: the hourly budget reset whenever a window closed with an earlier timestamp than the hour's start (windows close roughly, not strictly, in time order), letting spend exceed the budget; in both shadow mode and the evaluation. Tests: test_replay R11 (gate criteria; extra positives exclude rule-flagged windows; spend within the budget; logged shadow decisions joined to their windows); CLI translations. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> |
||
|
|
4e25666a70 |
Inject scripted attack traces into replay and score them
Some checks failed
Build and Test / build (debug, clang) (push) Has been cancelled
Build and Test / build (debug, gcc) (push) Has been cancelled
Build and Test / build (release, clang) (push) Has been cancelled
Build and Test / build (release, gcc) (push) Has been cancelled
Build and Test / docker (push) Has been cancelled
- src/learn/trace.cpp: a small trace format (exec, connect, write, ptrace, module with +offsets and process aliases) compiled to telemetry records with pids above any pid_max and node ids that name the trace and copy. - --replay --inject FILE [--inject-copies N]: copies are spread evenly over the ranked history (a first pass reads the time range), scored but never learned from, and checked against alert budgets of 1, 3 and 10 per day: is the copy's best window above the (budget x days)-th best real window? Ties count against. Injection leaves real windows and their ranking unchanged. - config/traces/standard.trace: the six plan traces (browser to curl|sh, systemd user persistence, memfd loader, ptrace injection, download then exec, python from a PDF viewer). - docs/evaluation/stage3-rarity-preregistration.md: method and pass thresholds, written before any run on host data. Tests: test_trace (standard traces, error messages with line numbers, records); test_replay R8 (every copy found, real ranking unchanged, a novel chain caught at 10/day and a bare shell not). fuzz_trace_dsl. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> |